00000001:02000400:3.0F:1787779673.510951:0:3292:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg331-server.virtnet: executing set_hostid 00000001:02000400:0.0F:1787779692.147183:0:3517:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg331-server.virtnet: executing load_modules_local 00000001:01000000:1.0F:1787779693.944870:0:3580:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 959 MB/s 00000001:01000000:0.0:1787779694.195933:0:3580:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 848 MB/s 00000001:01000000:2.0F:1787779694.445921:0:3580:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 4959 MB/s 00000020:02000000:2.0:1787779694.917075:0:3609:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_57_g44c575c 00000400:02000000:1.0:1787779695.737256:0:3624:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.203.131@tcp [8/256/0/180] 00008000:02000000:2.0:1787779699.649950:0:3774:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:1.0:1787779757.760526:0:5739:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg331-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1787779770.350018:0:6489:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787779770.350025:0:6489:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:3.0:1787779770.350027:0:6489:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1787779770.350159:0:6489:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000852291a7 00000080:02000400:3.0:1787779770.350171:0:6489:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:3.0:1787779770.358273:0:6489:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200065, mountfl=0 00000020:01000004:3.0:1787779770.359640:0:6489:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1787779770.360462:0:6489:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000d93988e2) 00000020:00000080:2.0:1787779770.360487:0:6489:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1787779770.441095:0:6489:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:0.0:1787779770.441180:0:6489:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00080000:01000000:3.0:1787779770.467673:0:6489:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1787779770.468114:0:6489:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1787779770.468128:0:6489:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787779770.468141:0:6489:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc8fc0a5179960161 00000020:01000004:3.0:1787779770.468149:0:6489:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:3.0:1787779770.468153:0:6489:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1787779770.468157:0:6489:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000852291a7 from MGS 00000020:01000004:3.0:1787779770.468162:0:6489:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1787779770.468182:0:6489:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000b1a85cd4) 00000020:00000080:3.0:1787779770.468193:0:6489:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1787779770.468454:0:6489:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000852291a7 from MGS, refs=2 00080000:01000000:3.0:1787779770.468459:0:6489:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787779770.468464:0:6489:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc8fc0a517996016f 00000100:00100000:3.0:1787779770.468620:0:6489:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1787779770.469085:0:6489:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1787779770.469092:0:6489:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1787779770.469636:0:6489:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1787779770.469643:0:6489:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1787779770.470708:0:6489:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787779770.471643:0:6489:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1787779770.471651:0:6489:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1787779770.472406:0:6489:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1787779770.472414:0:6489:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1787779770.473150:0:6489:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1787779770.473159:0:6489:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1787779770.475077:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787779770.475083:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787779770.475085:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787779770.475469:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787779770.475472:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787779770.475473:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787779770.476421:0:6489:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1787779770.482403:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1787779770.726362:0:6489:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2423 MB/s 00000001:01000000:3.0:1787779770.975937:0:6489:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 3355 MB/s 00000001:01000000:2.0:1787779771.227465:0:6489:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 529 MB/s 00000001:01000000:0.0:1787779771.477214:0:6489:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 899 MB/s 00010000:00010000:1.0:1787779771.483953:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:0.0:1787779771.488119:0:6489:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000040:01000000:0.0:1787779771.506425:0:6489:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:2.0:1787779771.512590:0:6503:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1787779771.513560:0:6489:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1787779771.513612:0:6489:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:0.0:1787779771.513817:0:6489:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1787779771.513992:0:6489:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1787779771.514504:0:6489:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787779771.514664:0:6489:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1787779771.514670:0:6489:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1787779771.516494:0:6489:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1787779771.516506:0:6489:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1787779771.516821:0:6489:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1787779771.516828:0:6489:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1787779771.517546:0:6489:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1787779771.517568:0:6489:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.131@tcp' 00000020:01000004:2.0:1787779771.517570:0:6489:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000100:00080000:0.0:1787779771.517697:0:6508:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:01000004:2.0:1787779771.517732:0:6489:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.131@tcp (typ=mgc) 00000020:00000080:2.0:1787779771.517742:0:6489:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.131@tcp (00000000484bd063) 00000020:00000080:2.0:1787779771.517759:0:6489:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1787779771.517868:0:6489:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000017ada013@MGC192.168.203.131@tcp: add connection 192.168.203.131@tcp at head 00010000:00010000:2.0:1787779771.518029:0:6489:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.131@tcp-0 is initialized 00000040:01000000:2.0:1787779771.518035:0:6489:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.131@tcp ctxt 1 is initialized 10000000:01000000:2.0:1787779771.519962:0:6509:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1787779771.520016:0:6489:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.131@tcp (uuid 1f575176-36bc-4786-83ee-2fea064a12a9) 00000020:00000080:2.0:1787779771.520039:0:6489:0:(genops.c:1385:class_connect()) connect: client 1f575176-36bc-4786-83ee-2fea064a12a9, cookie 0xc8fc0a517996017d 00000100:00080000:2.0:1787779771.520050:0:6489:0:(import.c:510:import_select_connection()) MGC192.168.203.131@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787779771.520055:0:6489:0:(import.c:624:import_select_connection()) MGC192.168.203.131@tcp: import 0000000017ada013 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:2.0:1787779771.520088:0:6489:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000006b509556 x1874622881464448/t0(0) o250->MGC192.168.203.131@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787779771.520108:0:6489:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 1f575176-36bc-4786-83ee-2fea064a12a9->MGS 00000020:01000004:2.0:1787779771.520126:0:6489:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1787779771.520131:0:6489:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1787779771.520143:0:6489:0:(genops.c:413:class_newdev()) Allocate new device MDS (000000002cd190d0) 00000020:00000080:2.0:1787779771.520155:0:6489:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1787779771.525918:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006b509556 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1f575176-36bc-4786-83ee-2fea064a12a9:3640:1874622881464448:0@lo:250: 00000100:00100000:0.0:1787779771.526016:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779771.528203:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881464448 00000100:00100000:0.0:1787779771.528216:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881464448 00000100:00100000:0.0:1787779771.528262:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787779771.528269:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c18463c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:3640:x1874622881464448:12345-0@lo:250: 00010000:00080000:0.0:1787779771.528299:0:6506:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 1f575176-36bc-4786-83ee-2fea064a12a9@0@lo t0 exp 0000000000000000 cur 179 last 0 00000020:00000080:0.0:1787779771.528340:0:6506:0:(genops.c:1385:class_connect()) connect: client 1f575176-36bc-4786-83ee-2fea064a12a9, cookie 0xc8fc0a517996018b 00000100:00080000:0.0:1787779771.528468:0:6506:0:(import.c:65:import_set_state_nolock()) 0000000075761602 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787779771.528545:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c18463c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+5:3640:x1874622881464448:12345-0@lo:250: Request processed in 275us (2530us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779771.528553:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787779771.528602:0:3640:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.203.131@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1787779771.528610:0:3640:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.131@tcp: connect to target with instance 0 00000100:00080000:0.0:1787779771.528617:0:3640:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.131@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1787779771.528623:0:3640:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1787779771.528626:0:3640:0:(import.c:65:import_set_state_nolock()) 0000000017ada013 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1787779771.528629:0:3640:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1787779771.528631:0:3640:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1787779771.528635:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006b509556 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1f575176-36bc-4786-83ee-2fea064a12a9:3640:1874622881464448:0@lo:250: 00000100:00100000:2.0:1787779771.535120:0:6489:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787779771.535300:0:6489:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1787779771.535383:0:6489:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1787779771.542986:0:6489:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1787779771.542999:0:6489:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1787779771.543642:0:6489:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1787779771.543651:0:6489:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1787779771.544775:0:6489:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787779771.545124:0:6489:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1787779771.545129:0:6489:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1787779771.545647:0:6489:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1787779771.545654:0:6489:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1787779771.591357:0:6489:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787779771.591640:0:6489:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1787779771.591647:0:6489:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1787779771.593574:0:6489:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1787779771.593586:0:6489:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1787779771.594657:0:6489:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787779771.595046:0:6489:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1787779771.595052:0:6489:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1787779771.602343:0:6489:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1787779771.602457:0:6489:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1787779771.605125:0:6489:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787779771.605325:0:6489:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1787779771.605332:0:6489:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1787779771.615955:0:6489:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1787779771.615979:0:6489:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1787779771.617430:0:6489:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787779771.617612:0:6489:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1787779771.617618:0:6489:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1787779771.621654:0:6489:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1787779771.621671:0:6489:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1787779771.638020:0:6489:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787779771.638272:0:6489:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1787779771.638279:0:6489:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1787779771.640171:0:6489:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1787779771.640186:0:6489:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1787779771.641320:0:6489:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1787779771.641332:0:6489:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1787779771.642216:0:6489:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1787779771.642245:0:6489:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:1.0:1787779771.642251:0:6489:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.131@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1787779771.642367:0:6489:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.131@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787779771.642403:0:6489:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.131@tcp, index=0000, flags=0x20065 00000020:01000004:1.0:1787779771.642407:0:6489:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787779771.642409:0:6489:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787779771.642414:0:6489:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787779771.642415:0:6489:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787779771.642416:0:6489:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787779771.642417:0:6489:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787779771.642418:0:6489:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787779771.642419:0:6489:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787779771.642420:0:6489:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787779771.642421:0:6489:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787779771.642422:0:6489:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787779771.642423:0:6489:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787779771.642425:0:6489:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:1.0:1787779771.642427:0:6489:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787779771.642428:0:6489:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787779771.642429:0:6489:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787779771.642429:0:6489:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787779771.642430:0:6489:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787779771.642431:0:6489:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787779771.642432:0:6489:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787779771.642432:0:6489:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787779771.642433:0:6489:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787779771.642433:0:6489:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787779771.642434:0:6489:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787779771.642435:0:6489:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787779771.642460:0:6489:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1787779771.642476:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000041ab582c pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:6489:1874622881464576:0@lo:253: 00000100:00100000:1.0:1787779771.642547:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779771.642646:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set 0000000099178daa going to sleep for 11 seconds 00000100:00100000:0.0:1787779771.642691:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881464576 00000100:00100000:0.0:1787779771.642698:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881464576 00000100:00100000:0.0:1787779771.642765:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787779771.642774:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008c728bdb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+5:6489:x1874622881464576:12345-0@lo:253: 20000000:01000000:0.0:1787779771.642931:0:6507:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787779771.642934:0:6507:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:2.0:1787779771.643287:0:6528:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1787779771.643337:0:6507:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:0.0:1787779771.643712:0:6507:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787779771.644625:0:6529:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:0.0:1787779771.646281:0:6507:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787779771.646287:0:6507:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:0.0:1787779771.646294:0:6507:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:0.0:1787779771.646322:0:6507:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:0.0:1787779771.646339:0:6507:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:0.0:1787779771.646534:0:6507:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787779771.646674:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:0.0:1787779771.646690:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1787779771.646709:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:0.0:1787779771.646726:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:0.0:1787779771.646740:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:0.0:1787779771.646915:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:0.0:1787779771.646926:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:0.0:1787779771.646939:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:0.0:1787779771.646946:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:0.0:1787779771.646959:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:0.0:1787779771.646965:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:0.0:1787779771.646995:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:0.0:1787779771.647014:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:0.0:1787779771.647044:0:6507:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1787779771.647049:0:6507:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:0.0:1787779771.647055:0:6507:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787779771.647300:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:0.0:1787779771.647323:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1787779771.647338:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:0.0:1787779771.647353:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:0.0:1787779771.647367:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:0.0:1787779771.647376:0:6507:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:0.0:1787779771.647401:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:0.0:1787779771.647409:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1787779771.647421:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:0.0:1787779771.647437:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:0.0:1787779771.647453:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:0.0:1787779771.647462:0:6507:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:0.0:1787779771.647484:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:0.0:1787779771.647500:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:0.0:1787779771.647513:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:0.0:1787779771.647529:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:0.0:1787779771.647597:0:6507:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:0.0:1787779771.647619:0:6507:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1787779771.647626:0:6507:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:2.0:1787779771.653967:0:6530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:0.0:1787779771.654340:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:0.0:1787779771.654386:0:6507:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.131@tcp for mdt 20000000:01000000:0.0:1787779771.654389:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.131@tcp (null) (null) (null) 00000040:00080000:0.0:1787779771.654403:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:0.0:1787779771.654410:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1787779771.654423:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:0.0:1787779771.654430:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.203.131@tcp (null) (null) 00000040:00080000:0.0:1787779771.654455:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:0.0:1787779771.654466:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:0.0:1787779771.654479:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:0.0:1787779771.654494:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:0.0:1787779771.654525:0:6507:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:0.0:1787779771.654529:0:6507:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1787779771.654533:0:6507:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1787779771.654576:0:6507:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1787779771.654579:0:6507:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:2.0:1787779771.655292:0:6531:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:0.0:1787779771.655472:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:0.0:1787779771.655495:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:0.0:1787779771.655508:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:0.0:1787779771.655519:0:6507:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1787779771.655521:0:6507:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1787779771.655820:0:6532:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:0.0:1787779771.656136:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:0.0:1787779771.656160:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:0.0:1787779771.656178:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 00000020:00000080:0.0:1787779771.656190:0:6507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787779771.656199:0:6507:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:0.0:1787779771.656204:0:6507:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1787779771.656207:0:6507:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1787779771.656213:0:6507:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:0.0:1787779771.656219:0:6507:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:3.0:1787779771.656571:0:6533:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:0.0:1787779771.656818:0:6507:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:0.0:1787779771.664728:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:0.0:1787779771.664771:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:0.0:1787779771.664787:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:0.0:1787779771.664809:0:6507:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1787779771.664828:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000e3ee7153/0xc8fc0a5179960192 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779771.665018:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e3ee7153/0xc8fc0a5179960192 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779771.665029:0:6507:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000e3ee7153/0xc8fc0a5179960192 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779771.665035:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000e3ee7153/0xc8fc0a5179960192 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779771.665041:0:6507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000e3ee7153/0xc8fc0a5179960192 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779771.665047:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000e3ee7153/0xc8fc0a5179960192 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779771.665052:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000e3ee7153 already unused, calling callback (000000008129b6a0) 00010000:00010000:0.0:1787779771.665056:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000e3ee7153/0xc8fc0a5179960192 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779771.665074:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000e3ee7153/0xc8fc0a5179960192 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779771.665086:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000e3ee7153/0xc8fc0a5179960192 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779771.665092:0:6507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000e3ee7153/0xc8fc0a5179960192 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779771.665106:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000e3ee7153/0xc8fc0a5179960192 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787779771.665122:0:6507:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1787779771.675932:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008c728bdb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+5:6489:x1874622881464576:12345-0@lo:253: Request processed in 33153us (33377us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779771.675947:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787779771.676198:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000041ab582c pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:6489:1874622881464576:0@lo:253: 10000000:01000000:1.0:1787779771.676215:0:6489:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1787779771.676218:0:6489:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787779771.676219:0:6489:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787779771.676221:0:6489:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787779771.676222:0:6489:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:1.0:1787779771.676223:0:6489:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787779771.676224:0:6489:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787779771.676225:0:6489:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787779771.676226:0:6489:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787779771.676238:0:6489:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1787779771.676239:0:6489:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787779771.676240:0:6489:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787779771.676259:0:6489:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000852291a7 from lustre-MDT0000 10000000:01000000:1.0:1787779771.676289:0:6489:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1787779771.676293:0:6489:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1787779771.676297:0:6489:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9c04515699b8 10000000:01000000:1.0:1787779771.676312:0:6489:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787779771.676321:0:6489:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9c04515699b8 from 1 10000000:01000000:1.0:1787779771.676324:0:6489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787779771.676361:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: 00000000854f5528/0xc8fc0a5179960199 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779771.676371:0:6489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: 00000000854f5528/0xc8fc0a5179960199 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779771.676379:0:6489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: 00000000854f5528/0xc8fc0a5179960199 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779771.676397:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000041ab582c pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:6489:1874622881464704:0@lo:101: 00000100:00100000:1.0:1787779771.676435:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779771.676516:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set 000000004bd710f5 going to sleep for 11 seconds 00000100:00100000:0.0:1787779771.676617:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881464704 00000100:00100000:0.0:1787779771.676623:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881464704 00000100:00100000:0.0:1787779771.676704:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787779771.676713:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ad0ba229 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+5:6489:x1874622881464704:12345-0@lo:101: 00010000:00010000:0.0:1787779771.676725:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787779771.676738:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e3ee7153/0xc8fc0a51799601a0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc8fc0a5179960199 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779771.676758:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e3ee7153/0xc8fc0a51799601a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc8fc0a5179960199 expref: 6 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779771.676767:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e3ee7153/0xc8fc0a51799601a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a5179960199 expref: 6 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779771.676787:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e3ee7153, rc 0) 00000100:00100000:0.0:1787779771.676827:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ad0ba229 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+6:6489:x1874622881464704:12345-0@lo:101: Request processed in 116us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779771.676834:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787779771.676930:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000041ab582c pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:6489:1874622881464704:0@lo:101: 00010000:00010000:1.0:1787779771.676942:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: 00000000854f5528/0xc8fc0a5179960199 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a51799601a0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779771.676950:0:6489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: 00000000854f5528/0xc8fc0a5179960199 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc8fc0a51799601a0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779771.676998:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000041ab582c pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:6489:1874622881464832:0@lo:501: 00000100:00100000:1.0:1787779771.677025:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779771.677269:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set 000000004bd710f5 going to sleep for 11 seconds 00000100:00100000:2.0:1787779771.677364:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881464832 00000100:00100000:2.0:1787779771.677370:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881464832 00000100:00100000:2.0:1787779771.677393:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787779771.677399:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fa2ae52f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+6:6489:x1874622881464832:12345-0@lo:501: 00000100:00100000:2.0:1787779771.677503:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fa2ae52f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+6:6489:x1874622881464832:12345-0@lo:501: Request processed in 104us (478us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787779771.677510:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787779771.677585:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000041ab582c pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:6489:1874622881464832:0@lo:501: 10000000:01000000:1.0:1787779771.677615:0:6489:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787779771.677633:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: 00000000854f5528/0xc8fc0a5179960199 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a51799601a0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779771.677641:0:6489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: 00000000854f5528/0xc8fc0a5179960199 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a51799601a0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787779771.677648:0:6489:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9c044407a000 10000000:01000000:1.0:1787779771.677652:0:6489:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787779771.677657:0:6489:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9c044407a000 10000000:01000000:1.0:1787779771.677660:0:6489:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1787779771.677662:0:6489:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9c044407a000 from 1 10000000:01000000:1.0:1787779771.677665:0:6489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1787779771.677683:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: 00000000c51b71e7/0xc8fc0a51799601a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779771.677690:0:6489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: 00000000c51b71e7/0xc8fc0a51799601a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779771.677698:0:6489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: 00000000c51b71e7/0xc8fc0a51799601a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779771.677710:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000041ab582c pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:6489:1874622881464960:0@lo:101: 00000100:00100000:1.0:1787779771.677736:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779771.677761:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881464960 00000100:00100000:1.0:1787779771.677765:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881464960 00000100:00100000:1.0:1787779771.677793:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787779771.677799:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000007561e32 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+6:6489:x1874622881464960:12345-0@lo:101: 00010000:00010000:1.0:1787779771.677810:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787779771.677821:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000dfb0b2c3/0xc8fc0a51799601ae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc8fc0a51799601a7 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779771.677835:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000dfb0b2c3/0xc8fc0a51799601ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc8fc0a51799601a7 expref: 7 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779771.677878:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000dfb0b2c3/0xc8fc0a51799601ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a51799601a7 expref: 7 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779771.677884:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000dfb0b2c3, rc 0) 00000100:00100000:1.0:1787779771.677908:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000007561e32 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+7:6489:x1874622881464960:12345-0@lo:101: Request processed in 110us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779771.677913:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787779771.677935:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set 000000004bd710f5 going to sleep for 11 seconds 00000100:00100000:1.0:1787779771.677946:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000041ab582c pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:6489:1874622881464960:0@lo:101: 00010000:00010000:1.0:1787779771.677955:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: 00000000c51b71e7/0xc8fc0a51799601a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a51799601ae expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779771.677962:0:6489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: 00000000c51b71e7/0xc8fc0a51799601a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc8fc0a51799601ae expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787779771.677971:0:6489:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1787779771.677974:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: 00000000c51b71e7/0xc8fc0a51799601a7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a51799601ae expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779771.677979:0:6489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: 00000000c51b71e7/0xc8fc0a51799601a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a51799601ae expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787779771.677996:0:6489:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1787779771.677999:0:6489:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787779771.678002:0:6489:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9c044407a000 10000000:01000000:1.0:1787779771.678004:0:6489:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1787779771.678007:0:6489:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1787779771.678009:0:6489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1787779771.678021:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: 000000009ea8da73/0xc8fc0a51799601b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779771.678027:0:6489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: 000000009ea8da73/0xc8fc0a51799601b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779771.678032:0:6489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: 000000009ea8da73/0xc8fc0a51799601b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779771.678042:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000041ab582c pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:6489:1874622881465088:0@lo:101: 00000100:00100000:1.0:1787779771.678065:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779771.678085:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881465088 00000100:00100000:1.0:1787779771.678088:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881465088 00000100:00100000:1.0:1787779771.678237:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787779771.678243:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d838fe3d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+7:6489:x1874622881465088:12345-0@lo:101: 00010000:00010000:1.0:1787779771.678250:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787779771.678257:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000184c5b7c/0xc8fc0a51799601bc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc8fc0a51799601b5 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779771.678269:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000184c5b7c/0xc8fc0a51799601bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc8fc0a51799601b5 expref: 8 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779771.678287:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000184c5b7c/0xc8fc0a51799601bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a51799601b5 expref: 8 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779771.678293:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000184c5b7c, rc 0) 00000100:00100000:1.0:1787779771.678328:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d838fe3d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+8:6489:x1874622881465088:12345-0@lo:101: Request processed in 86us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779771.678333:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787779771.678356:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set 000000004bd710f5 going to sleep for 11 seconds 00000100:00100000:1.0:1787779771.678368:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000041ab582c pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:6489:1874622881465088:0@lo:101: 00010000:00010000:1.0:1787779771.678376:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: 000000009ea8da73/0xc8fc0a51799601b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a51799601bc expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779771.678383:0:6489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: 000000009ea8da73/0xc8fc0a51799601b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc8fc0a51799601bc expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779771.678433:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000041ab582c pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:6489:1874622881465216:0@lo:501: 00000100:00100000:1.0:1787779771.678458:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779771.678476:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881465216 00000100:00100000:1.0:1787779771.678479:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881465216 00000100:00100000:1.0:1787779771.678495:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787779771.678499:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000d4773d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+8:6489:x1874622881465216:12345-0@lo:501: 00000100:00100000:1.0:1787779771.678725:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000d4773d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+9:6489:x1874622881465216:12345-0@lo:501: Request processed in 225us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779771.678732:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787779771.678758:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set 000000004bd710f5 going to sleep for 11 seconds 00000100:00100000:1.0:1787779771.678769:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000041ab582c pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:6489:1874622881465216:0@lo:501: 00000100:00100000:1.0:1787779771.678800:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000041ab582c pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:6489:1874622881465344:0@lo:503: 00000100:00100000:1.0:1787779771.678903:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779771.678955:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set 000000004bd710f5 going to sleep for 11 seconds 00000100:00100000:0.0:1787779771.679024:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881465344 00000100:00100000:0.0:1787779771.679028:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881465344 00000100:00100000:3.0:1787779771.679235:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787779771.679243:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ae17175a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+9:6489:x1874622881465344:12345-0@lo:503: 00000100:00100000:3.0:1787779771.679355:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ae17175a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+9:6489:x1874622881465344:12345-0@lo:503: Request processed in 113us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779771.679362:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787779771.679430:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000041ab582c pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:6489:1874622881465344:0@lo:503: 00000100:00100000:1.0:1787779771.679649:0:6534:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000041ab582c pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f575176-36bc-4786-83ee-2fea064a12a9:6534:1874622881465472:0@lo:502: 00000100:00100000:1.0:1787779771.679686:0:6534:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779771.679979:0:6534:0:(client.c:2715:ptlrpc_set_wait()) set 000000004e4c85eb going to sleep for 11 seconds 00000100:00100000:2.0:1787779771.680047:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881465472 00000100:00100000:2.0:1787779771.680052:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881465472 00000100:00100000:2.0:1787779771.680075:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787779771.680081:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006518e97e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+9:6534:x1874622881465472:12345-0@lo:502: 00000100:00100000:2.0:1787779771.680187:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006518e97e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+9:6534:x1874622881465472:12345-0@lo:502: Request processed in 105us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779771.680193:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787779771.680276:0:6534:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000041ab582c pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f575176-36bc-4786-83ee-2fea064a12a9:6534:1874622881465472:0@lo:502: 00000020:01000000:1.0:1787779771.680300:0:6534:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787779771.680323:0:6534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787779771.680325:0:6534:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1787779771.680331:0:6534:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1787779771.680334:0:6534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787779771.680354:0:6534:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000bd3f9300) 00000020:00000080:1.0:1787779771.680373:0:6534:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1787779771.680378:0:6534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1787779771.680461:0:6534:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:1.0:1787779771.680468:0:6534:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc8fc0a51799601ca 00000020:00000080:1.0:1787779771.680736:0:6534:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1787779771.680741:0:6534:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787779771.680745:0:6534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787779771.680746:0:6534:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1787779771.680750:0:6534:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787779771.680754:0:6534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787779771.680755:0:6534:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1787779771.680758:0:6534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787779771.680766:0:6534:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (0000000059b4356a) 00000020:00000080:1.0:1787779771.680776:0:6534:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1787779771.680780:0:6534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1787779771.680786:0:6534:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1787779771.680789:0:6534:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1787779771.680796:0:6534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787779771.680879:0:6534:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000852291a7 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1787779771.680891:0:6534:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000b5054d15) 00000020:00000080:1.0:1787779771.680899:0:6534:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1787779771.680962:0:6534:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1787779771.680968:0:6534:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc8fc0a51799601df 00000020:00000080:1.0:1787779771.681070:0:6534:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1787779771.681077:0:6534:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1787779771.681082:0:6534:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xc8fc0a51799601e6 00080000:01000000:1.0:1787779771.681086:0:6534:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:1.0:1787779771.681089:0:6534:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc8fc0a51799601ed 00080000:10000000:1.0:1787779771.681495:0:6534:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:1.0:1787779771.681635:0:6534:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:1.0:1787779771.686343:0:6534:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:1.0:1787779771.765324:0:6534:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:1.0:1787779771.765641:0:6534:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:2.0:1787779771.771294:0:6534:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1787779771.771725:0:6534:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1787779771.775983:0:6534:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000fa4aca08) 00000020:00000080:2.0:1787779771.776007:0:6534:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1787779771.776088:0:6534:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:2.0:1787779771.776094:0:6534:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc8fc0a51799601fb 00000020:00000080:2.0:1787779771.779666:0:6534:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:2.0:1787779771.781343:0:6534:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:10000000:0.0:1787779771.786925:0:6534:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:10000000:0.0:1787779771.793087:0:6534:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:10000000:0.0:1787779771.798918:0:6534:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:10000000:0.0:1787779771.804177:0:6534:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:10000000:0.0:1787779771.807689:0:6534:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00000020:00000080:0.0:1787779771.815455:0:6534:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xc8fc0a5179960202 00000020:00000080:0.0:1787779771.815786:0:6534:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1787779771.815798:0:6534:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787779771.815804:0:6534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787779771.815806:0:6534:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1787779771.815809:0:6534:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787779771.815814:0:6534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787779771.815815:0:6534:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787779771.815818:0:6534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787779771.815819:0:6534:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787779771.815822:0:6534:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787779771.815824:0:6534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787779771.815825:0:6534:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000020:01000000:0.0:1787779771.815827:0:6534:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787779771.815832:0:6534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787779771.815833:0:6534:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1787779771.815860:0:6534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1787779771.815899:0:6534:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:0.0:1787779771.815964:0:6534:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008dad7bf5 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f575176-36bc-4786-83ee-2fea064a12a9:6534:1874622881465600:0@lo:502: 00000100:00100000:0.0:1787779771.816047:0:6534:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779771.816113:0:6534:0:(client.c:2715:ptlrpc_set_wait()) set 000000006a8968db going to sleep for 11 seconds 00000100:00100000:1.0:1787779771.817614:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881465600 00000100:00100000:1.0:1787779771.817626:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881465600 00000100:00100000:1.0:1787779771.817677:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787779771.817686:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d4bc3c60 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+9:6534:x1874622881465600:12345-0@lo:502: 00000100:00100000:1.0:1787779771.817864:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d4bc3c60 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+9:6534:x1874622881465600:12345-0@lo:502: Request processed in 179us (1818us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779771.817872:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787779771.819471:0:6534:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008dad7bf5 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f575176-36bc-4786-83ee-2fea064a12a9:6534:1874622881465600:0@lo:502: 00000020:01000000:2.0:1787779771.819518:0:6534:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787779771.819529:0:6534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787779771.819531:0:6534:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:2.0:1787779771.819535:0:6534:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:1.0:1787779771.819700:0:6489:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:1.0:1787779771.819723:0:6489:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1787779771.819745:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: 000000009ea8da73/0xc8fc0a51799601b5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a51799601bc expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779771.819757:0:6489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: 000000009ea8da73/0xc8fc0a51799601b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a51799601bc expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787779771.819776:0:6489:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c044407a000 from 1 10000000:01000000:1.0:1787779771.819779:0:6489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787779771.819811:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: 000000005d8daf36/0xc8fc0a5179960209 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779771.819818:0:6489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: 000000005d8daf36/0xc8fc0a5179960209 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779771.819826:0:6489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: 000000005d8daf36/0xc8fc0a5179960209 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779771.819865:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000041ab582c pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:6489:1874622881465728:0@lo:101: 00000100:00100000:1.0:1787779771.819925:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779771.819965:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881465728 00000100:00100000:1.0:1787779771.819967:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b808b63d going to sleep for 11 seconds 00000100:00100000:3.0:1787779771.819973:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881465728 00000100:00100000:3.0:1787779771.820027:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787779771.820034:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c00b6ca0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+9:6489:x1874622881465728:12345-0@lo:101: 00010000:00010000:3.0:1787779771.820045:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787779771.820060:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003c94f8e6/0xc8fc0a5179960210 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc8fc0a5179960209 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779771.820080:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003c94f8e6/0xc8fc0a5179960210 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc8fc0a5179960209 expref: 10 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779771.820088:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003c94f8e6/0xc8fc0a5179960210 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a5179960209 expref: 10 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779771.820094:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003c94f8e6, rc 0) 00000100:00100000:3.0:1787779771.820138:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c00b6ca0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+10:6489:x1874622881465728:12345-0@lo:101: Request processed in 104us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779771.820144:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787779771.820189:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000041ab582c pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:6489:1874622881465728:0@lo:101: 00010000:00010000:1.0:1787779771.820201:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: 000000005d8daf36/0xc8fc0a5179960209 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a5179960210 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779771.820209:0:6489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: 000000005d8daf36/0xc8fc0a5179960209 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc8fc0a5179960210 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779771.820905:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000041ab582c pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:6489:1874622881465856:0@lo:256: 00000100:00100000:1.0:1787779771.820945:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779771.820968:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b808b63d going to sleep for 11 seconds 00000100:00100000:0.0:1787779771.821522:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881465856 00000100:00100000:0.0:1787779771.821529:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881465856 00000100:00100000:0.0:1787779771.821579:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787779771.821587:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009c844775 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+10:6489:x1874622881465856:12345-0@lo:256: 20000000:01000000:0.0:1787779771.821604:0:6505:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1787779771.821610:0:6505:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1787779771.821691:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009c844775 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+10:6489:x1874622881465856:12345-0@lo:256: Request processed in 105us (746us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779771.821700:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787779771.821801:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000041ab582c pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:6489:1874622881465856:0@lo:256: 10000000:01000000:2.0:1787779771.822528:0:6489:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787779771.822553:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: 000000005d8daf36/0xc8fc0a5179960209 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a5179960210 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779771.822563:0:6489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: 000000005d8daf36/0xc8fc0a5179960209 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a5179960210 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787779771.822571:0:6489:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c044407a000 from 1 10000000:01000000:2.0:1787779771.822574:0:6489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787779771.822907:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: 00000000fa8eef2f/0xc8fc0a5179960217 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779771.822916:0:6489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: 00000000fa8eef2f/0xc8fc0a5179960217 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779771.822924:0:6489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: 00000000fa8eef2f/0xc8fc0a5179960217 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779771.822943:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000012f72851 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:6489:1874622881465984:0@lo:101: 00000100:00100000:2.0:1787779771.822993:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779771.823041:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a2efca0d going to sleep for 11 seconds 00000100:00100000:3.0:1787779771.823063:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881465984 00000100:00100000:3.0:1787779771.823068:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881465984 00000100:00100000:3.0:1787779771.823110:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787779771.823118:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006490ca7b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+10:6489:x1874622881465984:12345-0@lo:101: 00010000:00010000:3.0:1787779771.823135:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787779771.823148:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004a6c7bbe/0xc8fc0a517996021e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc8fc0a5179960217 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779771.823618:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004a6c7bbe/0xc8fc0a517996021e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc8fc0a5179960217 expref: 11 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779771.823632:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004a6c7bbe/0xc8fc0a517996021e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a5179960217 expref: 11 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779771.823640:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004a6c7bbe, rc 0) 00000100:00100000:3.0:1787779771.823688:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006490ca7b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+11:6489:x1874622881465984:12345-0@lo:101: Request processed in 572us (696us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779771.823695:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787779771.824862:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000012f72851 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:6489:1874622881465984:0@lo:101: 00010000:00010000:2.0:1787779771.824885:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: 00000000fa8eef2f/0xc8fc0a5179960217 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a517996021e expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779771.824894:0:6489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: 00000000fa8eef2f/0xc8fc0a5179960217 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc8fc0a517996021e expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779771.824974:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000012f72851 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:6489:1874622881466112:0@lo:501: 00000100:00100000:2.0:1787779771.825407:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779771.837229:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881466112 00000100:00100000:0.0:1787779771.837245:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881466112 00000100:00100000:0.0:1787779771.837361:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787779771.837370:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000082eb7dce pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+11:6489:x1874622881466112:12345-0@lo:501: 00000100:00100000:0.0:1787779771.837556:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000082eb7dce pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+11:6489:x1874622881466112:12345-0@lo:501: Request processed in 187us (12154us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779771.837564:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787779771.838874:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a2efca0d going to sleep for 11 seconds 00000100:00100000:3.0:1787779771.838990:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000012f72851 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:6489:1874622881466112:0@lo:501: 00000100:00100000:3.0:1787779771.839091:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000090912cd6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:6489:1874622881466240:0@lo:503: 00000100:00100000:3.0:1787779771.839216:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779771.839255:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set 0000000043bcdf52 going to sleep for 11 seconds 00000100:00100000:1.0:1787779771.843323:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881466240 00000100:00100000:1.0:1787779771.843338:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881466240 00000100:00100000:1.0:1787779771.843433:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787779771.843443:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d8fb3e3b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+11:6489:x1874622881466240:12345-0@lo:503: 00000040:00080000:1.0:1787779771.843516:0:6507:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787779771.843625:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d8fb3e3b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+11:6489:x1874622881466240:12345-0@lo:503: Request processed in 184us (4410us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779771.843633:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787779771.843731:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000090912cd6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:6489:1874622881466240:0@lo:503: 00000040:00080000:3.0:1787779771.844454:0:6538:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:3.0:1787779771.844518:0:6489:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:3.0:1787779771.844543:0:6489:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787779771.844556:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: 00000000fa8eef2f/0xc8fc0a5179960217 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a517996021e expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779771.844568:0:6489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: 00000000fa8eef2f/0xc8fc0a5179960217 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a517996021e expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787779771.844628:0:6489:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787779771.844631:0:6489:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9c044407a000 10000000:01000000:3.0:1787779771.844634:0:6489:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9c044407a000 10000000:01000000:3.0:1787779771.844638:0:6489:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787779771.844644:0:6489:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c044407a000 from 1 10000000:01000000:3.0:1787779771.844647:0:6489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787779771.844678:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: 00000000f6ae4f27/0xc8fc0a5179960225 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779771.844686:0:6489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: 00000000f6ae4f27/0xc8fc0a5179960225 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779771.844695:0:6489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: 00000000f6ae4f27/0xc8fc0a5179960225 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779771.844715:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000090912cd6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:6489:1874622881466368:0@lo:101: 00000100:00100000:3.0:1787779771.844765:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779771.846869:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set 00000000dd5074a8 going to sleep for 11 seconds 00000100:00100000:0.0:1787779771.847441:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881466368 00000100:00100000:0.0:1787779771.847451:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881466368 00000100:00100000:0.0:1787779771.847504:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787779771.847513:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000063f3c211 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+11:6489:x1874622881466368:12345-0@lo:101: 00010000:00010000:0.0:1787779771.847528:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787779771.847675:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e7152357/0xc8fc0a517996022c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc8fc0a5179960225 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779771.847702:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e7152357/0xc8fc0a517996022c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc8fc0a5179960225 expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779771.847871:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e7152357/0xc8fc0a517996022c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a5179960225 expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779771.847880:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e7152357, rc 0) 00000100:00100000:0.0:1787779771.847953:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000063f3c211 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+12:6489:x1874622881466368:12345-0@lo:101: Request processed in 442us (3189us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779771.847961:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787779771.848291:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000090912cd6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:6489:1874622881466368:0@lo:101: 00010000:00010000:3.0:1787779771.848321:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: 00000000f6ae4f27/0xc8fc0a5179960225 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a517996022c expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779771.848332:0:6489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: 00000000f6ae4f27/0xc8fc0a5179960225 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc8fc0a517996022c expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779771.848944:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000090912cd6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:6489:1874622881466496:0@lo:501: 00000100:00100000:3.0:1787779771.848994:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779771.849044:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set 00000000dd5074a8 going to sleep for 11 seconds 00000100:00100000:0.0:1787779771.849071:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881466496 00000100:00100000:0.0:1787779771.849078:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881466496 00000100:00100000:0.0:1787779771.849120:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787779771.849128:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000001384399 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+12:6489:x1874622881466496:12345-0@lo:501: 00000100:00100000:0.0:1787779771.849257:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000001384399 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+12:6489:x1874622881466496:12345-0@lo:501: Request processed in 129us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779771.849264:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787779771.849758:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000090912cd6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:6489:1874622881466496:0@lo:501: 00000100:00100000:3.0:1787779771.849809:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000090912cd6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:6489:1874622881466624:0@lo:503: 00000100:00100000:3.0:1787779771.849886:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779771.849910:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set 00000000dd5074a8 going to sleep for 11 seconds 00000100:00100000:3.0:1787779771.849931:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881466624 00000100:00100000:3.0:1787779771.849936:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881466624 00000100:00100000:3.0:1787779771.849964:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787779771.849970:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c48ee223 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+12:6489:x1874622881466624:12345-0@lo:503: 00000100:00100000:3.0:1787779771.850071:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c48ee223 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+12:6489:x1874622881466624:12345-0@lo:503: Request processed in 101us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779771.850079:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787779771.850123:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000090912cd6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:6489:1874622881466624:0@lo:503: 00000100:00100000:3.0:1787779771.856437:0:6539:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000090912cd6 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f575176-36bc-4786-83ee-2fea064a12a9:6539:1874622881466752:0@lo:502: 00000100:00100000:3.0:1787779771.856537:0:6539:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779771.856605:0:6539:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e362a0ff going to sleep for 11 seconds 00000100:00100000:0.0:1787779771.856727:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881466752 00000100:00100000:0.0:1787779771.856734:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881466752 00000100:00100000:0.0:1787779771.856785:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787779771.856795:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000053372349 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+12:6539:x1874622881466752:12345-0@lo:502: 00000100:00100000:0.0:1787779771.857253:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000053372349 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+12:6539:x1874622881466752:12345-0@lo:502: Request processed in 459us (716us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779771.857261:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787779771.857593:0:6539:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000090912cd6 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f575176-36bc-4786-83ee-2fea064a12a9:6539:1874622881466752:0@lo:502: 00000020:01000004:3.0:1787779771.857664:0:6539:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1787779771.857680:0:6539:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000d7136902) 00000020:00000080:3.0:1787779771.857699:0:6539:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:3.0:1787779771.858387:0:6539:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000852291a7 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1787779771.858393:0:6539:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000852291a7 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1787779771.858396:0:6539:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000852291a7 4 00010000:00080000:3.0:1787779771.858425:0:6539:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000f2d658e2@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.131@tcp at head 00010000:00010000:3.0:1787779771.864632:0:6539:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:3.0:1787779771.864993:0:6539:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1787779771.865038:0:6539:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787779771.865057:0:6539:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xc8fc0a517996023a 00000100:00080000:3.0:1787779771.865067:0:6539:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787779771.865072:0:6539:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000f2d658e2 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:3.0:1787779771.865123:0:6539:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000090912cd6 x1874622881466880/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787779771.865152:0:6539:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1787779771.865352:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000090912cd6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874622881466880:0@lo:38: 00000100:00100000:2.0:1787779771.865432:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779771.866057:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881466880 00000100:00100000:1.0:1787779771.866065:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881466880 00000100:00100000:1.0:1787779771.866100:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787779771.866108:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b08b8127 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3640:x1874622881466880:12345-0@lo:38: 00000100:00100000:1.0:1787779771.866517:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b08b8127 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3640:x1874622881466880:12345-0@lo:38: Request processed in 407us (1084us total) trans 0 rc -11/-11 00000100:00100000:1.0:1787779771.866526:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787779771.866727:0:3640:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787779771.866735:0:3640:0:(import.c:65:import_set_state_nolock()) 00000000f2d658e2 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787779771.866739:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1787779771.866743:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000090912cd6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874622881466880:0@lo:38: 00000100:00100000:0.0:1787779771.873641:0:6539:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000124d7954 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f575176-36bc-4786-83ee-2fea064a12a9:6539:1874622881467008:0@lo:502: 00000100:00100000:0.0:1787779771.875099:0:6539:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779771.876675:0:6539:0:(client.c:2715:ptlrpc_set_wait()) set 00000000453245f1 going to sleep for 11 seconds 00000100:00100000:2.0:1787779771.881092:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881467008 00000100:00100000:2.0:1787779771.881108:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881467008 00000100:00100000:3.0:1787779771.881441:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787779771.881455:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000015c5fb95 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+12:6539:x1874622881467008:12345-0@lo:502: 00000100:00100000:3.0:1787779771.881637:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000015c5fb95 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+12:6539:x1874622881467008:12345-0@lo:502: Request processed in 185us (6541us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779771.881646:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787779771.881741:0:6539:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000124d7954 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f575176-36bc-4786-83ee-2fea064a12a9:6539:1874622881467008:0@lo:502: 00000040:00080000:1.0:1787779771.881777:0:6539:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:2.0:1787779771.882578:0:6489:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:2.0:1787779771.882609:0:6489:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787779771.882631:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: 00000000f6ae4f27/0xc8fc0a5179960225 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a517996022c expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779771.882641:0:6489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: 00000000f6ae4f27/0xc8fc0a5179960225 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a517996022c expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787779771.882693:0:6489:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787779771.882696:0:6489:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787779771.882714:0:6489:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787779771.882715:0:6489:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787779771.882716:0:6489:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787779771.882718:0:6489:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787779771.882719:0:6489:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787779771.882720:0:6489:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787779771.882721:0:6489:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787779771.882722:0:6489:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787779771.882724:0:6489:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787779771.882725:0:6489:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787779771.882728:0:6489:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:2.0:1787779771.882731:0:6489:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787779771.882732:0:6489:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787779771.882732:0:6489:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787779771.882733:0:6489:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787779771.882734:0:6489:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787779771.882735:0:6489:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787779771.882736:0:6489:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787779771.882737:0:6489:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787779771.882738:0:6489:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787779771.882738:0:6489:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787779771.882739:0:6489:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787779771.882740:0:6489:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787779771.882764:0:6489:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1787779771.882779:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007e593ed3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:6489:1874622881467136:0@lo:253: 00000100:00100000:2.0:1787779771.882832:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779771.886679:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ed829ca2 going to sleep for 11 seconds 00000100:00100000:0.0:1787779771.887471:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881467136 00000100:00100000:0.0:1787779771.887482:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881467136 00000100:00100000:0.0:1787779771.889422:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787779771.889446:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001a88e399 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+12:6489:x1874622881467136:12345-0@lo:253: 20000000:01000000:0.0:1787779771.889481:0:6505:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1787779771.889498:0:6505:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1787779771.899387:0:6505:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787779771.899398:0:6505:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1787779771.899621:0:6528:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787779771.899626:0:6528:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787779771.899647:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000af2e9fb5/0xc8fc0a5179960241 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779771.899664:0:6528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000003c94f8e6/0xc8fc0a5179960210 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a5179960209 expref: 12 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779771.899671:0:6528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000af2e9fb5/0xc8fc0a5179960241 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779771.899735:0:6528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000003c94f8e6/0xc8fc0a5179960210 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc8fc0a5179960209 expref: 12 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779771.899749:0:6528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000003c94f8e6/0xc8fc0a5179960210 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc8fc0a5179960209 expref: 12 pid: 6507 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779771.899764:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008cfbd84e pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6528:1874622881467264:0@lo:104: 00000100:00100000:2.0:1787779771.899833:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779771.900165:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set 000000002725e7b4 going to sleep for 11 seconds 00000100:00100000:0.0:1787779771.900330:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881467264 00000100:00100000:0.0:1787779771.900337:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881467264 00000100:00100000:0.0:1787779771.900388:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787779771.900396:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f3cdd162 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1f575176-36bc-4786-83ee-2fea064a12a9+3:6528:x1874622881467264:12345-0@lo:104: 00010000:00010000:0.0:1787779771.900412:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: 000000005d8daf36/0xc8fc0a5179960209 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc8fc0a5179960210 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779771.900468:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787779771.900473:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f3cdd162 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1f575176-36bc-4786-83ee-2fea064a12a9+3:6528:x1874622881467264:12345-0@lo:104: Request processed in 79us (641us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779771.900480:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787779771.900518:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008cfbd84e pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6528:1874622881467264:0@lo:104: 00010000:00010000:0.0:1787779771.900537:0:6528:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000af2e9fb5/0xc8fc0a5179960241 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779771.900553:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787779771.900558:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: 000000005d8daf36/0xc8fc0a5179960209 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc8fc0a5179960210 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779771.900564:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000005d8daf36 already unused, calling callback (000000000bd3cb84) 10000000:00010000:0.0:1787779771.900567:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: 000000005d8daf36/0xc8fc0a5179960209 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc8fc0a5179960210 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779771.900587:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: 000000005d8daf36/0xc8fc0a5179960209 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc8fc0a5179960210 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787779771.900593:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: 000000005d8daf36/0xc8fc0a5179960209 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc8fc0a5179960210 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787779771.900599:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787779771.900629:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: 000000005d8daf36/0xc8fc0a5179960209 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a5179960210 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779771.900635:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787779771.900649:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: 000000005d8daf36/0xc8fc0a5179960209 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a5179960210 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779771.900655:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: 000000005d8daf36/0xc8fc0a5179960209 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a5179960210 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779771.900670:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787779771.900671:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787779771.900673:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787779771.901019:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001a7a1862 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1f575176-36bc-4786-83ee-2fea064a12a9:3642:1874622881467392:0@lo:103: 00000100:00100000:1.0:1787779771.901059:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779771.902045:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881467392 00000100:00100000:0.0:1787779771.902055:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881467392 00010000:00010000:0.0:1787779771.902084:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000003c94f8e6/0xc8fc0a5179960210 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc8fc0a5179960209 expref: 13 pid: 6507 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779771.902117:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787779771.902124:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000886d2ec6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1f575176-36bc-4786-83ee-2fea064a12a9+13:3642:x1874622881467392:12345-0@lo:103: 00010000:00010000:0.0:1787779771.902137:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787779771.902141:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000003c94f8e6/0xc8fc0a5179960210 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc8fc0a5179960209 expref: 13 pid: 6507 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779771.902162:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000003c94f8e6/0xc8fc0a5179960210 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc8fc0a5179960209 expref: 13 pid: 6507 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779771.902175:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000003c94f8e6/0xc8fc0a5179960210 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc8fc0a5179960209 expref: 13 pid: 6507 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779771.902190:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000af2e9fb5/0xc8fc0a5179960241 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779771.902197:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000af2e9fb5/0xc8fc0a5179960241 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787779771.902212:0:6497:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002587631s 00010000:00010000:0.0:1787779771.902216:0:6497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000af2e9fb5/0xc8fc0a5179960241 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779771.902222:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000af2e9fb5/0xc8fc0a5179960241 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779771.902228:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000af2e9fb5/0xc8fc0a5179960241 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779771.902234:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000af2e9fb5/0xc8fc0a5179960241 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779771.902239:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000af2e9fb5 already unused, calling callback (000000008129b6a0) 00010000:00010000:0.0:1787779771.902243:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000af2e9fb5/0xc8fc0a5179960241 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779771.902249:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000af2e9fb5/0xc8fc0a5179960241 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779771.902279:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000af2e9fb5/0xc8fc0a5179960241 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779771.902290:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787779771.902364:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000886d2ec6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1f575176-36bc-4786-83ee-2fea064a12a9+12:3642:x1874622881467392:12345-0@lo:103: Request processed in 241us (1305us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779771.902371:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787779771.902410:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001a7a1862 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1f575176-36bc-4786-83ee-2fea064a12a9:3642:1874622881467392:0@lo:103: 00010000:00010000:2.0:1787779771.902488:0:6528:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000af2e9fb5/0xc8fc0a5179960241 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779771.902496:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000af2e9fb5/0xc8fc0a5179960241 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779771.902501:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000af2e9fb5/0xc8fc0a5179960241 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779771.906212:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001a88e399 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+11:6489:x1874622881467136:12345-0@lo:253: Request processed in 16773us (23372us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779771.906228:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787779771.906356:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007e593ed3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:6489:1874622881467136:0@lo:253: 10000000:01000000:2.0:1787779771.906373:0:6489:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1787779771.906377:0:6489:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787779771.906378:0:6489:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787779771.906380:0:6489:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787779771.906381:0:6489:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787779771.906382:0:6489:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787779771.906383:0:6489:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787779771.906384:0:6489:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787779771.906386:0:6489:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787779771.906387:0:6489:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787779771.906389:0:6489:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787779771.906390:0:6489:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787779771.906405:0:6489:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787779771.906427:0:6489:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1787779771.917462:0:6489:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00080000:10000000:0.0:1787779771.917830:0:6489:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:0.0:1787779771.918428:0:6489:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00080000:10000000:0.0:1787779771.918658:0:6489:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:1.0:1787779771.919183:0:6489:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00080000:10000000:1.0:1787779771.919382:0:6489:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:1.0:1787779771.920401:0:6489:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00080000:10000000:1.0:1787779771.920636:0:6489:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:1.0:1787779771.920828:0:6489:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00080000:10000000:1.0:1787779771.921038:0:6489:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:1.0:1787779771.921244:0:6489:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00080000:10000000:1.0:1787779771.921683:0:6489:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 40000000:02000000:1.0:1787779771.931287:0:6489:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:1.0:1787779771.943533:0:6489:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:0.0:1787779771.943803:0:6544:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:0.0:1787779771.943807:0:6544:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:1.0:1787779771.944072:0:6545:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1787779771.945529:0:6489:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1787779771.945645:0:6489:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1787779771.946088:0:6489:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1787779771.946097:0:6489:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1787779771.946209:0:6489:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787779771.947225:0:6489:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1787779771.952936:0:6545:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787779771.955043:0:6489:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1787779771.955123:0:6489:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1787779771.956015:0:6489:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1787779771.956254:0:6489:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x10:0x0] (8/32) registered 00100000:10000000:0.0:1787779771.957225:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:0.0:1787779771.957671:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:0.0:1787779771.960474:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:0.0:1787779771.960834:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:0.0:1787779771.960991:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:0.0:1787779771.961142:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:0.0:1787779771.961262:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:0.0:1787779771.961395:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:0.0:1787779771.961515:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:0.0:1787779771.966904:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:0.0:1787779771.971512:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:0.0:1787779771.972258:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:0.0:1787779771.974286:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00000040:00080000:1.0:1787779771.974644:0:6545:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1787779771.975225:0:6545:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1787779771.975231:0:6545:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00100000:10000000:0.0:1787779771.975492:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:0.0:1787779771.976039:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:0.0:1787779771.976193:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:0.0:1787779771.976688:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:0.0:1787779771.977088:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:0.0:1787779771.977255:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:0.0:1787779771.977478:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:0.0:1787779771.977692:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1787779771.980145:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1787779771.980498:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1787779771.981101:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1787779771.981242:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1787779771.981778:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1787779771.982102:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1787779771.982249:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1787779771.982475:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1787779771.982807:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1787779771.983912:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1787779771.984288:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1787779771.984628:0:6489:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:3.0:1787779771.989043:0:6489:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1787779771.989085:0:6489:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb66b819b7988 00100000:10000000:3.0:1787779771.989093:0:6489:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1787779771.990191:0:6489:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787779771.990207:0:6489:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.131@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787779771.990228:0:6489:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1787779771.990245:0:6489:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:3.0:1787779771.991157:0:6489:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787779771.991361:0:6489:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:1.0:1787779772.515118:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787779773.535249:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787779774.556226:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787779775.580176:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787779775.937331:0:6790:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg331-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787779776.605664:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1787779776.868250:0:6842:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787779776.868454:0:6842:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00080000:1.0:1787779777.310692:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1787779777.310701:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787779777.310704:0:37:0:(import.c:65:import_set_state_nolock()) 00000000f2d658e2 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787779777.310715:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000f2d658e2 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:1.0:1787779777.310732:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000041ab582c x1874622881467648/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787779777.310866:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000526a7dd9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1f575176-36bc-4786-83ee-2fea064a12a9:3643:1874622881467520:0@lo:400: 00000100:00100000:1.0:1787779777.310943:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779777.311074:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000041ab582c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874622881467648:0@lo:38: 00000100:00100000:1.0:1787779777.311110:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779777.315361:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881467520 00000100:00100000:3.0:1787779777.315376:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881467520 00000100:00100000:3.0:1787779777.315436:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787779777.315444:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fccd540f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+11:3643:x1874622881467520:12345-0@lo:400: 00000100:00100000:3.0:1787779777.315535:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fccd540f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+11:3643:x1874622881467520:12345-0@lo:400: Request processed in 92us (4593us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779777.315543:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787779777.315587:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881467648 00000100:00100000:3.0:1787779777.315591:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881467648 00000100:00100000:3.0:1787779777.315614:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787779777.315618:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a15e9784 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3640:x1874622881467648:12345-0@lo:38: 00010000:00080000:3.0:1787779777.315638:0:6514:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 185 last 0 00000020:00000080:3.0:1787779777.315671:0:6514:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xc8fc0a5179960248 00000004:00100000:3.0:1787779777.315720:0:6514:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787779777.317033:0:6514:0:(import.c:65:import_set_state_nolock()) 0000000075fbdccb : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787779777.317117:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a15e9784 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874622881467648:12345-0@lo:38: Request processed in 1494us (6003us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779777.317127:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787779777.317186:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000526a7dd9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1f575176-36bc-4786-83ee-2fea064a12a9:3643:1874622881467520:0@lo:400: 00010000:00080000:3.0:1787779777.317245:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000041ab582c x1874622881467648/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787779787 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787779777.318045:0:3640:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1787779777.318055:0:3640:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1787779777.318060:0:3640:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787779777.318063:0:3640:0:(import.c:65:import_set_state_nolock()) 00000000f2d658e2 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787779777.318070:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000041ab582c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874622881467648:0@lo:38: 00010000:00010000:0.0:1787779777.628353:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787779778.652164:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1787779779.303456:0:6943:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787779779.303775:0:6943:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787779779.676044:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787779779.868829:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787779779.868859:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c044407a000 from 3 10000000:01000000:1.0:1787779779.868864:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787779779.868909:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: 000000004a42cb03/0xc8fc0a517996024f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779779.868921:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: 000000004a42cb03/0xc8fc0a517996024f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779779.868931:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: 000000004a42cb03/0xc8fc0a517996024f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779779.868967:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b1994c35 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881467776:0@lo:101: 00000100:00100000:1.0:1787779779.869037:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779779.869092:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set 000000009756e966 going to sleep for 11 seconds 00000100:00100000:3.0:1787779779.874884:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881467776 00000100:00100000:3.0:1787779779.874900:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881467776 00000100:00100000:3.0:1787779779.874955:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787779779.874964:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000090b53ae8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+11:6509:x1874622881467776:12345-0@lo:101: 00010000:00010000:3.0:1787779779.874981:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787779779.874999:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f916f108/0xc8fc0a5179960256 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc8fc0a517996024f expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779779.875025:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f916f108/0xc8fc0a5179960256 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc8fc0a517996024f expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779779.875035:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f916f108/0xc8fc0a5179960256 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a517996024f expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779779.875044:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f916f108, rc 0) 00000100:00100000:3.0:1787779779.875146:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000090b53ae8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+12:6509:x1874622881467776:12345-0@lo:101: Request processed in 183us (6108us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779779.875154:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787779779.875651:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b1994c35 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881467776:0@lo:101: 00010000:00010000:2.0:1787779779.875672:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: 000000004a42cb03/0xc8fc0a517996024f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a5179960256 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779779.875680:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: 000000004a42cb03/0xc8fc0a517996024f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc8fc0a5179960256 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779779.875751:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000162de5ee pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881467904:0@lo:256: 00000100:00100000:2.0:1787779779.875791:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779779.875824:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c524bbbf going to sleep for 11 seconds 00000100:00100000:3.0:1787779779.876376:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881467904 00000100:00100000:3.0:1787779779.876393:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881467904 00000100:00100000:3.0:1787779779.876453:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787779779.876461:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000372395b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+12:6509:x1874622881467904:12345-0@lo:256: 20000000:01000000:3.0:1787779779.876477:0:6506:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787779779.876502:0:6506:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787779779.876506:0:6506:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:3.0:1787779779.876592:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000372395b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+12:6509:x1874622881467904:12345-0@lo:256: Request processed in 131us (800us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779779.876599:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787779779.877358:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000162de5ee pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881467904:0@lo:256: 10000000:01000000:2.0:1787779779.877422:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787779779.877430:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: 000000004a42cb03/0xc8fc0a517996024f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a5179960256 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779779.877439:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: 000000004a42cb03/0xc8fc0a517996024f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a5179960256 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779780.703498:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787779781.724098:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787779782.429879:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787779782.429903:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a2977635 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1f575176-36bc-4786-83ee-2fea064a12a9:3644:1874622881468032:0@lo:400: 00000100:00100000:0.0:1787779782.429907:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008817bb86 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1874622881468160:0@lo:400: 00000100:00100000:0.0:1787779782.432452:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779782.432749:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779782.432959:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881468032 00000100:00100000:1.0:1787779782.432970:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881468032 00000100:00100000:1.0:1787779782.433027:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787779782.433037:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001e5df59e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+12:3644:x1874622881468032:12345-0@lo:400: 00000100:00100000:1.0:1787779782.433112:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001e5df59e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+12:3644:x1874622881468032:12345-0@lo:400: Request processed in 77us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779782.433121:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787779782.433181:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a2977635 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1f575176-36bc-4786-83ee-2fea064a12a9:3644:1874622881468032:0@lo:400: 00000100:00100000:3.0:1787779782.433745:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881468160 00000100:00100000:3.0:1787779782.433752:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881468160 00000100:00100000:3.0:1787779782.433802:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787779782.433811:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e0b9f78e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1874622881468160:12345-0@lo:400: 00000100:00100000:3.0:1787779782.433892:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e0b9f78e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1874622881468160:12345-0@lo:400: Request processed in 83us (1452us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779782.433899:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1787779782.433943:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000008817bb86 x1874622881468160/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779798 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779782.433957:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008817bb86 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1874622881468160:0@lo:400: 00010000:00010000:2.0:1787779782.758293:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787779783.777605:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787779784.797013:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787779785.838967:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787779786.848159:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787779787.552680:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000047ed1fd0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1f575176-36bc-4786-83ee-2fea064a12a9:3642:1874622881468288:0@lo:400: 00000100:00100000:1.0:1787779787.552759:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779787.552880:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787779787.552888:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cdd1ff09 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874622881468416:0@lo:400: 00000100:00100000:1.0:1787779787.552917:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779787.552963:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881468416 00000100:00100000:1.0:1787779787.552969:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881468416 00000100:00100000:1.0:1787779787.553011:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787779787.553019:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003cbea592 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874622881468416:12345-0@lo:400: 00000100:00100000:1.0:1787779787.553068:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003cbea592 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874622881468416:12345-0@lo:400: Request processed in 50us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779787.553088:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787779787.553127:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000cdd1ff09 x1874622881468416/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779803 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787779787.553141:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cdd1ff09 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874622881468416:0@lo:400: 00000100:00100000:0.0:1787779787.554754:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881468288 00000100:00100000:0.0:1787779787.554771:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881468288 00000100:00100000:0.0:1787779787.554812:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787779787.554819:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001733b363 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+12:3642:x1874622881468288:12345-0@lo:400: 00000100:00100000:0.0:1787779787.554911:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001733b363 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+12:3642:x1874622881468288:12345-0@lo:400: Request processed in 92us (2153us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779787.554917:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787779787.560054:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000047ed1fd0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1f575176-36bc-4786-83ee-2fea064a12a9:3642:1874622881468288:0@lo:400: 00010000:00010000:2.0:1787779787.868008:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787779788.202202:0:7441:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1787779788.202206:0:7441:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:0.0:1787779788.202207:0:7441:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1787779788.202342:0:7441:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000003b09e874 00000020:01000004:0.0:1787779788.202358:0:7441:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200061, mountfl=0 00000020:01000004:0.0:1787779788.202368:0:7441:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1787779788.202389:0:7441:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (0000000086626a97) 00000020:00000080:0.0:1787779788.202404:0:7441:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1787779788.256088:0:7441:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00100000:10000000:2.0:1787779788.256194:0:7441:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00080000:01000000:1.0:1787779788.281616:0:7441:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1787779788.281836:0:7441:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:1.0:1787779788.281934:0:7441:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:1.0:1787779788.281945:0:7441:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xc8fc0a5179960264 00000020:01000004:1.0:1787779788.281951:0:7441:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:1.0:1787779788.281971:0:7441:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.131@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1787779788.281973:0:7441:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.131@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1787779788.281979:0:7441:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:1.0:1787779788.282002:0:7441:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:1.0:1787779788.282005:0:7441:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.131@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:3.0:1787779788.302266:0:7441:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.131@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787779788.302304:0:7441:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.131@tcp, index=0001, flags=0x20061 00000020:01000004:3.0:1787779788.302308:0:7441:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787779788.302310:0:7441:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1787779788.302311:0:7441:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787779788.302312:0:7441:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787779788.302313:0:7441:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787779788.302315:0:7441:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787779788.302316:0:7441:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787779788.302317:0:7441:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787779788.302319:0:7441:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787779788.302321:0:7441:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787779788.302326:0:7441:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787779788.302329:0:7441:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020061 00000020:01000004:3.0:1787779788.302331:0:7441:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787779788.302332:0:7441:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1787779788.302333:0:7441:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787779788.302334:0:7441:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787779788.302335:0:7441:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787779788.302336:0:7441:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787779788.302336:0:7441:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787779788.302337:0:7441:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787779788.302338:0:7441:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787779788.302339:0:7441:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787779788.302340:0:7441:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787779788.302366:0:7441:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1787779788.302385:0:7441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007c600d71 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:7441:1874622881468544:0@lo:253: 00000100:00100000:3.0:1787779788.302548:0:7441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779788.302605:0:7441:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ba76fb96 going to sleep for 11 seconds 00000100:00100000:0.0:1787779788.302663:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881468544 00000100:00100000:0.0:1787779788.302671:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881468544 00000100:00100000:0.0:1787779788.302723:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787779788.302731:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a9712ef7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+12:7441:x1874622881468544:12345-0@lo:253: 20000000:01000000:0.0:1787779788.302764:0:6506:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1787779788.302768:0:6506:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0001, index=1 20000000:01000000:0.0:1787779788.302773:0:6506:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0001 to 1 20000000:01000000:0.0:1787779788.302776:0:6506:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0001 20000000:01000000:0.0:1787779788.302806:0:6506:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0001-mdtlov) log for lustre-MDT0001 00000040:00080000:3.0:1787779788.303284:0:6506:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787779788.303397:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:3.0:1787779788.303412:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf001 lov lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1787779788.303428:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:3.0:1787779788.303443:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:3.0:1787779788.303455:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:3.0:1787779788.303580:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 20000000:01000000:3.0:1787779788.303589:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf001 mdt lustre-MDT0001_UUID (null) (null) 00000040:00080000:3.0:1787779788.303603:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 20000000:01000000:3.0:1787779788.303608:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0001 lustre-MDT0001-mdtlov (null) (null) 00000040:00080000:3.0:1787779788.303619:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 20000000:01000000:3.0:1787779788.303624:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf003 lustre-MDT0001_UUID 1 lustre-MDT0001-mdtlov f 00000040:00080000:3.0:1787779788.303635:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:3.0:1787779788.303649:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:3.0:1787779788.303751:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 20000000:01000000:3.0:1787779788.303762:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.131@tcp (null) (null) (null) 00000040:00080000:3.0:1787779788.303774:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 20000000:01000000:3.0:1787779788.303787:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf001 osp lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1787779788.303802:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 20000000:01000000:3.0:1787779788.303810:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf003 lustre-MDT0000_UUID 192.168.203.131@tcp (null) (null) 00000040:00080000:3.0:1787779788.303821:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 20000000:01000000:3.0:1787779788.303827:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:3.0:1787779788.304024:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:3.0:1787779788.304047:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:3.0:1787779788.304059:0:6506:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:3.0:1787779788.304137:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 20000000:01000000:3.0:1787779788.304147:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf009 sys.timeout=20 (null) (null) (null) 00000040:00080000:3.0:1787779788.304163:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:3.0:1787779788.304183:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:3.0:1787779788.304215:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 20000000:01000000:3.0:1787779788.304222:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf00f mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (null) (null) (null) 00000040:00080000:3.0:1787779788.304235:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:3.0:1787779788.304256:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:3.0:1787779788.304262:0:6506:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 20000000:01000000:3.0:1787779788.304285:0:6506:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0001 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:3.0:1787779788.304292:0:6506:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0001/add mdc fl=4 00000040:00080000:3.0:1787779788.304737:0:7447:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:0.0:1787779788.305092:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:0.0:1787779788.305113:0:6506:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.131@tcp for mdt 20000000:01000000:0.0:1787779788.305115:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.131@tcp (null) (null) (null) 00000040:00080000:0.0:1787779788.305130:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:0.0:1787779788.305137:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1787779788.305149:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:0.0:1787779788.305164:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf003 lustre-MDT0001_UUID 192.168.203.131@tcp (null) (null) 00000040:00080000:0.0:1787779788.305181:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:0.0:1787779788.305200:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0001_UUID 1 1 lustre-MDT0001-mdc_UUID 00000040:00080000:0.0:1787779788.305215:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 160 off12472 00000040:00080000:0.0:1787779788.305230:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12696 20000000:01000000:0.0:1787779788.305289:0:6506:0:(mgs_llog.c:3435:mgs_write_log_osp_to_mdt()) adding osp index 1 to lustre-MDT0000 20000000:01000000:0.0:1787779788.305296:0:6506:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0001/add osp fl=4 00000040:00080000:3.0:1787779788.305621:0:7448:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000040:00080000:0.0:1787779788.305776:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:0.0:1787779788.305790:0:6506:0:(mgs_llog.c:3493:mgs_write_log_osp_to_mdt()) add nid 192.168.203.131@tcp for mdt 20000000:01000000:0.0:1787779788.305792:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.131@tcp (null) (null) (null) 00000040:00080000:0.0:1787779788.305807:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:0.0:1787779788.305813:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf001 osp lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1787779788.305826:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:0.0:1787779788.305832:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf003 lustre-MDT0001_UUID 192.168.203.131@tcp (null) (null) 00000040:00080000:1.0:1787779788.306131:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:1.0:1787779788.306142:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf014 lustre-MDT0001_UUID 1 1 (null) 00000040:00080000:1.0:1787779788.306157:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:1.0:1787779788.306172:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 20000000:01000000:1.0:1787779788.306203:0:6506:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:1.0:1787779788.306206:0:6506:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1787779788.306210:0:6506:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1787779788.306256:0:6506:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:1.0:1787779788.306258:0:6506:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787779788.306830:0:7449:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 16 marker 14 1->4: lustre sys.timeout 20000000:01000000:2.0:1787779788.306876:0:7449:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 14 2->4: lustre sys.timeout 00000040:00080000:2.0:1787779788.306892:0:7449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 22 count 22 00000040:00080000:1.0:1787779788.307076:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:1.0:1787779788.307098:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:1.0:1787779788.307112:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 20000000:01000000:1.0:1787779788.307121:0:6506:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1787779788.307123:0:6506:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787779788.308281:0:7450:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 8 1->4: lustre sys.timeout 20000000:01000000:0.0:1787779788.308314:0:7450:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 8 2->4: lustre sys.timeout 00000040:00080000:0.0:1787779788.308330:0:7450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:1.0:1787779788.308567:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12920 00000040:00080000:1.0:1787779788.308604:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off13000 00000040:00080000:1.0:1787779788.308620:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13224 20000000:01000000:1.0:1787779788.308632:0:6506:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1787779788.308634:0:6506:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1787779788.308970:0:7451:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 9 1->4: lustre sys.timeout 20000000:01000000:3.0:1787779788.308989:0:7451:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 9 2->4: lustre sys.timeout 00000040:00080000:3.0:1787779788.309018:0:7451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:1.0:1787779788.309106:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:1.0:1787779788.309125:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:1.0:1787779788.309147:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:1.0:1787779788.309161:0:6506:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1787779788.309163:0:6506:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1787779788.309170:0:6506:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:1.0:1787779788.309176:0:6506:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0001/lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:1.0:1787779788.309590:0:7452:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 20 count 25 20000000:00000400:3.0:1787779788.309711:0:6506:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 10000000:01000000:3.0:1787779788.323077:0:6506:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1787779788.323372:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000005a8b46a2/0xc8fc0a517996026b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779788.323391:0:6506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000e3ee7153/0xc8fc0a51799601a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a5179960199 expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779788.323409:0:6506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000184c5b7c/0xc8fc0a51799601bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a51799601b5 expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779788.323414:0:6506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000e7152357/0xc8fc0a517996022c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a5179960225 expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779788.323421:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000005a8b46a2/0xc8fc0a517996026b lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779788.323587:0:6506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000e7152357/0xc8fc0a517996022c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc8fc0a5179960225 expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779788.323601:0:6506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000e7152357/0xc8fc0a517996022c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc8fc0a5179960225 expref: 12 pid: 6506 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779788.323621:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009c2a1831 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6506:1874622881468672:0@lo:104: 00000100:00100000:3.0:1787779788.323686:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787779788.323788:0:6506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000184c5b7c/0xc8fc0a51799601bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc8fc0a51799601b5 expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779788.323797:0:6506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000184c5b7c/0xc8fc0a51799601bc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc8fc0a51799601b5 expref: 12 pid: 6506 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779788.323804:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000079fae718 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6506:1874622881468800:0@lo:104: 00000100:00100000:3.0:1787779788.323825:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787779788.324240:0:6506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000e3ee7153/0xc8fc0a51799601a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc8fc0a5179960199 expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779788.324249:0:6506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000e3ee7153/0xc8fc0a51799601a0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc8fc0a5179960199 expref: 12 pid: 6505 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779788.324266:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000129623c6 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6506:1874622881468928:0@lo:104: 00000100:00100000:3.0:1787779788.324290:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779788.324375:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881468672 00000100:00100000:2.0:1787779788.324382:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881468672 00000100:00100000:2.0:1787779788.324417:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881468800 00000100:00100000:2.0:1787779788.324419:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881468800 00000100:00100000:2.0:1787779788.324443:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787779788.324450:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004f4216b6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1f575176-36bc-4786-83ee-2fea064a12a9+4:6506:x1874622881468672:12345-0@lo:104: 00010000:00010000:2.0:1787779788.324471:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: 00000000f6ae4f27/0xc8fc0a5179960225 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc8fc0a517996022c expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779788.324528:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787779788.324533:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004f4216b6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1f575176-36bc-4786-83ee-2fea064a12a9+4:6506:x1874622881468672:12345-0@lo:104: Request processed in 84us (848us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779788.324539:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787779788.324555:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787779788.324560:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e8182245 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1f575176-36bc-4786-83ee-2fea064a12a9+3:6506:x1874622881468800:12345-0@lo:104: 00010000:00010000:2.0:1787779788.324565:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: 000000009ea8da73/0xc8fc0a51799601b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc8fc0a51799601bc expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779788.324596:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787779788.324600:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e8182245 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1f575176-36bc-4786-83ee-2fea064a12a9+3:6506:x1874622881468800:12345-0@lo:104: Request processed in 41us (775us total) trans 0 rc 0/0 00010000:00010000:0.0:1787779788.324604:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:2.0:1787779788.324605:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1787779788.324610:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: 00000000f6ae4f27/0xc8fc0a5179960225 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc8fc0a517996022c expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779788.324617:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000f6ae4f27 already unused, calling callback (000000000bd3cb84) 00010000:00010000:2.0:1787779788.324618:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:00010000:0.0:1787779788.324620:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: 00000000f6ae4f27/0xc8fc0a5179960225 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc8fc0a517996022c expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779788.324627:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: 00000000f6ae4f27/0xc8fc0a5179960225 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc8fc0a517996022c expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787779788.324633:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: 00000000f6ae4f27/0xc8fc0a5179960225 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc8fc0a517996022c expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787779788.324648:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787779788.324676:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: 00000000f6ae4f27/0xc8fc0a5179960225 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a517996022c expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779788.324682:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787779788.324698:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: 00000000f6ae4f27/0xc8fc0a5179960225 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a517996022c expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779788.324703:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: 00000000f6ae4f27/0xc8fc0a5179960225 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a517996022c expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779788.324714:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787779788.324715:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787779788.324717:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787779788.324730:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787779788.324742:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000893f8dd7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1f575176-36bc-4786-83ee-2fea064a12a9:3643:1874622881469056:0@lo:103: 00000100:00100000:0.0:1787779788.324770:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779788.324867:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881469056 00000100:00100000:2.0:1787779788.324876:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881469056 00010000:00010000:2.0:1787779788.324892:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000e7152357/0xc8fc0a517996022c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc8fc0a5179960225 expref: 13 pid: 6506 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779788.324914:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787779788.324920:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000313d7fbd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1f575176-36bc-4786-83ee-2fea064a12a9+13:3643:x1874622881469056:12345-0@lo:103: 00010000:00010000:2.0:1787779788.324928:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787779788.324932:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000e7152357/0xc8fc0a517996022c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc8fc0a5179960225 expref: 13 pid: 6506 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779788.324941:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000e7152357/0xc8fc0a517996022c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc8fc0a5179960225 expref: 13 pid: 6506 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779788.324955:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787779788.324978:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000313d7fbd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1f575176-36bc-4786-83ee-2fea064a12a9+13:3643:x1874622881469056:12345-0@lo:103: Request processed in 59us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779788.324984:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787779788.325057:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000893f8dd7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1f575176-36bc-4786-83ee-2fea064a12a9:3643:1874622881469056:0@lo:103: 00000100:00100000:3.0:1787779788.325224:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ce7d5cdf going to sleep for 11 seconds 00010000:00010000:3.0:1787779788.325237:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000e7152357/0xc8fc0a517996022c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc8fc0a5179960225 expref: 12 pid: 6506 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779788.325247:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009c2a1831 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6506:1874622881468672:0@lo:104: 00000100:00100000:3.0:1787779788.325254:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000079fae718 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6506:1874622881468800:0@lo:104: 00000100:00100000:1.0:1787779788.325323:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881468928 00000100:00100000:1.0:1787779788.325328:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881468928 00000100:00100000:1.0:1787779788.325349:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787779788.325354:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006a14f6bf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1f575176-36bc-4786-83ee-2fea064a12a9+3:6506:x1874622881468928:12345-0@lo:104: 00010000:00010000:1.0:1787779788.325361:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: 00000000854f5528/0xc8fc0a5179960199 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc8fc0a51799601a0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779788.325447:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787779788.325452:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006a14f6bf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1f575176-36bc-4786-83ee-2fea064a12a9+3:6506:x1874622881468928:12345-0@lo:104: Request processed in 99us (1163us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779788.325458:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1787779788.325614:0:7453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787779788.325618:0:7453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: 00000000854f5528/0xc8fc0a5179960199 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc8fc0a51799601a0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779788.325624:0:7453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000854f5528 already unused, calling callback (000000000bd3cb84) 10000000:00010000:1.0:1787779788.325627:0:7453:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: 00000000854f5528/0xc8fc0a5179960199 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc8fc0a51799601a0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779788.325643:0:7453:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: 00000000854f5528/0xc8fc0a5179960199 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc8fc0a51799601a0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787779788.325648:0:7453:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: 00000000854f5528/0xc8fc0a5179960199 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc8fc0a51799601a0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787779788.325652:0:7453:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787779788.325675:0:7453:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: 00000000854f5528/0xc8fc0a5179960199 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a51799601a0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779788.325680:0:7453:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787779788.325691:0:7453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: 00000000854f5528/0xc8fc0a5179960199 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a51799601a0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779788.325697:0:7453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: 00000000854f5528/0xc8fc0a5179960199 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a51799601a0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779788.325713:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cdd1ff09 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1f575176-36bc-4786-83ee-2fea064a12a9:3641:1874622881469184:0@lo:103: 00000100:00100000:1.0:1787779788.325751:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787779788.325773:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787779788.325775:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787779788.325776:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787779788.325883:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: 000000009ea8da73/0xc8fc0a51799601b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc8fc0a51799601bc expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779788.325890:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000009ea8da73 already unused, calling callback (000000000bd3cb84) 10000000:00010000:2.0:1787779788.325892:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: 000000009ea8da73/0xc8fc0a51799601b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc8fc0a51799601bc expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779788.325897:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: 000000009ea8da73/0xc8fc0a51799601b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc8fc0a51799601bc expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787779788.325902:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: 000000009ea8da73/0xc8fc0a51799601b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc8fc0a51799601bc expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787779788.325907:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787779788.325926:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: 000000009ea8da73/0xc8fc0a51799601b5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a51799601bc expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779788.325931:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787779788.325943:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: 000000009ea8da73/0xc8fc0a51799601b5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a51799601bc expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779788.325948:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: 000000009ea8da73/0xc8fc0a51799601b5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a51799601bc expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779788.325959:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787779788.325961:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787779788.325962:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787779788.326399:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787779788.326409:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000162de5ee pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1f575176-36bc-4786-83ee-2fea064a12a9:3641:1874622881469312:0@lo:103: 00000100:00100000:1.0:1787779788.326448:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779788.326508:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881469184 00000100:00100000:2.0:1787779788.326514:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881469184 00010000:00010000:2.0:1787779788.326532:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000e3ee7153/0xc8fc0a51799601a0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc8fc0a5179960199 expref: 12 pid: 6505 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779788.326559:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881469312 00000100:00100000:2.0:1787779788.326563:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881469312 00010000:00010000:2.0:1787779788.326572:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000184c5b7c/0xc8fc0a51799601bc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc8fc0a51799601b5 expref: 13 pid: 6506 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779788.326584:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787779788.326589:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000089c9a2fa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1f575176-36bc-4786-83ee-2fea064a12a9+13:3641:x1874622881469184:12345-0@lo:103: 00010000:00010000:2.0:1787779788.326597:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787779788.326600:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000e3ee7153/0xc8fc0a51799601a0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc8fc0a5179960199 expref: 13 pid: 6505 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779788.326608:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000e3ee7153/0xc8fc0a51799601a0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc8fc0a5179960199 expref: 13 pid: 6505 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779788.326633:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787779788.326661:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000089c9a2fa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1f575176-36bc-4786-83ee-2fea064a12a9+13:3641:x1874622881469184:12345-0@lo:103: Request processed in 72us (910us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779788.326667:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787779788.326679:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787779788.326685:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cedac180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1f575176-36bc-4786-83ee-2fea064a12a9+12:3641:x1874622881469312:12345-0@lo:103: 00010000:00010000:2.0:1787779788.326692:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787779788.326695:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000184c5b7c/0xc8fc0a51799601bc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc8fc0a51799601b5 expref: 12 pid: 6506 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779788.326704:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000184c5b7c/0xc8fc0a51799601bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc8fc0a51799601b5 expref: 12 pid: 6506 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779788.326713:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000184c5b7c/0xc8fc0a51799601bc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc8fc0a51799601b5 expref: 12 pid: 6506 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779788.326792:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000005a8b46a2/0xc8fc0a517996026b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779788.326800:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005a8b46a2/0xc8fc0a517996026b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779788.326814:0:6497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000005a8b46a2/0xc8fc0a517996026b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779788.326820:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000005a8b46a2/0xc8fc0a517996026b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779788.326826:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000005a8b46a2/0xc8fc0a517996026b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779788.326923:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000005a8b46a2/0xc8fc0a517996026b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779788.326930:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000005a8b46a2 already unused, calling callback (000000008129b6a0) 00010000:00010000:2.0:1787779788.326933:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000005a8b46a2/0xc8fc0a517996026b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779788.326939:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000005a8b46a2/0xc8fc0a517996026b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779788.326948:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000005a8b46a2/0xc8fc0a517996026b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779788.326958:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787779788.326981:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cedac180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1f575176-36bc-4786-83ee-2fea064a12a9+11:3641:x1874622881469312:12345-0@lo:103: Request processed in 297us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779788.327108:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787779788.327378:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000162de5ee pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1f575176-36bc-4786-83ee-2fea064a12a9:3641:1874622881469312:0@lo:103: 00000100:00100000:1.0:1787779788.327386:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cdd1ff09 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1f575176-36bc-4786-83ee-2fea064a12a9:3641:1874622881469184:0@lo:103: 00010000:00010000:0.0:1787779788.327502:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787779788.327697:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000e3ee7153/0xc8fc0a51799601a0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc8fc0a5179960199 expref: 10 pid: 6505 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779788.327709:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000129623c6 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6506:1874622881468928:0@lo:104: 00010000:00010000:3.0:1787779788.327731:0:6506:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000005a8b46a2/0xc8fc0a517996026b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779788.327740:0:6506:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000005a8b46a2/0xc8fc0a517996026b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779788.327744:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000005a8b46a2/0xc8fc0a517996026b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779788.327749:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000005a8b46a2/0xc8fc0a517996026b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787779788.327765:0:6506:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:1.0:1787779788.331270:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a9712ef7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+9:7441:x1874622881468544:12345-0@lo:253: Request processed in 28533us (28798us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779788.331284:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787779788.331356:0:7441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007c600d71 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:7441:1874622881468544:0@lo:253: 10000000:01000000:3.0:1787779788.331370:0:7441:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1787779788.331381:0:7441:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787779788.331383:0:7441:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1787779788.331385:0:7441:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787779788.331386:0:7441:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0001_UUID 00000020:01000004:3.0:1787779788.331388:0:7441:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787779788.331389:0:7441:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787779788.331390:0:7441:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787779788.331391:0:7441:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1787779788.331392:0:7441:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787779788.331394:0:7441:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787779788.331412:0:7441:0:(tgt_mount.c:101:server_register_mount()) register mount 000000003b09e874 from lustre-MDT0001 10000000:01000000:3.0:1787779788.331492:0:7441:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:3.0:1787779788.331494:0:7441:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1787779788.331500:0:7441:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9c04515699b8 local copy 10000000:01000000:3.0:1787779788.331503:0:7441:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787779788.331534:0:7441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: 00000000fee2ddc9/0xc8fc0a5179960272 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779788.331544:0:7441:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.131@tcp lock: 00000000fee2ddc9/0xc8fc0a5179960272 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779788.331552:0:7441:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: 00000000fee2ddc9/0xc8fc0a5179960272 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779788.331569:0:7441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007c600d71 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:7441:1874622881469440:0@lo:101: 00000100:00100000:3.0:1787779788.331599:0:7441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779788.331658:0:7441:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ce7d5cdf going to sleep for 11 seconds 00000100:00100000:1.0:1787779788.331688:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881469440 00000100:00100000:1.0:1787779788.331692:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881469440 00000100:00100000:1.0:1787779788.331753:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787779788.331760:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006f60b4aa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+9:7441:x1874622881469440:12345-0@lo:101: 00010000:00010000:1.0:1787779788.331772:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787779788.331782:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000091841d67/0xc8fc0a5179960279 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc8fc0a5179960272 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779788.331801:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000091841d67/0xc8fc0a5179960279 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc8fc0a5179960272 expref: 10 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779788.331810:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000091841d67/0xc8fc0a5179960279 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a5179960272 expref: 10 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779788.331817:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000091841d67, rc 0) 00000100:00100000:1.0:1787779788.331965:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006f60b4aa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+10:7441:x1874622881469440:12345-0@lo:101: Request processed in 204us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779788.331971:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787779788.332160:0:7441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007c600d71 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:7441:1874622881469440:0@lo:101: 00010000:00010000:3.0:1787779788.332170:0:7441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: 00000000fee2ddc9/0xc8fc0a5179960272 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xc8fc0a5179960279 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779788.332178:0:7441:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: 00000000fee2ddc9/0xc8fc0a5179960272 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xc8fc0a5179960279 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779788.332268:0:7441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007c600d71 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:7441:1874622881469568:0@lo:501: 00000100:00100000:3.0:1787779788.332290:0:7441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779788.332317:0:7441:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ce7d5cdf going to sleep for 11 seconds 00000100:00100000:2.0:1787779788.332352:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881469568 00000100:00100000:2.0:1787779788.332356:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881469568 00000100:00100000:2.0:1787779788.332382:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787779788.332387:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000085af9129 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+10:7441:x1874622881469568:12345-0@lo:501: 00000100:00100000:2.0:1787779788.332446:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000085af9129 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+10:7441:x1874622881469568:12345-0@lo:501: Request processed in 58us (155us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787779788.332452:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787779788.332549:0:7441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007c600d71 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:7441:1874622881469568:0@lo:501: 10000000:01000000:3.0:1787779788.332559:0:7441:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.131@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1787779788.332572:0:7441:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.131@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1787779788.332576:0:7441:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: 00000000fee2ddc9/0xc8fc0a5179960272 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xc8fc0a5179960279 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779788.332583:0:7441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: 00000000fee2ddc9/0xc8fc0a5179960272 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xc8fc0a5179960279 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779788.332589:0:7441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.131@tcp lock: 00000000fee2ddc9/0xc8fc0a5179960272 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xc8fc0a5179960279 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779788.332609:0:7441:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787779788.332628:0:7441:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9c04764fa000 10000000:01000000:3.0:1787779788.332631:0:7441:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787779788.332635:0:7441:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9c04515699b8 10000000:01000000:3.0:1787779788.332637:0:7441:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1787779788.332640:0:7441:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9c04515699b8 from 1 10000000:01000000:3.0:1787779788.332642:0:7441:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1787779788.332654:0:7441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: 0000000086b51916/0xc8fc0a5179960280 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779788.332660:0:7441:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: 0000000086b51916/0xc8fc0a5179960280 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779788.332677:0:7441:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: 0000000086b51916/0xc8fc0a5179960280 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779788.332686:0:7441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007c600d71 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:7441:1874622881469696:0@lo:101: 00000100:00100000:3.0:1787779788.332707:0:7441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779788.332719:0:7441:0:(client.c:2715:ptlrpc_set_wait()) set 000000006c1125fd going to sleep for 11 seconds 00000100:00100000:3.0:1787779788.332730:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881469696 00000100:00100000:3.0:1787779788.332733:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881469696 00000100:00100000:3.0:1787779788.332753:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787779788.332758:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000033dcb7c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+10:7441:x1874622881469696:12345-0@lo:101: 00010000:00010000:3.0:1787779788.332764:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787779788.332771:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000022ae6466/0xc8fc0a5179960287 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc8fc0a5179960280 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779788.332782:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000022ae6466/0xc8fc0a5179960287 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc8fc0a5179960280 expref: 11 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779788.332790:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000022ae6466/0xc8fc0a5179960287 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a5179960280 expref: 11 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779788.332796:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000022ae6466, rc 0) 00000100:00100000:3.0:1787779788.332816:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000033dcb7c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+11:7441:x1874622881469696:12345-0@lo:101: Request processed in 59us (109us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779788.332822:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00010000:2.0:1787779788.332944:0:7453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787779788.332949:0:7453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: 00000000fee2ddc9/0xc8fc0a5179960272 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xc8fc0a5179960279 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779788.332957:0:7453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000fee2ddc9 already unused, calling callback (000000000bd3cb84) 10000000:00010000:2.0:1787779788.332965:0:7453:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: 00000000fee2ddc9/0xc8fc0a5179960272 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xc8fc0a5179960279 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779788.332973:0:7453:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: 00000000fee2ddc9/0xc8fc0a5179960272 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0xc8fc0a5179960279 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787779788.332979:0:7453:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: 00000000fee2ddc9/0xc8fc0a5179960272 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0xc8fc0a5179960279 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787779788.332983:0:7453:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787779788.333058:0:7453:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: 00000000fee2ddc9/0xc8fc0a5179960272 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xc8fc0a5179960279 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779788.333066:0:7453:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787779788.333081:0:7453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: 00000000fee2ddc9/0xc8fc0a5179960272 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xc8fc0a5179960279 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779788.333087:0:7453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: 00000000fee2ddc9/0xc8fc0a5179960272 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xc8fc0a5179960279 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779788.333101:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787779788.333102:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787779788.333103:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787779788.333161:0:7441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007c600d71 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:7441:1874622881469696:0@lo:101: 00010000:00010000:3.0:1787779788.333170:0:7441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: 0000000086b51916/0xc8fc0a5179960280 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a5179960287 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779788.333196:0:7441:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: 0000000086b51916/0xc8fc0a5179960280 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc8fc0a5179960287 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787779788.333210:0:7441:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1787779788.333224:0:7441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: 0000000086b51916/0xc8fc0a5179960280 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a5179960287 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779788.333230:0:7441:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: 0000000086b51916/0xc8fc0a5179960280 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a5179960287 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787779788.333237:0:7441:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9c04764fa000 10000000:01000000:3.0:1787779788.333240:0:7441:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1787779788.333243:0:7441:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9c04764fa000 from 1 10000000:01000000:3.0:1787779788.333245:0:7441:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1787779788.333255:0:7441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: 0000000095264a53/0xc8fc0a517996028e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779788.333261:0:7441:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: 0000000095264a53/0xc8fc0a517996028e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779788.333267:0:7441:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: 0000000095264a53/0xc8fc0a517996028e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779788.333276:0:7441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007c600d71 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:7441:1874622881469952:0@lo:101: 00000100:00100000:3.0:1787779788.333298:0:7441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779788.333315:0:7441:0:(client.c:2715:ptlrpc_set_wait()) set 000000006c1125fd going to sleep for 11 seconds 00000100:00100000:3.0:1787779788.333325:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881469952 00000100:00100000:3.0:1787779788.333328:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881469952 00000100:00100000:3.0:1787779788.333348:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787779788.333352:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007dff2c16 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+11:7441:x1874622881469952:12345-0@lo:101: 00010000:00010000:3.0:1787779788.333358:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787779788.333363:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000072216992/0xc8fc0a5179960295 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc8fc0a517996028e expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779788.333375:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000072216992/0xc8fc0a5179960295 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc8fc0a517996028e expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779788.333382:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000072216992/0xc8fc0a5179960295 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a517996028e expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779788.333387:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000072216992, rc 0) 00000100:00100000:3.0:1787779788.333409:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007dff2c16 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+12:7441:x1874622881469952:12345-0@lo:101: Request processed in 57us (111us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779788.333414:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787779788.333520:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e335b84a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1f575176-36bc-4786-83ee-2fea064a12a9:3643:1874622881469824:0@lo:103: 00000100:00100000:0.0:1787779788.333548:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779788.333576:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881469824 00000100:00100000:0.0:1787779788.333579:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881469824 00000100:00100000:0.0:1787779788.333604:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787779788.333608:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000893f8dd7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1f575176-36bc-4786-83ee-2fea064a12a9+12:3643:x1874622881469824:12345-0@lo:103: 00010000:00010000:0.0:1787779788.333616:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787779788.333625:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000091841d67/0xc8fc0a5179960279 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc8fc0a5179960272 expref: 12 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779788.333640:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787779788.333661:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000893f8dd7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1f575176-36bc-4786-83ee-2fea064a12a9+11:3643:x1874622881469824:12345-0@lo:103: Request processed in 53us (112us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779788.333666:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787779788.333688:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e335b84a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1f575176-36bc-4786-83ee-2fea064a12a9:3643:1874622881469824:0@lo:103: 00000100:00100000:3.0:1787779788.333758:0:7441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007c600d71 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:7441:1874622881469952:0@lo:101: 00010000:00010000:3.0:1787779788.333767:0:7441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: 0000000095264a53/0xc8fc0a517996028e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a5179960295 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779788.333773:0:7441:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: 0000000095264a53/0xc8fc0a517996028e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc8fc0a5179960295 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787779788.333782:0:7441:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1787779788.333818:0:7441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: 0000000095264a53/0xc8fc0a517996028e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a5179960295 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779788.333824:0:7441:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: 0000000095264a53/0xc8fc0a517996028e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a5179960295 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787779788.333873:0:7441:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1787779788.333876:0:7441:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787779788.333881:0:7441:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9c04764fa000 10000000:01000000:3.0:1787779788.333882:0:7441:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1787779788.333885:0:7441:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:3.0:1787779788.333887:0:7441:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1787779788.333900:0:7441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: 000000003c94f8e6/0xc8fc0a517996029c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779788.333905:0:7441:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: 000000003c94f8e6/0xc8fc0a517996029c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779788.333912:0:7441:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: 000000003c94f8e6/0xc8fc0a517996029c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779788.333921:0:7441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007c600d71 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:7441:1874622881470080:0@lo:101: 00000100:00100000:3.0:1787779788.333941:0:7441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779788.333960:0:7441:0:(client.c:2715:ptlrpc_set_wait()) set 000000006c1125fd going to sleep for 11 seconds 00000100:00100000:3.0:1787779788.333972:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881470080 00000100:00100000:3.0:1787779788.333975:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881470080 00000100:00100000:3.0:1787779788.334003:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787779788.334008:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b6a0ebef pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+11:7441:x1874622881470080:12345-0@lo:101: 00010000:00010000:3.0:1787779788.334014:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787779788.334032:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006e5a6519/0xc8fc0a51799602a3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc8fc0a517996029c expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779788.334044:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006e5a6519/0xc8fc0a51799602a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc8fc0a517996029c expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779788.334058:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006e5a6519/0xc8fc0a51799602a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a517996029c expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779788.334064:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006e5a6519, rc 0) 00000100:00100000:3.0:1787779788.334087:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b6a0ebef pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+12:7441:x1874622881470080:12345-0@lo:101: Request processed in 80us (145us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779788.334092:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787779788.334110:0:7441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007c600d71 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:7441:1874622881470080:0@lo:101: 00010000:00010000:3.0:1787779788.334117:0:7441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: 000000003c94f8e6/0xc8fc0a517996029c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a51799602a3 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779788.334123:0:7441:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: 000000003c94f8e6/0xc8fc0a517996029c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc8fc0a51799602a3 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779788.334177:0:7441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007c600d71 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:7441:1874622881470208:0@lo:501: 00000100:00100000:3.0:1787779788.334211:0:7441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779788.334219:0:7441:0:(client.c:2715:ptlrpc_set_wait()) set 000000006c1125fd going to sleep for 11 seconds 00000100:00100000:3.0:1787779788.334235:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881470208 00000100:00100000:3.0:1787779788.334238:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881470208 00000100:00100000:3.0:1787779788.334253:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787779788.334258:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003c7a59fc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+12:7441:x1874622881470208:12345-0@lo:501: 00000100:00100000:3.0:1787779788.334341:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003c7a59fc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+12:7441:x1874622881470208:12345-0@lo:501: Request processed in 83us (130us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779788.334347:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787779788.334366:0:7441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007c600d71 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:7441:1874622881470208:0@lo:501: 00000100:00100000:3.0:1787779788.334402:0:7441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007c600d71 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:7441:1874622881470336:0@lo:503: 00000100:00100000:3.0:1787779788.334453:0:7441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779788.334461:0:7441:0:(client.c:2715:ptlrpc_set_wait()) set 000000006c1125fd going to sleep for 11 seconds 00000100:00100000:3.0:1787779788.334478:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881470336 00000100:00100000:3.0:1787779788.334481:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881470336 00000100:00100000:3.0:1787779788.334496:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787779788.334501:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b8cf53b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+12:7441:x1874622881470336:12345-0@lo:503: 00000100:00100000:3.0:1787779788.334570:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b8cf53b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+12:7441:x1874622881470336:12345-0@lo:503: Request processed in 69us (116us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779788.334576:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787779788.334608:0:7441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007c600d71 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:7441:1874622881470336:0@lo:503: 00000040:00080000:3.0:1787779788.334817:0:7441:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787779788.334899:0:7441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007c600d71 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:7441:1874622881470464:0@lo:502: 00000100:00100000:3.0:1787779788.334930:0:7441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779788.334945:0:7441:0:(client.c:2715:ptlrpc_set_wait()) set 000000006c1125fd going to sleep for 11 seconds 00000100:00100000:3.0:1787779788.334961:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881470464 00000100:00100000:3.0:1787779788.334965:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881470464 00000100:00100000:3.0:1787779788.334981:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787779788.334985:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ec7fc6c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+12:7441:x1874622881470464:12345-0@lo:502: 00000100:00100000:3.0:1787779788.335053:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ec7fc6c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+12:7441:x1874622881470464:12345-0@lo:502: Request processed in 67us (123us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779788.335059:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787779788.335086:0:7441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007c600d71 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:7441:1874622881470464:0@lo:502: 00000040:00080000:3.0:1787779788.335302:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1787779788.335328:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 136 off8552 00000040:00080000:3.0:1787779788.335341:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 176 off8728 00000040:00080000:3.0:1787779788.335352:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8952 00000040:00080000:3.0:1787779788.335364:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9176 00000040:00080000:3.0:1787779788.335384:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 120 off9296 00000040:00080000:3.0:1787779788.335396:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 112 off9408 00000040:00080000:3.0:1787779788.335408:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 160 off9568 00000040:00080000:3.0:1787779788.335420:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9792 00000040:00080000:3.0:1787779788.335432:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10016 00000040:00080000:3.0:1787779788.335446:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 88 off10104 00000040:00080000:3.0:1787779788.335459:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 144 off10248 00000040:00080000:3.0:1787779788.335472:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].13, 152 off10400 00000040:00080000:3.0:1787779788.335484:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].14, 168 off10568 00000040:00080000:3.0:1787779788.335497:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].15, 224 off10792 00000040:00080000:3.0:1787779788.335509:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].16, 224 off11016 00000040:00080000:3.0:1787779788.335522:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].17, 80 off11096 00000040:00080000:3.0:1787779788.335536:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].18, 224 off11320 00000040:00080000:3.0:1787779788.335549:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].19, 224 off11544 00000040:00080000:3.0:1787779788.335562:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].20, 160 off11704 00000040:00080000:3.0:1787779788.335573:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].21, 224 off11928 00000040:00080000:3.0:1787779788.335586:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].22, 224 off12152 00000040:00080000:3.0:1787779788.335599:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].23, 80 off12232 00000100:00100000:3.0:1787779788.335619:0:7441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007c600d71 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:7441:1874622881470592:0@lo:502: 00000100:00100000:3.0:1787779788.335654:0:7441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779788.335679:0:7441:0:(client.c:2715:ptlrpc_set_wait()) set 000000006c1125fd going to sleep for 11 seconds 00000100:00100000:3.0:1787779788.335700:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881470592 00000100:00100000:3.0:1787779788.335704:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881470592 00000100:00100000:3.0:1787779788.335721:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787779788.335726:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f4ec5e1d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+12:7441:x1874622881470592:12345-0@lo:502: 00000100:00100000:3.0:1787779788.335793:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f4ec5e1d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+12:7441:x1874622881470592:12345-0@lo:502: Request processed in 67us (139us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779788.335800:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787779788.335833:0:7441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007c600d71 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:7441:1874622881470592:0@lo:502: 00000040:00080000:3.0:1787779788.335891:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].24, 224 off12456 00000040:00080000:3.0:1787779788.335904:0:7441:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 24 count 25 00000020:01000000:0.0:1787779788.337119:0:7454:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787779788.337133:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787779788.337136:0:7454:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1787779788.337141:0:7454:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:0.0:1787779788.337144:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787779788.337157:0:7454:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (000000004ebed63e) 00000020:00000080:0.0:1787779788.337176:0:7454:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lod with refcount 2 00000020:00000080:0.0:1787779788.337182:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1787779788.337295:0:7454:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787779788.337303:0:7454:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xc8fc0a51799602b1 00000020:00000080:0.0:1787779788.337583:0:7454:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:0.0:1787779788.337588:0:7454:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787779788.337592:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787779788.337593:0:7454:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1787779788.337597:0:7454:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787779788.337600:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787779788.337601:0:7454:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:0.0:1787779788.337604:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787779788.337737:0:7454:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (00000000a60843b4) 00000020:00000080:0.0:1787779788.337749:0:7454:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type mdt with refcount 2 00000020:00000080:0.0:1787779788.337754:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1787779788.337756:0:7454:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:0.0:1787779788.337759:0:7454:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:0.0:1787779788.337764:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787779788.337818:0:7454:0:(tgt_mount.c:153:server_get_mount()) get mount 000000003b09e874 from lustre-MDT0001, refs=2 00000020:00000080:0.0:1787779788.338155:0:7454:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (000000004a74bc41) 00000020:00000080:0.0:1787779788.338169:0:7454:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type mdd with refcount 2 00000004:01000000:0.0:1787779788.338244:0:7454:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1787779788.338250:0:7454:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xc8fc0a51799602c6 00000020:00000080:0.0:1787779788.338348:0:7454:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:0.0:1787779788.338355:0:7454:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1787779788.338359:0:7454:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xc8fc0a51799602cd 00080000:01000000:0.0:1787779788.338364:0:7454:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:0.0:1787779788.338367:0:7454:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xc8fc0a51799602d4 00080000:10000000:0.0:1787779788.339106:0:7454:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:0.0:1787779788.339254:0:7454:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0001: No data found on store. Initialize space. 00010000:00010000:3.0:1787779788.450560:0:7454:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:02000400:3.0:1787779788.451169:0:7454:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0001: new disk, initializing 00000001:00000004:2.0:1787779788.455501:0:7454:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1787779788.456381:0:7454:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0001: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1787779788.465486:0:7454:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:3.0:1787779788.465499:0:7454:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787779788.465505:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787779788.465507:0:7454:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:3.0:1787779788.465511:0:7454:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787779788.465517:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787779788.465519:0:7454:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:3.0:1787779788.465522:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787779788.465527:0:7454:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.131@tcp to nid 0x20000c0a8cb83 (192.168.203.131@tcp) 00000020:00000080:3.0:1787779788.465552:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787779788.465565:0:7454:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (0000000001e73378) 00000020:00000080:3.0:1787779788.465583:0:7454:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:3.0:1787779788.465590:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787779788.465659:0:7454:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:3.0:1787779788.465665:0:7454:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:3.0:1787779788.465672:0:7454:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xc8fc0a51799602e2 00010000:00080000:3.0:1787779788.465701:0:7454:0:(ldlm_lib.c:102:import_set_conn()) imp 000000009618ead4@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.131@tcp at head 00010000:00010000:3.0:1787779788.470924:0:7454:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-2 is initialized 00000020:00000080:0.0:1787779788.478235:0:7454:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1787779788.478252:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1787779788.478294:0:7454:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:0.0:1787779788.478314:0:7454:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xc8fc0a51799602e9 00000100:00080000:0.0:1787779788.478326:0:7454:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787779788.478331:0:7454:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import 000000009618ead4 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:0.0:1787779788.478364:0:7454:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000006481e448 x1874622881470720/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787779788.478393:0:7454:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787779788.478566:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006481e448 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1874622881470720:0@lo:38: 00000100:00100000:3.0:1787779788.478632:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779788.478710:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881470720 00000100:00100000:3.0:1787779788.478716:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881470720 00000100:00100000:3.0:1787779788.478746:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787779788.478752:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007c600d71 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3640:x1874622881470720:12345-0@lo:38: 00010000:00080000:3.0:1787779788.478773:0:6517:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 196 last 0 00000020:00000080:3.0:1787779788.478800:0:6517:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xc8fc0a51799602f0 00000004:00100000:3.0:1787779788.478813:0:6517:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1787779788.478825:0:6517:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000020:01000000:0.0:1787779788.479133:0:7454:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787779788.479138:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787779788.479140:0:7454:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:0.0:1787779788.479142:0:7454:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787779788.479145:0:7454:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1787779788.479147:0:7454:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787779788.479148:0:7454:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787779788.479149:0:7454:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787779788.479151:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787779788.479152:0:7454:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:0.0:1787779788.479154:0:7454:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787779788.479158:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787779788.479164:0:7454:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:0.0:1787779788.479169:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1787779788.479210:0:7454:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1787779788.479224:0:7454:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787779788.479227:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787779788.479228:0:7454:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:0.0:1787779788.479230:0:7454:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787779788.479232:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787779788.479234:0:7454:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787779788.479240:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787779788.479242:0:7454:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787779788.479261:0:7454:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787779788.479264:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787779788.479265:0:7454:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787779788.479268:0:7454:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000020:01000000:3.0:1787779788.479540:0:7441:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-24 (rc=0) 10000000:01000000:3.0:1787779788.479568:0:7441:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1787779788.479586:0:7441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: 000000003c94f8e6/0xc8fc0a517996029c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a51799602a3 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779788.479595:0:7441:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: 000000003c94f8e6/0xc8fc0a517996029c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a51799602a3 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787779788.479603:0:7441:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c04764fa000 from 1 10000000:01000000:3.0:1787779788.479606:0:7441:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787779788.479631:0:7441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: 000000009883edf5/0xc8fc0a51799602f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779788.479638:0:7441:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: 000000009883edf5/0xc8fc0a51799602f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779788.479645:0:7441:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: 000000009883edf5/0xc8fc0a51799602f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779788.479662:0:7441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000129623c6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:7441:1874622881470848:0@lo:101: 00000100:00100000:3.0:1787779788.479704:0:7441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779788.479738:0:7441:0:(client.c:2715:ptlrpc_set_wait()) set 000000002c51d703 going to sleep for 11 seconds 00000100:00100000:0.0:1787779788.479816:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881470848 00000100:00100000:0.0:1787779788.479821:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881470848 00000100:00100000:2.0:1787779788.479971:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cdd1ff09 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874622881470976:0@lo:400: 00000100:00100000:2.0:1787779788.480023:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779788.480511:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787779788.480516:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000058b2efb8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+12:7441:x1874622881470848:12345-0@lo:101: 00010000:00010000:0.0:1787779788.480526:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787779788.480537:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000076347e44/0xc8fc0a51799602fe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc8fc0a51799602f7 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779788.480554:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000076347e44/0xc8fc0a51799602fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc8fc0a51799602f7 expref: 13 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779788.480560:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000076347e44/0xc8fc0a51799602fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a51799602f7 expref: 13 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779788.480566:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000076347e44, rc 0) 00000100:00100000:0.0:1787779788.480601:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000058b2efb8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+13:7441:x1874622881470848:12345-0@lo:101: Request processed in 86us (898us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779788.480611:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787779788.480698:0:7441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000129623c6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:7441:1874622881470848:0@lo:101: 00010000:00010000:2.0:1787779788.480709:0:7441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: 000000009883edf5/0xc8fc0a51799602f7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a51799602fe expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779788.480722:0:7441:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: 000000009883edf5/0xc8fc0a51799602f7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc8fc0a51799602fe expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779788.480800:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881470976 00000100:00100000:1.0:1787779788.480806:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881470976 00000100:00100000:1.0:1787779788.480870:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787779788.480879:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007e593ed3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874622881470976:12345-0@lo:400: 00000100:00100000:1.0:1787779788.480930:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007e593ed3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874622881470976:12345-0@lo:400: Request processed in 54us (907us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779788.480937:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1787779788.480978:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000cdd1ff09 x1874622881470976/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779804 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779788.481000:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cdd1ff09 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874622881470976:0@lo:400: 00000100:00100000:0.0:1787779788.481754:0:7441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000038a52583 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:7441:1874622881471104:0@lo:256: 00000100:00100000:0.0:1787779788.481801:0:7441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779788.482141:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881471104 00000100:00100000:3.0:1787779788.482148:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881471104 00000100:00100000:0.0:1787779788.482166:0:7441:0:(client.c:2715:ptlrpc_set_wait()) set 000000008feb4e70 going to sleep for 11 seconds 00000100:00100000:3.0:1787779788.482227:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787779788.482241:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000011c094c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+13:7441:x1874622881471104:12345-0@lo:256: 20000000:01000000:3.0:1787779788.482257:0:6505:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1787779788.482273:0:6505:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1787779788.482276:0:6505:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:3.0:1787779788.482373:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000011c094c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+13:7441:x1874622881471104:12345-0@lo:256: Request processed in 134us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779788.482381:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787779788.482405:0:7441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000038a52583 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:7441:1874622881471104:0@lo:256: 10000000:01000000:0.0:1787779788.483105:0:7441:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787779788.483121:0:7441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: 000000009883edf5/0xc8fc0a51799602f7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a51799602fe expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779788.483131:0:7441:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: 000000009883edf5/0xc8fc0a51799602f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a51799602fe expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787779788.483139:0:7441:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c04764fa000 from 1 10000000:01000000:0.0:1787779788.483143:0:7441:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787779788.483168:0:7441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: 00000000e3382dbd/0xc8fc0a5179960305 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779788.483174:0:7441:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: 00000000e3382dbd/0xc8fc0a5179960305 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779788.483182:0:7441:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: 00000000e3382dbd/0xc8fc0a5179960305 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779788.483206:0:7441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000038a52583 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:7441:1874622881471232:0@lo:101: 00000100:00100000:0.0:1787779788.483242:0:7441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779788.483263:0:7441:0:(client.c:2715:ptlrpc_set_wait()) set 000000008feb4e70 going to sleep for 11 seconds 00000100:00100000:3.0:1787779788.483318:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881471232 00000100:00100000:3.0:1787779788.483323:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881471232 00000100:00100000:3.0:1787779788.483355:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787779788.483362:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cb463ae6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+13:7441:x1874622881471232:12345-0@lo:101: 00010000:00010000:3.0:1787779788.483372:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787779788.483383:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000b11bb6b/0xc8fc0a517996030c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc8fc0a5179960305 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779788.483400:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000b11bb6b/0xc8fc0a517996030c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc8fc0a5179960305 expref: 14 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779788.483408:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000b11bb6b/0xc8fc0a517996030c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a5179960305 expref: 14 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779788.483415:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000b11bb6b, rc 0) 00000100:00100000:3.0:1787779788.483495:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cb463ae6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+14:7441:x1874622881471232:12345-0@lo:101: Request processed in 133us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779788.483501:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787779788.483520:0:7441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000038a52583 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:7441:1874622881471232:0@lo:101: 00010000:00010000:0.0:1787779788.483539:0:7441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: 00000000e3382dbd/0xc8fc0a5179960305 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a517996030c expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779788.483547:0:7441:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: 00000000e3382dbd/0xc8fc0a5179960305 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc8fc0a517996030c expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779788.483631:0:7441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000038a52583 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:7441:1874622881471360:0@lo:501: 00000100:00100000:0.0:1787779788.483654:0:7441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779788.483682:0:7441:0:(client.c:2715:ptlrpc_set_wait()) set 000000008feb4e70 going to sleep for 11 seconds 00000100:00100000:3.0:1787779788.483734:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881471360 00000100:00100000:3.0:1787779788.483738:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881471360 00000100:00100000:3.0:1787779788.483768:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787779788.483775:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c070f672 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+14:7441:x1874622881471360:12345-0@lo:501: 00000100:00100000:3.0:1787779788.484406:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c070f672 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+14:7441:x1874622881471360:12345-0@lo:501: Request processed in 630us (749us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779788.484414:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787779788.484538:0:7441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000038a52583 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:7441:1874622881471360:0@lo:501: 00000100:00100000:0.0:1787779788.484568:0:7441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000038a52583 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:7441:1874622881471488:0@lo:503: 00000100:00100000:0.0:1787779788.484606:0:7441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779788.484635:0:7441:0:(client.c:2715:ptlrpc_set_wait()) set 000000008feb4e70 going to sleep for 11 seconds 00000100:00100000:3.0:1787779788.484680:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881471488 00000100:00100000:3.0:1787779788.484684:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881471488 00000100:00100000:3.0:1787779788.484715:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787779788.484721:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005d1e84b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+14:7441:x1874622881471488:12345-0@lo:503: 00000040:00080000:3.0:1787779788.484751:0:6506:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787779788.485101:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005d1e84b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+14:7441:x1874622881471488:12345-0@lo:503: Request processed in 379us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779788.485108:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787779788.485235:0:7441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000038a52583 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:7441:1874622881471488:0@lo:503: 00000040:00080000:0.0:1787779788.485570:0:7441:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787779788.485616:0:7441:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 1 count 1 00000040:00080000:0.0:1787779788.485689:0:7441:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00080000:2.0:1787779788.488479:0:6517:0:(import.c:65:import_set_state_nolock()) 0000000013e159a3 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787779788.488579:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007c600d71 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3640:x1874622881470720:12345-0@lo:38: Request processed in 9824us (9944us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779788.488594:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787779788.488721:0:3640:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787779788.488730:0:3640:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 1 00000100:00080000:1.0:1787779788.488737:0:3640:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1787779788.488742:0:3640:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787779788.488744:0:3640:0:(import.c:65:import_set_state_nolock()) 000000009618ead4 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787779788.488763:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006481e448 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1874622881470720:0@lo:38: 00000040:00080000:3.0:1787779788.490396:0:7459:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 00000020:01000000:1.0:1787779788.490908:0:7441:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:1.0:1787779788.490950:0:7441:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787779788.490967:0:7441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: 00000000e3382dbd/0xc8fc0a5179960305 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a517996030c expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779788.490982:0:7441:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: 00000000e3382dbd/0xc8fc0a5179960305 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a517996030c expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787779788.491056:0:7441:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787779788.491059:0:7441:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9c04764fa000 10000000:01000000:1.0:1787779788.491062:0:7441:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9c04764fa000 10000000:01000000:1.0:1787779788.491066:0:7441:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787779788.491072:0:7441:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c04764fa000 from 1 10000000:01000000:1.0:1787779788.491075:0:7441:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787779788.491111:0:7441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: 00000000854f5528/0xc8fc0a5179960313 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779788.491119:0:7441:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: 00000000854f5528/0xc8fc0a5179960313 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779788.491129:0:7441:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: 00000000854f5528/0xc8fc0a5179960313 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779788.491150:0:7441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b1994c35 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:7441:1874622881471616:0@lo:101: 00000100:00100000:1.0:1787779788.491254:0:7441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779788.491292:0:7441:0:(client.c:2715:ptlrpc_set_wait()) set 00000000cdc23eb3 going to sleep for 11 seconds 00000100:00100000:3.0:1787779788.492135:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881471616 00000100:00100000:3.0:1787779788.492207:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881471616 00000100:00100000:1.0:1787779788.492277:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005b23dbc2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881471744:0@lo:41: 00000100:00100000:3.0:1787779788.492325:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787779788.492337:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779788.492393:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881471744 00000100:00100000:3.0:1787779788.492398:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004e577bb8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+14:7441:x1874622881471616:12345-0@lo:101: 00000100:00100000:1.0:1787779788.492399:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881471744 00010000:00010000:3.0:1787779788.492416:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787779788.492431:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000091bd699a/0xc8fc0a517996031a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc8fc0a5179960313 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779788.492455:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000091bd699a/0xc8fc0a517996031a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc8fc0a5179960313 expref: 15 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779788.492466:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000091bd699a/0xc8fc0a517996031a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a5179960313 expref: 15 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779788.492475:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000091bd699a, rc 0) 00000100:00100000:1.0:1787779788.492629:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787779788.492637:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b5c126af pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3641:x1874622881471744:12345-0@lo:41: 00000004:00000024:1.0:1787779788.492663:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:3.0:1787779788.492675:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004e577bb8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+15:7441:x1874622881471616:12345-0@lo:101: Request processed in 336us (1415us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779788.492689:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787779788.492746:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b5c126af pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3641:x1874622881471744:12345-0@lo:41: Request processed in 111us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779788.492754:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787779788.492796:0:7441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b1994c35 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:7441:1874622881471616:0@lo:101: 00010000:00010000:1.0:1787779788.492811:0:7441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: 00000000854f5528/0xc8fc0a5179960313 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a517996031a expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779788.492820:0:7441:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: 00000000854f5528/0xc8fc0a5179960313 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc8fc0a517996031a expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779788.492963:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005b23dbc2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881471744:0@lo:41: 00000100:00100000:1.0:1787779788.493685:0:7441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b1994c35 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:7441:1874622881471872:0@lo:501: 00000100:00100000:1.0:1787779788.493727:0:7441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779788.494480:0:7441:0:(client.c:2715:ptlrpc_set_wait()) set 00000000cdc23eb3 going to sleep for 11 seconds 00000100:00100000:3.0:1787779788.495725:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881471872 00000100:00100000:3.0:1787779788.495737:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881471872 00000100:00100000:3.0:1787779788.495875:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787779788.495884:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b822c1a3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+15:7441:x1874622881471872:12345-0@lo:501: 00000100:00100000:3.0:1787779788.496068:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b822c1a3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+15:7441:x1874622881471872:12345-0@lo:501: Request processed in 184us (2340us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779788.496075:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787779788.496162:0:7441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b1994c35 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:7441:1874622881471872:0@lo:501: 00000100:00100000:1.0:1787779788.496223:0:7441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b1994c35 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:7441:1874622881472000:0@lo:503: 00000100:00100000:1.0:1787779788.496272:0:7441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779788.498888:0:7441:0:(client.c:2715:ptlrpc_set_wait()) set 00000000cdc23eb3 going to sleep for 11 seconds 00000100:00100000:2.0:1787779788.499561:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881472000 00000100:00100000:2.0:1787779788.499579:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881472000 00000100:00100000:1.0:1787779788.499741:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787779788.499749:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e659de29 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+15:7441:x1874622881472000:12345-0@lo:503: 00000100:00100000:1.0:1787779788.499927:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e659de29 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+15:7441:x1874622881472000:12345-0@lo:503: Request processed in 178us (3655us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779788.499934:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787779788.500045:0:7441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b1994c35 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:7441:1874622881472000:0@lo:503: 00000040:00080000:2.0:1787779788.500373:0:7441:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787779788.502560:0:7441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000038a52583 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:7441:1874622881472128:0@lo:502: 00000100:00100000:0.0:1787779788.502709:0:7441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779788.503380:0:7441:0:(client.c:2715:ptlrpc_set_wait()) set 0000000087106eb1 going to sleep for 11 seconds 00000100:00100000:1.0:1787779788.503550:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881472128 00000100:00100000:1.0:1787779788.503558:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881472128 00000100:00100000:1.0:1787779788.503746:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787779788.503754:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e23129fe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+15:7441:x1874622881472128:12345-0@lo:502: 00000100:00100000:1.0:1787779788.503909:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e23129fe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+15:7441:x1874622881472128:12345-0@lo:502: Request processed in 156us (1201us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779788.503917:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787779788.504025:0:7441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000038a52583 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:7441:1874622881472128:0@lo:502: 00000040:00080000:0.0:1787779788.504260:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1787779788.504292:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1787779788.504306:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1787779788.504318:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1787779788.504342:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1787779788.504354:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1787779788.504366:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1787779788.504378:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1787779788.504391:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1787779788.504403:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1787779788.504416:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1787779788.504706:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1787779788.504726:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1787779788.504738:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1787779788.504750:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1787779788.504765:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1787779788.504781:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1787779788.504794:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1787779788.504809:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1787779788.504823:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1787779788.504880:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1787779788.504899:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1787779788.504914:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1787779788.504928:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1787779788.504941:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:0.0:1787779788.504954:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:0.0:1787779788.504967:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:0.0:1787779788.504981:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000100:00100000:0.0:1787779788.505015:0:7441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000038a52583 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:7441:1874622881472256:0@lo:502: 00000100:00100000:0.0:1787779788.505066:0:7441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779788.505641:0:7441:0:(client.c:2715:ptlrpc_set_wait()) set 0000000087106eb1 going to sleep for 11 seconds 00000100:00100000:3.0:1787779788.505789:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881472256 00000100:00100000:3.0:1787779788.505795:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881472256 00000100:00100000:3.0:1787779788.505830:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787779788.505862:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008e9b3dd1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+15:7441:x1874622881472256:12345-0@lo:502: 00000100:00100000:3.0:1787779788.505974:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008e9b3dd1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+15:7441:x1874622881472256:12345-0@lo:502: Request processed in 137us (907us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779788.505982:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787779788.506095:0:7441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000038a52583 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:7441:1874622881472256:0@lo:502: 00000040:00080000:0.0:1787779788.506150:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:0.0:1787779788.506161:0:7441:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:0.0:1787779788.506768:0:7460:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:0.0:1787779788.506791:0:7460:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (00000000af106535) 00000020:00000080:0.0:1787779788.506811:0:7460:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:0.0:1787779788.506927:0:7460:0:(tgt_mount.c:153:server_get_mount()) get mount 000000003b09e874 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1787779788.506931:0:7460:0:(tgt_mount.c:187:server_put_mount()) put mount 000000003b09e874 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1787779788.506934:0:7460:0:(obd_mount.c:710:lustre_put_lsi()) put 000000003b09e874 3 00010000:00080000:0.0:1787779788.506960:0:7460:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000072b89587@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.131@tcp at head 00010000:00010000:0.0:1787779788.512928:0:7460:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-3 is initialized 00000020:00000080:0.0:1787779788.513143:0:7460:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:0.0:1787779788.515327:0:7460:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787779788.515343:0:7460:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xc8fc0a5179960328 00000100:00080000:0.0:1787779788.515355:0:7460:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787779788.515360:0:7460:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import 0000000072b89587 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:0.0:1787779788.515396:0:7460:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000038a52583 x1874622881472384/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787779788.515502:0:7460:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787779788.517542:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000038a52583 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874622881472384:0@lo:38: 00000100:00100000:3.0:1787779788.517634:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779788.517993:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881472384 00000100:00100000:0.0:1787779788.518001:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881472384 00000100:00100000:0.0:1787779788.518039:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787779788.518045:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000079fae718 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3640:x1874622881472384:12345-0@lo:38: 00010000:00080000:0.0:1787779788.518072:0:6512:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 196 last 0 00000020:00000080:0.0:1787779788.518106:0:6512:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xc8fc0a517996032f 00000004:00100000:0.0:1787779788.518120:0:6512:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787779788.518150:0:6512:0:(import.c:65:import_set_state_nolock()) 00000000c1df149d : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787779788.518215:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000079fae718 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1874622881472384:12345-0@lo:38: Request processed in 169us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779788.518223:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787779788.518267:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000038a52583 x1874622881472384/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787779798 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787779788.518296:0:3640:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787779788.518304:0:3640:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 1 00000100:00080000:0.0:1787779788.518311:0:3640:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1787779788.518316:0:3640:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787779788.518318:0:3640:0:(import.c:65:import_set_state_nolock()) 0000000072b89587 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787779788.518322:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000038a52583 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874622881472384:0@lo:38: 00000040:00080000:0.0:1787779788.518422:0:7460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 40000000:00080000:3.0:1787779788.518541:0:7462:0:(fid_handler.c:282:seq_server_check_and_alloc_super()) srv-lustre-MDT0001: Can't allocate super-sequence: rc = -115 00000020:01000000:3.0:1787779788.519011:0:7441:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:3.0:1787779788.519044:0:7441:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787779788.519058:0:7441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: 00000000854f5528/0xc8fc0a5179960313 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a517996031a expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779788.519068:0:7441:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: 00000000854f5528/0xc8fc0a5179960313 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a517996031a expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787779788.519116:0:7441:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787779788.519123:0:7441:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1787779788.519124:0:7441:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787779788.519126:0:7441:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787779788.519127:0:7441:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787779788.519128:0:7441:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787779788.519129:0:7441:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787779788.519131:0:7441:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787779788.519132:0:7441:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787779788.519134:0:7441:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787779788.519135:0:7441:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787779788.519138:0:7441:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020061 00000020:01000004:3.0:1787779788.519140:0:7441:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787779788.519141:0:7441:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1787779788.519142:0:7441:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787779788.519143:0:7441:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787779788.519144:0:7441:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787779788.519145:0:7441:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787779788.519146:0:7441:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787779788.519147:0:7441:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787779788.519148:0:7441:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787779788.519148:0:7441:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787779788.519149:0:7441:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787779788.519167:0:7441:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1787779788.519192:0:7441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009c2a1831 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:7441:1874622881472512:0@lo:253: 00000100:00100000:3.0:1787779788.519236:0:7441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779788.519265:0:7441:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e68ac8ee going to sleep for 11 seconds 00000100:00100000:3.0:1787779788.519290:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881472512 00000100:00100000:3.0:1787779788.519295:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881472512 00000100:00100000:3.0:1787779788.519332:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787779788.519339:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005762de85 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+15:7441:x1874622881472512:12345-0@lo:253: 20000000:01000000:3.0:1787779788.519362:0:6506:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1787779788.519375:0:6506:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:1.0:1787779788.524075:0:6491:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:1.0:1787779788.524230:0:6506:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787779788.524276:0:6506:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:1.0:1787779788.524668:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005762de85 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+15:7441:x1874622881472512:12345-0@lo:253: Request processed in 5325us (5427us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779788.524681:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 20000000:01000000:2.0:1787779788.524745:0:6528:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787779788.524751:0:6528:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787779788.524769:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000060d37649/0xc8fc0a5179960336 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779788.524784:0:6528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000f916f108/0xc8fc0a5179960256 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a517996024f expref: 14 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779788.524791:0:6528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000076347e44/0xc8fc0a51799602fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a51799602f7 expref: 14 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779788.524798:0:6528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000060d37649/0xc8fc0a5179960336 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779788.524833:0:6528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000076347e44/0xc8fc0a51799602fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc8fc0a51799602f7 expref: 14 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779788.524879:0:6528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000076347e44/0xc8fc0a51799602fe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc8fc0a51799602f7 expref: 14 pid: 6507 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779788.524906:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005e11f8c3 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6528:1874622881472640:0@lo:104: 00000100:00100000:2.0:1787779788.524943:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787779788.524986:0:6528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000f916f108/0xc8fc0a5179960256 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc8fc0a517996024f expref: 14 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779788.524994:0:6528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000f916f108/0xc8fc0a5179960256 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc8fc0a517996024f expref: 14 pid: 6505 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779788.525001:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000012f72851 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6528:1874622881472768:0@lo:104: 00000100:00100000:2.0:1787779788.525022:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779788.525040:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set 0000000099178daa going to sleep for 11 seconds 00000100:00100000:0.0:1787779788.525123:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881472640 00000100:00100000:0.0:1787779788.525130:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881472640 00000100:00100000:0.0:1787779788.525160:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881472768 00000100:00100000:0.0:1787779788.525163:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881472768 00000100:00100000:0.0:1787779788.525176:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787779788.525182:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008cfbd84e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1f575176-36bc-4786-83ee-2fea064a12a9+4:6528:x1874622881472640:12345-0@lo:104: 00010000:00010000:0.0:1787779788.525202:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: 000000009883edf5/0xc8fc0a51799602f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc8fc0a51799602fe expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779788.525248:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787779788.525253:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008cfbd84e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1f575176-36bc-4786-83ee-2fea064a12a9+4:6528:x1874622881472640:12345-0@lo:104: Request processed in 72us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779788.525259:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787779788.525273:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787779788.525279:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006b509556 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1f575176-36bc-4786-83ee-2fea064a12a9+3:6528:x1874622881472768:12345-0@lo:104: 00010000:00010000:0.0:1787779788.525284:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: 000000004a42cb03/0xc8fc0a517996024f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc8fc0a5179960256 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779788.525316:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787779788.525326:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006b509556 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1f575176-36bc-4786-83ee-2fea064a12a9+3:6528:x1874622881472768:12345-0@lo:104: Request processed in 48us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779788.525332:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:0.0:1787779788.525348:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787779788.525354:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: 000000009883edf5/0xc8fc0a51799602f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc8fc0a51799602fe expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779788.525361:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000009883edf5 already unused, calling callback (000000000bd3cb84) 10000000:00010000:0.0:1787779788.525364:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: 000000009883edf5/0xc8fc0a51799602f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc8fc0a51799602fe expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779788.525371:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: 000000009883edf5/0xc8fc0a51799602f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc8fc0a51799602fe expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787779788.525377:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: 000000009883edf5/0xc8fc0a51799602f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc8fc0a51799602fe expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787779788.525382:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787779788.525408:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: 000000009883edf5/0xc8fc0a51799602f7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a51799602fe expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779788.525416:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787779788.525439:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: 000000009883edf5/0xc8fc0a51799602f7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a51799602fe expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779788.525446:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: 000000009883edf5/0xc8fc0a51799602f7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a51799602fe expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779788.525458:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787779788.525460:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: 000000004a42cb03/0xc8fc0a517996024f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc8fc0a5179960256 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779788.525474:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000004a42cb03 already unused, calling callback (000000000bd3cb84) 10000000:00010000:0.0:1787779788.525476:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: 000000004a42cb03/0xc8fc0a517996024f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc8fc0a5179960256 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779788.525481:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: 000000004a42cb03/0xc8fc0a517996024f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc8fc0a5179960256 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787779788.525486:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: 000000004a42cb03/0xc8fc0a517996024f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc8fc0a5179960256 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787779788.525491:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787779788.525502:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: 000000004a42cb03/0xc8fc0a517996024f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a5179960256 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779788.525508:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787779788.525520:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: 000000004a42cb03/0xc8fc0a517996024f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a5179960256 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779788.525526:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: 000000004a42cb03/0xc8fc0a517996024f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a5179960256 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779788.525538:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787779788.525539:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787779788.525541:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787779788.525546:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787779788.525562:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000038a52583 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1f575176-36bc-4786-83ee-2fea064a12a9:3642:1874622881472896:0@lo:103: 00000100:00100000:0.0:1787779788.525716:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779788.525755:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a5a9872c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1f575176-36bc-4786-83ee-2fea064a12a9:3643:1874622881473024:0@lo:103: 00000100:00100000:0.0:1787779788.525788:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779788.525821:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881472896 00000100:00100000:0.0:1787779788.525825:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881472896 00010000:00010000:0.0:1787779788.525860:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000076347e44/0xc8fc0a51799602fe lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc8fc0a51799602f7 expref: 15 pid: 6507 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779788.525878:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881473024 00000100:00100000:0.0:1787779788.525881:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881473024 00010000:00010000:0.0:1787779788.525891:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000f916f108/0xc8fc0a5179960256 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc8fc0a517996024f expref: 16 pid: 6505 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779788.525903:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787779788.525908:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d7a1e075 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1f575176-36bc-4786-83ee-2fea064a12a9+16:3642:x1874622881472896:12345-0@lo:103: 00010000:00010000:0.0:1787779788.525917:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787779788.525921:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000076347e44/0xc8fc0a51799602fe lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc8fc0a51799602f7 expref: 16 pid: 6507 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779788.525930:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000076347e44/0xc8fc0a51799602fe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc8fc0a51799602f7 expref: 16 pid: 6507 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779788.525944:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787779788.525970:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d7a1e075 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1f575176-36bc-4786-83ee-2fea064a12a9+16:3642:x1874622881472896:12345-0@lo:103: Request processed in 62us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779788.525976:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787779788.525988:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787779788.525993:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ebc5edd2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1f575176-36bc-4786-83ee-2fea064a12a9+15:3643:x1874622881473024:12345-0@lo:103: 00010000:00010000:0.0:1787779788.526001:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787779788.526004:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000f916f108/0xc8fc0a5179960256 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc8fc0a517996024f expref: 15 pid: 6505 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779788.526024:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000f916f108/0xc8fc0a5179960256 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc8fc0a517996024f expref: 15 pid: 6505 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779788.526036:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000060d37649/0xc8fc0a5179960336 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779788.526042:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000060d37649/0xc8fc0a5179960336 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787779788.526055:0:6499:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002587631s 00010000:00010000:0.0:1787779788.526058:0:6499:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000060d37649/0xc8fc0a5179960336 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779788.526064:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000060d37649/0xc8fc0a5179960336 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779788.526069:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000060d37649/0xc8fc0a5179960336 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779788.526074:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000060d37649/0xc8fc0a5179960336 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779788.526079:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000060d37649 already unused, calling callback (000000008129b6a0) 00010000:00010000:0.0:1787779788.526081:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000060d37649/0xc8fc0a5179960336 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779788.526087:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000060d37649/0xc8fc0a5179960336 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779788.526094:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000060d37649/0xc8fc0a5179960336 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779788.526111:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787779788.526136:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ebc5edd2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1f575176-36bc-4786-83ee-2fea064a12a9+15:3643:x1874622881473024:12345-0@lo:103: Request processed in 144us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779788.526142:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787779788.526210:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a5a9872c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1f575176-36bc-4786-83ee-2fea064a12a9:3643:1874622881473024:0@lo:103: 00000100:00100000:0.0:1787779788.526234:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000038a52583 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1f575176-36bc-4786-83ee-2fea064a12a9:3642:1874622881472896:0@lo:103: 00010000:00010000:2.0:1787779788.526354:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000076347e44/0xc8fc0a51799602fe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc8fc0a51799602f7 expref: 14 pid: 6507 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779788.526366:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005e11f8c3 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6528:1874622881472640:0@lo:104: 00010000:00010000:2.0:1787779788.526375:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000f916f108/0xc8fc0a5179960256 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc8fc0a517996024f expref: 13 pid: 6505 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779788.526382:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000012f72851 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6528:1874622881472768:0@lo:104: 00010000:00010000:2.0:1787779788.526395:0:6528:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000060d37649/0xc8fc0a5179960336 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779788.526403:0:6528:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000060d37649/0xc8fc0a5179960336 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779788.526407:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000060d37649/0xc8fc0a5179960336 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779788.526422:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000060d37649/0xc8fc0a5179960336 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779788.526553:0:7441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009c2a1831 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:7441:1874622881472512:0@lo:253: 10000000:01000000:3.0:1787779788.526563:0:7441:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1787779788.526637:0:7441:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787779788.526644:0:7441:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1787779788.526645:0:7441:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787779788.526647:0:7441:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787779788.526648:0:7441:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787779788.526649:0:7441:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787779788.526650:0:7441:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787779788.526652:0:7441:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787779788.526653:0:7441:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787779788.526654:0:7441:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787779788.526655:0:7441:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787779788.526666:0:7441:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1787779788.532470:0:7441:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00080000:10000000:2.0:1787779788.532760:0:7441:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1787779788.533021:0:7441:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:2.0:1787779788.533199:0:7441:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1787779788.533387:0:7441:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:2.0:1787779788.533835:0:7441:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:3.0:1787779788.537529:0:7441:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:3.0:1787779788.538012:0:7441:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:3.0:1787779788.538234:0:7441:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:10000000:3.0:1787779788.538395:0:7441:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:3.0:1787779788.538658:0:7441:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00080000:10000000:3.0:1787779788.538803:0:7441:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00000040:01000000:1.0:1787779788.540736:0:7441:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:2.0:1787779788.541066:0:7465:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:2.0:1787779788.541070:0:7465:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:1.0:1787779788.541232:0:7466:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000100:00100000:1.0:1787779788.541282:0:7466:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000041ab582c pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7466:1874622881473152:0@lo:700: 00000100:00100000:1.0:1787779788.541350:0:7466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779788.541401:0:7466:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d87a73c8 going to sleep for 11 seconds 00000100:00100000:2.0:1787779788.541504:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881473152 00000100:00100000:2.0:1787779788.541510:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881473152 00000100:00100000:2.0:1787779788.541558:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787779788.541677:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000526a7dd9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7466:x1874622881473152:12345-0@lo:700: 00000040:01000000:3.0:1787779788.541797:0:7441:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:1.0:1787779788.542306:0:7467:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f93477e8 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7467:1874622881473280:0@lo:1000: 00000100:00100000:1.0:1787779788.542344:0:7467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779788.542379:0:7467:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e2a36bcc going to sleep for 11 seconds 00000100:00100000:2.0:1787779788.542436:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881473280 00000100:00100000:2.0:1787779788.542441:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881473280 00000100:00100000:2.0:1787779788.542473:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787779788.542478:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000886d2ec6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7467:x1874622881473280:12345-0@lo:1000: 00000100:00100000:2.0:1787779788.542545:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000886d2ec6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7467:x1874622881473280:12345-0@lo:1000: Request processed in 66us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779788.542551:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787779788.542745:0:7467:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f93477e8 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7467:1874622881473280:0@lo:1000: 00000040:01000000:0.0:1787779788.542777:0:7467:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000100:00100000:0.0:1787779788.542800:0:7467:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000038a52583 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7467:1874622881473408:0@lo:700: 00000100:00100000:0.0:1787779788.542829:0:7467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779788.542873:0:7467:0:(client.c:2715:ptlrpc_set_wait()) set 0000000087106eb1 going to sleep for 11 seconds 00000100:00100000:1.0:1787779788.542935:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881473408 00000100:00100000:1.0:1787779788.542939:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881473408 00000100:00100000:1.0:1787779788.542980:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787779788.542986:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a5a9872c pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7467:x1874622881473408:12345-0@lo:700: 00000100:00100000:1.0:1787779788.543023:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a5a9872c pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7467:x1874622881473408:12345-0@lo:700: Request processed in 39us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779788.543030:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787779788.543092:0:7467:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000038a52583 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7467:1874622881473408:0@lo:700: 00000100:00100000:0.0:1787779788.543132:0:7467:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000038a52583 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7467:1874622881473536:0@lo:900: 00000100:00100000:0.0:1787779788.543154:0:7467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779788.543176:0:7467:0:(client.c:2715:ptlrpc_set_wait()) set 0000000087106eb1 going to sleep for 11 seconds 00000100:00100000:1.0:1787779788.543234:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881473536 00000100:00100000:1.0:1787779788.543238:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881473536 00000100:00100000:1.0:1787779788.543266:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787779788.543272:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000313d7fbd pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7467:x1874622881473536:12345-0@lo:900: 00000100:00100000:1.0:1787779788.543306:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000313d7fbd pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7467:x1874622881473536:12345-0@lo:900: Request processed in 35us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779788.543312:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787779788.543416:0:7467:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000038a52583 x1874622881473536/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787779804 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787779788.543493:0:7467:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000038a52583 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7467:1874622881473536:0@lo:900: 00000100:00100000:0.0:1787779788.543563:0:7467:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000038a52583 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7467:1874622881473664:0@lo:1000: 00000100:00100000:0.0:1787779788.543660:0:7467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779788.543681:0:7467:0:(client.c:2715:ptlrpc_set_wait()) set 00000000755cf4fa going to sleep for 11 seconds 00000100:00100000:1.0:1787779788.543730:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881473664 00000100:00100000:1.0:1787779788.543734:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881473664 00000100:00100000:1.0:1787779788.543763:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787779788.543768:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000893f8dd7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7467:x1874622881473664:12345-0@lo:1000: 00000100:00100000:1.0:1787779788.543821:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000893f8dd7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7467:x1874622881473664:12345-0@lo:1000: Request processed in 53us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779788.543827:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787779788.543926:0:7467:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000038a52583 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7467:1874622881473664:0@lo:1000: 00000004:00080000:0.0:1787779788.543966:0:7467:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 0000000087106eb1 with version 0 00000020:00100000:0.0:1787779788.543985:0:7467:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787779788.543991:0:7467:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@0000000038a52583 x1874622881473920/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787779788.544002:0:7467:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000038a52583 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7467:1874622881473920:0@lo:1000: 00000100:00100000:0.0:1787779788.544024:0:7467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779788.544043:0:7467:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f690323c going to sleep for 11 seconds 00000100:00100000:1.0:1787779788.544081:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881473920 00000100:00100000:1.0:1787779788.544085:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881473920 00000100:00100000:1.0:1787779788.544111:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787779788.544117:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d7a1e075 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7467:x1874622881473920:12345-0@lo:1000: 00000040:01000000:3.0:1787779788.545091:0:7441:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:3.0:1787779788.545207:0:7441:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1787779788.545829:0:7441:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1787779788.545865:0:7441:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:3.0:1787779788.546022:0:7441:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787779788.549586:0:7441:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1787779788.550429:0:7441:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1787779788.550468:0:7441:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:1.0:1787779788.550721:0:7441:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:2.0:1787779788.550830:0:6491:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 40000000:02000000:2.0:1787779788.551049:0:6519:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt 00080000:10000000:1.0:1787779788.551110:0:7441:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:1.0:1787779788.551733:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:1.0:1787779788.551894:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:1.0:1787779788.552022:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:1.0:1787779788.552150:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00000100:00100000:3.0:1787779788.554862:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d7a1e075 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7467:x1874622881473920:12345-0@lo:1000: Request processed in 10718us (10810us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1787779788.554876:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000004:00080000:0.0:1787779788.557344:0:7467:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:0.0:1787779788.557353:0:7467:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1787779788.557373:0:7467:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000038a52583 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7467:1874622881473920:0@lo:1000: 00000100:00100000:0.0:1787779788.557678:0:7467:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000038a52583 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7467:1874622881474048:0@lo:1000: 00000100:00100000:0.0:1787779788.557737:0:7467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779788.557874:0:7467:0:(client.c:2715:ptlrpc_set_wait()) set 00000000762e0ff7 going to sleep for 11 seconds 00000100:00100000:2.0:1787779788.558165:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000526a7dd9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7466:x1874622881473152:12345-0@lo:700: Request processed in 16599us (16814us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779788.558203:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787779788.558223:0:7466:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000041ab582c x1874622881473152/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787779804 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787779788.558237:0:7466:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000041ab582c pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7466:1874622881473152:0@lo:700: 40000000:02000000:1.0:1787779788.558247:0:7466:0:(fid_request.c:122:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] 00100000:10000000:0.0:1787779788.558674:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:0.0:1787779788.558958:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:0.0:1787779788.559092:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:0.0:1787779788.559379:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:0.0:1787779788.559556:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:0.0:1787779788.559804:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:0.0:1787779788.559968:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:0.0:1787779788.560125:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:0.0:1787779788.560802:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00000100:00100000:3.0:1787779788.560952:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881474048 00000100:00100000:3.0:1787779788.560962:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881474048 00100000:10000000:0.0:1787779788.561176:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:0.0:1787779788.561330:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:0.0:1787779788.561475:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:0.0:1787779788.561932:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:0.0:1787779788.562076:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:0.0:1787779788.562226:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:0.0:1787779788.562380:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:0.0:1787779788.562766:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:0.0:1787779788.562963:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:0.0:1787779788.563092:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:0.0:1787779788.563343:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:0.0:1787779788.563542:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:0.0:1787779788.563750:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:0.0:1787779788.564140:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:0.0:1787779788.564305:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:0.0:1787779788.564630:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:0.0:1787779788.564941:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:0.0:1787779788.565079:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00000100:00100000:2.0:1787779788.565296:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787779788.565310:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000291c3609 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7467:x1874622881474048:12345-0@lo:1000: 00000100:00100000:2.0:1787779788.565463:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000291c3609 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7467:x1874622881474048:12345-0@lo:1000: Request processed in 158us (7727us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779788.565471:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787779788.565547:0:7467:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000038a52583 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7467:1874622881474048:0@lo:1000: 00000040:00080000:0.0:1787779788.565649:0:7467:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:0.0:1787779788.565684:0:7467:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 0000000087106eb1 with version 1 00000004:00080000:3.0:1787779788.567291:0:7456:0:(osp_trans.c:1336:osp_get_next_request()) ou 00000000cc719340 version 1 rpc_version 1 00000020:00100000:3.0:1787779788.567332:0:7456:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1787779788.567340:0:7456:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000009c2a1831 x1874622881474304/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787779788.567362:0:7456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009c2a1831 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7456:1874622881474304:0@lo:1000: 00000100:00100000:3.0:1787779788.567443:0:7456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779788.567488:0:7456:0:(client.c:2715:ptlrpc_set_wait()) set 00000000cdc23eb3 going to sleep for 11 seconds 00000100:00100000:3.0:1787779788.567509:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881474304 00000100:00100000:3.0:1787779788.567515:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881474304 00000100:00100000:3.0:1787779788.567550:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787779788.567557:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000025f09d6e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7456:x1874622881474304:12345-0@lo:1000: 00000040:00080000:0.0:1787779788.572600:0:7467:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1787779788.575910:0:7467:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00100000:10000000:2.0:1787779788.580281:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1787779788.585805:0:7441:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:2.0:1787779788.585938:0:6491:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000100:00100000:3.0:1787779788.586090:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000025f09d6e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7456:x1874622881474304:12345-0@lo:1000: Request processed in 18530us (18645us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1787779788.586103:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000004:00080000:1.0:1787779788.586440:0:7456:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:1.0:1787779788.586446:0:7456:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1787779788.586475:0:7456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009c2a1831 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7456:1874622881474304:0@lo:1000: 00000001:00080000:3.0:1787779788.598400:0:7441:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1787779788.598500:0:7441:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffb66b81c83988 00100000:10000000:3.0:1787779788.598509:0:7441:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000040:00080000:0.0:1787779788.598668:0:7466:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:01000004:3.0:1787779788.599422:0:7441:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787779788.599502:0:7441:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.131@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787779788.599523:0:7441:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1787779788.599539:0:7441:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:2.0:1787779788.601951:0:7441:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787779788.602372:0:7441:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00000040:00080000:1.0:1787779788.610338:0:7466:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1787779788.610423:0:7466:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1787779788.610428:0:7466:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 10000000:01000000:3.0:1787779788.807566:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787779788.807573:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c04764fa000 from 4 10000000:01000000:3.0:1787779788.807578:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787779788.807688:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: 000000009824b5a2/0xc8fc0a517996033d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779788.807700:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: 000000009824b5a2/0xc8fc0a517996033d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779788.807710:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: 000000009824b5a2/0xc8fc0a517996033d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779788.807797:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000090912cd6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881474432:0@lo:101: 00000100:00100000:3.0:1787779788.807991:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779788.808079:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b761b8a8 going to sleep for 11 seconds 00000100:00100000:0.0:1787779788.808219:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881474432 00000100:00100000:0.0:1787779788.808227:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881474432 00000100:00100000:0.0:1787779788.808282:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787779788.808290:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000028477768 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+13:6509:x1874622881474432:12345-0@lo:101: 00010000:00010000:0.0:1787779788.808304:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787779788.808317:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004e7eaaeb/0xc8fc0a5179960344 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc8fc0a517996033d expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779788.808347:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004e7eaaeb/0xc8fc0a5179960344 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc8fc0a517996033d expref: 14 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779788.808357:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004e7eaaeb/0xc8fc0a5179960344 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a517996033d expref: 14 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779788.808366:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004e7eaaeb, rc 0) 00000100:00100000:0.0:1787779788.808405:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000028477768 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+14:6509:x1874622881474432:12345-0@lo:101: Request processed in 116us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779788.808412:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787779788.808671:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000090912cd6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881474432:0@lo:101: 00010000:00010000:3.0:1787779788.808689:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: 000000009824b5a2/0xc8fc0a517996033d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a5179960344 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779788.808698:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: 000000009824b5a2/0xc8fc0a517996033d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc8fc0a5179960344 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779788.808766:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000090912cd6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881474560:0@lo:256: 00000100:00100000:3.0:1787779788.808798:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779788.808821:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b761b8a8 going to sleep for 11 seconds 00000100:00100000:0.0:1787779788.808879:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881474560 00000100:00100000:0.0:1787779788.808885:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881474560 00000100:00100000:0.0:1787779788.808922:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787779788.808929:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000b9d61c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+14:6509:x1874622881474560:12345-0@lo:256: 20000000:01000000:0.0:1787779788.808943:0:6506:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787779788.808957:0:6506:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787779788.808960:0:6506:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:0.0:1787779788.809032:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000b9d61c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+14:6509:x1874622881474560:12345-0@lo:256: Request processed in 103us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779788.809040:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787779788.809168:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000090912cd6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881474560:0@lo:256: 10000000:01000000:3.0:1787779788.809221:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787779788.809227:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: 000000009824b5a2/0xc8fc0a517996033d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a5179960344 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779788.809236:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: 000000009824b5a2/0xc8fc0a517996033d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a5179960344 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787779788.809244:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787779788.809246:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c044407a000 from 21 10000000:01000000:3.0:1787779788.809249:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787779788.809265:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: 00000000445a1f73/0xc8fc0a517996034b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779788.809272:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: 00000000445a1f73/0xc8fc0a517996034b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779788.809290:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: 00000000445a1f73/0xc8fc0a517996034b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779788.809302:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000090912cd6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881474688:0@lo:101: 00000100:00100000:3.0:1787779788.809327:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779788.809352:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b761b8a8 going to sleep for 11 seconds 00000100:00100000:1.0:1787779788.809404:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881474688 00000100:00100000:1.0:1787779788.809408:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881474688 00000100:00100000:1.0:1787779788.809441:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787779788.809448:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000662f2544 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+14:6509:x1874622881474688:12345-0@lo:101: 00010000:00010000:1.0:1787779788.809456:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787779788.809464:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005d8daf36/0xc8fc0a5179960352 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc8fc0a517996034b expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779788.809479:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005d8daf36/0xc8fc0a5179960352 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc8fc0a517996034b expref: 15 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779788.809487:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005d8daf36/0xc8fc0a5179960352 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a517996034b expref: 15 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779788.809505:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005d8daf36, rc 0) 00000100:00100000:1.0:1787779788.809543:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000662f2544 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+15:6509:x1874622881474688:12345-0@lo:101: Request processed in 96us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779788.809549:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787779788.809640:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000090912cd6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881474688:0@lo:101: 00010000:00010000:3.0:1787779788.809649:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: 00000000445a1f73/0xc8fc0a517996034b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a5179960352 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779788.809656:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: 00000000445a1f73/0xc8fc0a517996034b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc8fc0a5179960352 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779788.809707:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000090912cd6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881474816:0@lo:501: 00000100:00100000:3.0:1787779788.809731:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779788.809759:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b761b8a8 going to sleep for 11 seconds 00000100:00100000:0.0:1787779788.809797:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881474816 00000100:00100000:0.0:1787779788.809802:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881474816 00000100:00100000:0.0:1787779788.809831:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787779788.809868:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001155fa79 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+15:6509:x1874622881474816:12345-0@lo:501: 00000100:00100000:0.0:1787779788.809979:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001155fa79 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+15:6509:x1874622881474816:12345-0@lo:501: Request processed in 143us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779788.809987:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787779788.810090:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000090912cd6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881474816:0@lo:501: 00000100:00100000:3.0:1787779788.810116:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000090912cd6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881474944:0@lo:503: 00000100:00100000:3.0:1787779788.810152:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779788.810172:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b761b8a8 going to sleep for 11 seconds 00000100:00100000:0.0:1787779788.810230:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881474944 00000100:00100000:0.0:1787779788.810234:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881474944 00000100:00100000:0.0:1787779788.810262:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787779788.810268:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000711304bf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+15:6509:x1874622881474944:12345-0@lo:503: 00000100:00100000:0.0:1787779788.810342:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000711304bf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+15:6509:x1874622881474944:12345-0@lo:503: Request processed in 75us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779788.810350:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787779788.810431:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000090912cd6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881474944:0@lo:503: 00000100:00100000:0.0:1787779788.818704:0:7484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008dad7bf5 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f575176-36bc-4786-83ee-2fea064a12a9:7484:1874622881475072:0@lo:502: 00000100:00100000:0.0:1787779788.818787:0:7484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779788.818851:0:7484:0:(client.c:2715:ptlrpc_set_wait()) set 000000003b882e0e going to sleep for 11 seconds 00000100:00100000:2.0:1787779788.819015:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881475072 00000100:00100000:2.0:1787779788.819021:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881475072 00000100:00100000:2.0:1787779788.819070:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787779788.819079:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000001b1173a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+15:7484:x1874622881475072:12345-0@lo:502: 00000100:00100000:2.0:1787779788.819210:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000001b1173a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+15:7484:x1874622881475072:12345-0@lo:502: Request processed in 132us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779788.819217:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787779788.819567:0:7484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008dad7bf5 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f575176-36bc-4786-83ee-2fea064a12a9:7484:1874622881475072:0@lo:502: 00000100:00100000:0.0:1787779788.819619:0:7484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008dad7bf5 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f575176-36bc-4786-83ee-2fea064a12a9:7484:1874622881475200:0@lo:502: 00000100:00100000:0.0:1787779788.819654:0:7484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779788.819681:0:7484:0:(client.c:2715:ptlrpc_set_wait()) set 000000003b882e0e going to sleep for 11 seconds 00000100:00100000:1.0:1787779788.819728:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881475200 00000100:00100000:1.0:1787779788.819733:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881475200 00000100:00100000:1.0:1787779788.819799:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787779788.819806:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000008dadf56 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+15:7484:x1874622881475200:12345-0@lo:502: 00000100:00100000:1.0:1787779788.819912:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000008dadf56 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+15:7484:x1874622881475200:12345-0@lo:502: Request processed in 107us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779788.819919:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787779788.819990:0:7484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008dad7bf5 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f575176-36bc-4786-83ee-2fea064a12a9:7484:1874622881475200:0@lo:502: 00000040:00080000:0.0:1787779788.820009:0:7484:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:3.0:1787779788.820222:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:3.0:1787779788.820244:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787779788.820252:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: 00000000445a1f73/0xc8fc0a517996034b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a5179960352 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779788.820275:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: 00000000445a1f73/0xc8fc0a517996034b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a5179960352 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787779788.820284:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787779788.820286:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c044407a000 from 4 10000000:01000000:3.0:1787779788.820289:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787779788.820311:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: 000000001551b46d/0xc8fc0a5179960359 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779788.820318:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: 000000001551b46d/0xc8fc0a5179960359 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779788.820326:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: 000000001551b46d/0xc8fc0a5179960359 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779788.820338:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000090912cd6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881475328:0@lo:101: 00000100:00100000:3.0:1787779788.820470:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779788.820534:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b761b8a8 going to sleep for 11 seconds 00000100:00100000:1.0:1787779788.820575:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881475328 00000100:00100000:1.0:1787779788.820580:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881475328 00000100:00100000:1.0:1787779788.820611:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787779788.820617:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002c2e9b32 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+15:6509:x1874622881475328:12345-0@lo:101: 00010000:00010000:1.0:1787779788.820626:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787779788.820637:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004a42cb03/0xc8fc0a5179960360 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc8fc0a5179960359 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779788.820656:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004a42cb03/0xc8fc0a5179960360 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc8fc0a5179960359 expref: 16 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779788.820665:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004a42cb03/0xc8fc0a5179960360 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a5179960359 expref: 16 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779788.820673:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004a42cb03, rc 0) 00000100:00100000:1.0:1787779788.820710:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002c2e9b32 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+16:6509:x1874622881475328:12345-0@lo:101: Request processed in 93us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779788.820723:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787779788.820798:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000090912cd6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881475328:0@lo:101: 00010000:00010000:3.0:1787779788.820810:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: 000000001551b46d/0xc8fc0a5179960359 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a5179960360 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779788.820817:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: 000000001551b46d/0xc8fc0a5179960359 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc8fc0a5179960360 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779788.820889:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000090912cd6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881475456:0@lo:256: 00000100:00100000:3.0:1787779788.820918:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779788.820947:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b761b8a8 going to sleep for 11 seconds 00000100:00100000:2.0:1787779788.821015:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881475456 00000100:00100000:2.0:1787779788.821020:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881475456 00000100:00100000:2.0:1787779788.821039:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787779788.821044:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000057370c0b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+16:6509:x1874622881475456:12345-0@lo:256: 20000000:01000000:2.0:1787779788.821058:0:6506:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787779788.821073:0:6506:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787779788.821077:0:6506:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:2.0:1787779788.821149:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000057370c0b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+16:6509:x1874622881475456:12345-0@lo:256: Request processed in 104us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779788.821155:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787779788.821234:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000090912cd6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881475456:0@lo:256: 10000000:01000000:3.0:1787779788.821274:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787779788.821279:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: 000000001551b46d/0xc8fc0a5179960359 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a5179960360 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779788.821286:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: 000000001551b46d/0xc8fc0a5179960359 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a5179960360 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787779788.821293:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1787779788.821295:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:3.0:1787779788.821297:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1787779788.821312:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: 00000000c107f9cd/0xc8fc0a5179960367 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779788.821319:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: 00000000c107f9cd/0xc8fc0a5179960367 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779788.821326:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: 00000000c107f9cd/0xc8fc0a5179960367 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779788.821336:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000090912cd6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881475584:0@lo:101: 00000100:00100000:3.0:1787779788.821361:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779788.821388:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b761b8a8 going to sleep for 11 seconds 00000100:00100000:1.0:1787779788.821442:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881475584 00000100:00100000:1.0:1787779788.821446:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881475584 00000100:00100000:1.0:1787779788.821466:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787779788.821471:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000082ddbff pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+16:6509:x1874622881475584:12345-0@lo:101: 00010000:00010000:1.0:1787779788.821478:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787779788.821486:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000091841d67/0xc8fc0a517996036e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc8fc0a5179960367 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779788.821500:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000091841d67/0xc8fc0a517996036e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc8fc0a5179960367 expref: 17 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779788.821508:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000091841d67/0xc8fc0a517996036e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a5179960367 expref: 17 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779788.821513:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000091841d67, rc 0) 00000100:00100000:1.0:1787779788.821549:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000082ddbff pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+17:6509:x1874622881475584:12345-0@lo:101: Request processed in 79us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779788.821555:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787779788.821622:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000090912cd6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881475584:0@lo:101: 00010000:00010000:3.0:1787779788.821632:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: 00000000c107f9cd/0xc8fc0a5179960367 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a517996036e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779788.821639:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: 00000000c107f9cd/0xc8fc0a5179960367 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc8fc0a517996036e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779788.821692:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000090912cd6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881475712:0@lo:501: 00000100:00100000:3.0:1787779788.821716:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779788.821737:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b761b8a8 going to sleep for 11 seconds 00000100:00100000:2.0:1787779788.821783:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881475712 00000100:00100000:2.0:1787779788.821788:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881475712 00000100:00100000:2.0:1787779788.821804:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787779788.821809:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000046c45628 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+17:6509:x1874622881475712:12345-0@lo:501: 00000100:00100000:2.0:1787779788.821935:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000046c45628 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+17:6509:x1874622881475712:12345-0@lo:501: Request processed in 125us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779788.821942:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787779788.822006:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000090912cd6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881475712:0@lo:501: 00000100:00100000:3.0:1787779788.822031:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000090912cd6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881475840:0@lo:503: 00000100:00100000:3.0:1787779788.822065:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779788.822092:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b761b8a8 going to sleep for 11 seconds 00000100:00100000:1.0:1787779788.822140:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881475840 00000100:00100000:1.0:1787779788.822144:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881475840 00000100:00100000:1.0:1787779788.822162:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787779788.822168:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009b3e8847 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+17:6509:x1874622881475840:12345-0@lo:503: 00000100:00100000:1.0:1787779788.822259:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009b3e8847 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+17:6509:x1874622881475840:12345-0@lo:503: Request processed in 91us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779788.822265:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787779788.822336:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000090912cd6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881475840:0@lo:503: 00000100:00100000:2.0:1787779788.822670:0:7485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000012f72851 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f575176-36bc-4786-83ee-2fea064a12a9:7485:1874622881475968:0@lo:502: 00000100:00100000:2.0:1787779788.822705:0:7485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779788.822727:0:7485:0:(client.c:2715:ptlrpc_set_wait()) set 000000004c16714d going to sleep for 11 seconds 00000100:00100000:1.0:1787779788.822772:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881475968 00000100:00100000:1.0:1787779788.822777:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881475968 00000100:00100000:1.0:1787779788.822817:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787779788.822823:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008b159725 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+17:7485:x1874622881475968:12345-0@lo:502: 00000100:00100000:1.0:1787779788.823040:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008b159725 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+17:7485:x1874622881475968:12345-0@lo:502: Request processed in 218us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779788.823047:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787779788.823120:0:7485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000012f72851 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f575176-36bc-4786-83ee-2fea064a12a9:7485:1874622881475968:0@lo:502: 00000020:01000000:2.0:1787779788.823145:0:7485:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787779788.823155:0:7485:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787779788.823157:0:7485:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:2.0:1787779788.823162:0:7485:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787779788.823165:0:7485:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.131@tcp to nid 0x20000c0a8cb83 (192.168.203.131@tcp) 00000020:00000080:2.0:1787779788.823200:0:7485:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787779788.823223:0:7485:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (00000000836355ba) 00000020:00000080:2.0:1787779788.823242:0:7485:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osp with refcount 2 00000020:00000080:2.0:1787779788.823249:0:7485:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787779788.823332:0:7485:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:2.0:1787779788.823338:0:7485:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:2.0:1787779788.823344:0:7485:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc8fc0a517996037c 00010000:00080000:2.0:1787779788.823372:0:7485:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000070324504@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.131@tcp at head 00010000:00010000:2.0:1787779788.825323:0:7485:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-4 is initialized 00000020:00000080:0.0:1787779788.837078:0:7485:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787779788.837093:0:7485:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1787779788.837133:0:7485:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:0.0:1787779788.837155:0:7485:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc8fc0a5179960383 00000100:00080000:0.0:1787779788.837166:0:7485:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787779788.837170:0:7485:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import 0000000070324504 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:0.0:1787779788.837218:0:7485:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000008dad7bf5 x1874622881476096/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787779788.837247:0:7485:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000040:01000000:0.0:1787779788.837287:0:7485:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:3.0:1787779788.837453:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008dad7bf5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1874622881476096:0@lo:38: 00000100:00100000:3.0:1787779788.837525:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787779788.837932:0:7490:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@000000009c2a1831 x1874622881476224/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779788.837943:0:7490:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f0285f9d going to sleep for 0 seconds 00000020:01000000:0.0:1787779788.838311:0:7485:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787779788.838316:0:7485:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787779788.838318:0:7485:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:0.0:1787779788.838321:0:7485:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787779788.838325:0:7485:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787779788.838327:0:7485:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787779788.838330:0:7485:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787779788.838331:0:7485:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1787779788.838353:0:7485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000038a52583 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f575176-36bc-4786-83ee-2fea064a12a9:7485:1874622881476352:0@lo:502: 00000100:00100000:0.0:1787779788.838403:0:7485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779788.838429:0:7485:0:(client.c:2715:ptlrpc_set_wait()) set 0000000072f62198 going to sleep for 11 seconds 00000100:00100000:3.0:1787779788.838485:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881476352 00000100:00100000:3.0:1787779788.838492:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881476352 00000100:00100000:3.0:1787779788.838540:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787779788.838548:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005c94f432 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+17:7485:x1874622881476352:12345-0@lo:502: 00000100:00100000:3.0:1787779788.838656:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005c94f432 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+17:7485:x1874622881476352:12345-0@lo:502: Request processed in 109us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779788.838664:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787779788.838874:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881476096 00000100:00100000:1.0:1787779788.838880:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881476096 00000100:00100000:1.0:1787779788.838908:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787779788.838913:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000090912cd6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3640:x1874622881476096:12345-0@lo:38: 00010000:00080000:1.0:1787779788.838934:0:6518:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 196 last 0 00000020:00000080:1.0:1787779788.838965:0:6518:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc8fc0a517996038a 00000004:00100000:1.0:1787779788.838979:0:6518:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1787779788.838984:0:6518:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:0.0:1787779788.839148:0:7485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000038a52583 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f575176-36bc-4786-83ee-2fea064a12a9:7485:1874622881476352:0@lo:502: 00000020:01000000:0.0:1787779788.839176:0:7485:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787779788.839192:0:7485:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787779788.839194:0:7485:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787779788.839197:0:7485:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:3.0:1787779788.839336:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:3.0:1787779788.839357:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1787779788.839365:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: 00000000c107f9cd/0xc8fc0a5179960367 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a517996036e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779788.839386:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: 00000000c107f9cd/0xc8fc0a5179960367 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a517996036e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787779788.839396:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1787779788.839399:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9c04515699b8 from 1 10000000:01000000:3.0:1787779788.839402:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787779788.839423:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: 000000006f2710ee/0xc8fc0a5179960391 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779788.839430:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: 000000006f2710ee/0xc8fc0a5179960391 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779788.839438:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: 000000006f2710ee/0xc8fc0a5179960391 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779788.839451:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000129623c6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881476480:0@lo:101: 00000100:00100000:3.0:1787779788.839485:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779788.839515:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set 0000000061039245 going to sleep for 11 seconds 00000100:00100000:0.0:1787779788.839561:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881476480 00000100:00100000:0.0:1787779788.839566:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881476480 00000100:00100000:0.0:1787779788.839598:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787779788.839605:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b4a2a5a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+17:6509:x1874622881476480:12345-0@lo:101: 00010000:00010000:0.0:1787779788.839614:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787779788.839626:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b3a89eb6/0xc8fc0a5179960398 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc8fc0a5179960391 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779788.839644:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b3a89eb6/0xc8fc0a5179960398 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc8fc0a5179960391 expref: 18 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779788.839653:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b3a89eb6/0xc8fc0a5179960398 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a5179960391 expref: 18 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779788.839661:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b3a89eb6, rc 0) 00000100:00100000:0.0:1787779788.839706:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b4a2a5a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+18:6509:x1874622881476480:12345-0@lo:101: Request processed in 102us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779788.839713:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787779788.839813:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000129623c6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881476480:0@lo:101: 00010000:00010000:1.0:1787779788.839824:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: 000000006f2710ee/0xc8fc0a5179960391 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a5179960398 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779788.839832:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: 000000006f2710ee/0xc8fc0a5179960391 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xc8fc0a5179960398 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779788.839918:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000041ab582c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881476608:0@lo:501: 00000100:00100000:1.0:1787779788.839946:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779788.839961:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ab750aed going to sleep for 11 seconds 00000100:00100000:0.0:1787779788.840105:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881476608 00000100:00100000:0.0:1787779788.840110:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881476608 00000100:00100000:0.0:1787779788.840176:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787779788.840193:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fe190a9e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+18:6509:x1874622881476608:12345-0@lo:501: 00000100:00100000:0.0:1787779788.840250:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fe190a9e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+18:6509:x1874622881476608:12345-0@lo:501: Request processed in 67us (304us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787779788.840257:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787779788.840313:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000041ab582c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881476608:0@lo:501: 10000000:01000000:1.0:1787779788.840337:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787779788.840342:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: 000000006f2710ee/0xc8fc0a5179960391 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a5179960398 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779788.840355:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: 000000006f2710ee/0xc8fc0a5179960391 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a5179960398 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787779788.857222:0:6518:0:(import.c:65:import_set_state_nolock()) 0000000047922c83 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787779788.857325:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000090912cd6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3640:x1874622881476096:12345-0@lo:38: Request processed in 18409us (19800us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779788.857335:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787779788.857419:0:3640:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787779788.857437:0:3640:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1787779788.857446:0:3640:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1787779788.857451:0:3640:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1787779788.857460:0:3640:0:(import.c:65:import_set_state_nolock()) 0000000070324504 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:2.0:1787779788.857474:0:3640:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000f0285f9d): req@000000009c2a1831 x1874622881476224/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787779788.857488:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008dad7bf5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1874622881476096:0@lo:38: 00000100:00100000:2.0:1787779788.857596:0:7490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779788.857623:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881476224 00000100:00100000:2.0:1787779788.857628:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881476224 00000100:00100000:2.0:1787779788.857657:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787779788.857664:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005e11f8c3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7490:x1874622881476224:12345-0@lo:1000: 00000100:00100000:2.0:1787779788.857721:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005e11f8c3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7490:x1874622881476224:12345-0@lo:1000: Request processed in 57us (125us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779788.857728:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787779788.857765:0:7490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009c2a1831 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7490:1874622881476224:0@lo:1000: 00000040:01000000:2.0:1787779788.857797:0:7490:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1787779788.857830:0:7490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000439fd67a pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7490:1874622881476864:0@lo:1000: 00000100:00100000:2.0:1787779788.857887:0:7490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779788.857904:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881476864 00000100:00100000:2.0:1787779788.857907:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881476864 00000100:00100000:2.0:1787779788.857924:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787779788.857929:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001b7aa419 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7490:x1874622881476864:12345-0@lo:1000: 00000100:00100000:2.0:1787779788.858001:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001b7aa419 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7490:x1874622881476864:12345-0@lo:1000: Request processed in 72us (114us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779788.858007:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787779788.858025:0:7490:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a8cf970d going to sleep for 11 seconds 00000100:00100000:2.0:1787779788.858036:0:7490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000439fd67a pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7490:1874622881476864:0@lo:1000: 00000100:00100000:2.0:1787779788.858069:0:7490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000439fd67a pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7490:1874622881476992:0@lo:700: 00000100:00100000:2.0:1787779788.858099:0:7490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779788.858111:0:7490:0:(client.c:2715:ptlrpc_set_wait()) set 000000008a064ac9 going to sleep for 11 seconds 00000100:00100000:1.0:1787779788.858172:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000012f72851 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881476736:0@lo:41: 00000100:00100000:1.0:1787779788.858214:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779788.858250:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881476992 00000100:00100000:1.0:1787779788.858254:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881476992 00000100:00100000:1.0:1787779788.858279:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787779788.858285:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005b23dbc2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0000-mdtlov_UUID+6:7490:x1874622881476992:12345-0@lo:700: 00000100:00100000:1.0:1787779788.858319:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005b23dbc2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0000-mdtlov_UUID+6:7490:x1874622881476992:12345-0@lo:700: Request processed in 35us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779788.858326:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787779788.858341:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881476736 00000100:00100000:1.0:1787779788.858344:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881476736 00000100:00100000:1.0:1787779788.858358:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787779788.858362:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000041ab582c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3644:x1874622881476736:12345-0@lo:41: 00000004:00000024:1.0:1787779788.858380:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:1.0:1787779788.858411:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000041ab582c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3644:x1874622881476736:12345-0@lo:41: Request processed in 48us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779788.858416:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787779788.858444:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000012f72851 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881476736:0@lo:41: 00000100:00100000:2.0:1787779788.858501:0:7490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000439fd67a pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7490:1874622881476992:0@lo:700: 00000100:00100000:2.0:1787779788.858663:0:7490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000439fd67a pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7490:1874622881477120:0@lo:1000: 00000100:00100000:2.0:1787779788.858688:0:7490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779788.858743:0:7490:0:(client.c:2715:ptlrpc_set_wait()) set 000000009b407f96 going to sleep for 11 seconds 00000100:00100000:1.0:1787779788.859825:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881477120 00000100:00100000:1.0:1787779788.859862:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881477120 00000100:00100000:1.0:1787779788.859901:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787779788.859908:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e335b84a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7490:x1874622881477120:12345-0@lo:1000: 00000100:00100000:1.0:1787779788.859985:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e335b84a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7490:x1874622881477120:12345-0@lo:1000: Request processed in 78us (1297us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779788.859993:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787779788.860148:0:7490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000439fd67a pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7490:1874622881477120:0@lo:1000: 00000004:00080000:0.0:1787779788.860207:0:7490:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 000000008a064ac9 with version 0 00000020:00100000:0.0:1787779788.860224:0:7490:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787779788.860230:0:7490:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@0000000038a52583 x1874622881477376/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787779788.860246:0:7490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000038a52583 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7490:1874622881477376:0@lo:1000: 00000100:00100000:0.0:1787779788.860275:0:7490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779788.860300:0:7490:0:(client.c:2715:ptlrpc_set_wait()) set 00000000fec96f98 going to sleep for 11 seconds 00000100:00100000:1.0:1787779788.860338:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881477376 00000100:00100000:1.0:1787779788.860342:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881477376 00000100:00100000:1.0:1787779788.860369:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787779788.860375:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008dad7bf5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7490:x1874622881477376:12345-0@lo:1000: 00000001:00080000:2.0:1787779788.863281:0:7442:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967297 is committed 00000001:00100000:2.0:1787779788.863294:0:7442:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1787779788.863633:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008dad7bf5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7490:x1874622881477376:12345-0@lo:1000: Request processed in 3255us (3354us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1787779788.863645:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000004:00080000:0.0:1787779788.863708:0:7490:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:0.0:1787779788.863713:0:7490:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1787779788.863727:0:7490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000038a52583 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7490:1874622881477376:0@lo:1000: 00000100:00100000:0.0:1787779788.863811:0:7490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000038a52583 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7490:1874622881477504:0@lo:1000: 00000100:00100000:0.0:1787779788.863884:0:7490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779788.863917:0:7490:0:(client.c:2715:ptlrpc_set_wait()) set 000000007aaa4c74 going to sleep for 11 seconds 00000100:00100000:2.0:1787779788.864010:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881477504 00000100:00100000:2.0:1787779788.864017:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881477504 00000100:00100000:2.0:1787779788.864057:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787779788.864065:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006481e448 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7490:x1874622881477504:12345-0@lo:1000: 00000100:00100000:2.0:1787779788.864134:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006481e448 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7490:x1874622881477504:12345-0@lo:1000: Request processed in 70us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779788.864141:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787779788.864222:0:7490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000038a52583 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7490:1874622881477504:0@lo:1000: 00000040:00080000:0.0:1787779788.864238:0:7490:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:0.0:1787779788.864273:0:7490:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 00000000aff1e48e with version 1 00000004:00080000:1.0:1787779788.864491:0:7486:0:(osp_trans.c:1336:osp_get_next_request()) ou 0000000033cf0753 version 1 rpc_version 1 00000020:00100000:1.0:1787779788.864509:0:7486:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787779788.864515:0:7486:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@0000000089c9a2fa x1874622881477760/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787779788.864528:0:7486:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000089c9a2fa pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7486:1874622881477760:0@lo:1000: 00000100:00100000:1.0:1787779788.864555:0:7486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779788.864577:0:7486:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ab750aed going to sleep for 11 seconds 00000100:00100000:2.0:1787779788.864617:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881477760 00000100:00100000:2.0:1787779788.864621:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881477760 00000100:00100000:2.0:1787779788.864648:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787779788.864654:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cedac180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7486:x1874622881477760:12345-0@lo:1000: 00000040:00080000:0.0:1787779788.867246:0:7490:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1787779788.867323:0:7490:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1787779788.867328:0:7490:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000001:00080000:0.0:1787779788.870807:0:7442:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967298 is committed 00000100:00100000:2.0:1787779788.871020:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cedac180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7486:x1874622881477760:12345-0@lo:1000: Request processed in 6363us (6461us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1787779788.871032:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000004:00080000:1.0:1787779788.871109:0:7486:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:1.0:1787779788.871115:0:7486:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1787779788.871130:0:7486:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000089c9a2fa pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7486:1874622881477760:0@lo:1000: 00010000:00010000:2.0:1787779788.894599:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787779789.918315:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787779790.941129:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787779791.966630:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787779792.089365:0:7717:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg331-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000020:00000004:0.0:1787779792.878519:0:7769:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787779792.878729:0:7769:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787779792.988012:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787779793.692046:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000162de5ee pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881477888:0@lo:41: 00000100:00100000:0.0:1787779793.692116:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779793.692184:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881477888 00000100:00100000:1.0:1787779793.692192:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881477888 00000100:00100000:1.0:1787779793.692240:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787779793.692248:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001a7a1862 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881477888:12345-0@lo:41: 00000004:00000024:1.0:1787779793.692300:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:1.0:1787779793.692354:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001a7a1862 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881477888:12345-0@lo:41: Request processed in 107us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779793.692362:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787779793.692446:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000162de5ee pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881477888:0@lo:41: 00010000:00010000:1.0:1787779794.014626:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787779794.204191:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787779794.204191:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000121838a2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1f575176-36bc-4786-83ee-2fea064a12a9:3643:1874622881478144:0@lo:400: 00000100:00100000:3.0:1787779794.204210:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000439fd67a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881478016:0@lo:41: 00000100:00100000:1.0:1787779794.204764:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a2977635 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874622881478272:0@lo:400: 00000100:00100000:0.0:1787779794.204913:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000124d7954 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1874622881478528:0@lo:400: 00000100:00100000:3.0:1787779794.205682:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779794.205746:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008817bb86 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881478400:0@lo:400: 00000100:00100000:3.0:1787779794.205773:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779794.205891:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779794.205925:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000038a52583 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881478656:0@lo:400: 00000100:00100000:3.0:1787779794.205984:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881478144 00000100:00100000:3.0:1787779794.205990:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881478144 00000100:00100000:3.0:1787779794.206032:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787779794.206040:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005f23a052 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+18:3643:x1874622881478144:12345-0@lo:400: 00000100:00100000:3.0:1787779794.206099:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005f23a052 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+18:3643:x1874622881478144:12345-0@lo:400: Request processed in 61us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779794.206105:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787779794.206184:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881478016 00000100:00100000:3.0:1787779794.206189:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881478016 00000100:00100000:3.0:1787779794.206210:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881478400 00000100:00100000:3.0:1787779794.206213:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881478400 00000100:00100000:2.0:1787779794.206218:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779794.206231:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881478656 00000100:00100000:3.0:1787779794.206235:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881478656 00000100:00100000:2.0:1787779794.206245:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000121838a2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1f575176-36bc-4786-83ee-2fea064a12a9:3643:1874622881478144:0@lo:400: 00000100:00100000:3.0:1787779794.206251:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787779794.206258:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f4ec2803 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3641:x1874622881478016:12345-0@lo:41: 00000004:00000024:3.0:1787779794.206288:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:0.0:1787779794.206411:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779794.206448:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881478528 00000100:00100000:0.0:1787779794.206453:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881478528 00000100:00100000:0.0:1787779794.206481:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787779794.206488:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000121838a2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1874622881478528:12345-0@lo:400: 00000100:00100000:0.0:1787779794.206525:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000121838a2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1874622881478528:12345-0@lo:400: Request processed in 38us (114us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779794.206531:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787779794.206591:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f4ec2803 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3641:x1874622881478016:12345-0@lo:41: Request processed in 333us (911us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779794.206599:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787779794.206613:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787779794.206619:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009c2a1831 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881478400:12345-0@lo:400: 00000100:00100000:3.0:1787779794.206649:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009c2a1831 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881478400:12345-0@lo:400: Request processed in 30us (875us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779794.206655:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787779794.206666:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787779794.206671:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000012f72851 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881478656:12345-0@lo:400: 00000100:00100000:3.0:1787779794.206704:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000012f72851 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881478656:12345-0@lo:400: Request processed in 33us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779794.206710:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787779794.206736:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000038a52583 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881478656:0@lo:400: 00000100:00100000:1.0:1787779794.207064:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779794.207126:0:6513:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00010000:00080000:1.0:1787779794.207129:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000124d7954 x1874622881478528/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779810 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787779794.207157:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000124d7954 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1874622881478528:0@lo:400: 00000100:00100000:3.0:1787779794.207165:0:6513:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1787779794.207306:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000439fd67a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881478016:0@lo:41: 00000100:00100000:2.0:1787779794.207330:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008817bb86 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881478400:0@lo:400: 00000100:00100000:0.0:1787779794.207357:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881478272 00000100:00100000:0.0:1787779794.207360:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881478272 00000100:00100000:0.0:1787779794.207770:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787779794.207778:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000089c9a2fa pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874622881478272:12345-0@lo:400: 00000100:00100000:0.0:1787779794.207858:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000089c9a2fa pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874622881478272:12345-0@lo:400: Request processed in 60us (773us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779794.207866:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1787779794.207921:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000a2977635 x1874622881478272/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779810 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787779794.207931:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a2977635 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874622881478272:0@lo:400: 00010000:00010000:2.0:1787779795.037039:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1787779795.396022:0:7871:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787779795.396245:0:7871:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787779796.062100:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787779796.294773:0:7920:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcd4fd07c0 20000000:00000080:2.0:1787779796.294789:0:7920:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9c046efaac00 uarg=0000000000000000 20000000:01000000:2.0:1787779796.294826:0:7920:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1787779796.294831:0:7920:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1787779796.294850:0:7920:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1787779796.294919:0:7920:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:2.0:1787779796.295017:0:7920:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:0.0:1787779796.309772:0:7920:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787779796.309999:0:7920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1787779796.310030:0:7920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:0.0:1787779796.310044:0:7920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:0.0:1787779796.310058:0:7920:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787779796.310074:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000e3ee7153/0xc8fc0a517996039f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779796.310090:0:7920:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000004a6c7bbe/0xc8fc0a517996021e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a5179960217 expref: 17 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779796.310096:0:7920:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000000b11bb6b/0xc8fc0a517996030c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a5179960305 expref: 17 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779796.310103:0:7920:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000e3ee7153/0xc8fc0a517996039f lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779796.310152:0:7920:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000000b11bb6b/0xc8fc0a517996030c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc8fc0a5179960305 expref: 17 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779796.310165:0:7920:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000000b11bb6b/0xc8fc0a517996030c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc8fc0a5179960305 expref: 17 pid: 6506 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779796.310179:0:7920:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a2977635 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7920:1874622881478784:0@lo:104: 00000100:00100000:0.0:1787779796.310234:0:7920:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787779796.310291:0:7920:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000004a6c7bbe/0xc8fc0a517996021e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc8fc0a5179960217 expref: 17 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779796.310298:0:7920:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000004a6c7bbe/0xc8fc0a517996021e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc8fc0a5179960217 expref: 17 pid: 6507 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779796.310305:0:7920:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008817bb86 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7920:1874622881478912:0@lo:104: 00000100:00100000:0.0:1787779796.310329:0:7920:0:(client.c:2715:ptlrpc_set_wait()) set 00000000029c0487 going to sleep for 11 seconds 00000100:00100000:2.0:1787779796.310409:0:6495:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787779796.310430:0:6495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779796.310459:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881478784 00000100:00100000:2.0:1787779796.310466:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881478784 00000100:00100000:2.0:1787779796.310500:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881478912 00000100:00100000:2.0:1787779796.310502:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881478912 00000100:00100000:2.0:1787779796.310515:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787779796.310532:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b727a244 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1f575176-36bc-4786-83ee-2fea064a12a9+4:7920:x1874622881478784:12345-0@lo:104: 00010000:00010000:2.0:1787779796.310543:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: 00000000e3382dbd/0xc8fc0a5179960305 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc8fc0a517996030c expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779796.310794:0:7920:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a2977635 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7920:1874622881478784:0@lo:104: 00010000:00010000:2.0:1787779796.310829:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787779796.310835:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b727a244 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1f575176-36bc-4786-83ee-2fea064a12a9+4:7920:x1874622881478784:12345-0@lo:104: Request processed in 304us (601us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779796.310870:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787779796.310955:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787779796.310962:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000066f2b96c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1f575176-36bc-4786-83ee-2fea064a12a9+3:7920:x1874622881478912:12345-0@lo:104: 00010000:00010000:2.0:1787779796.310969:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: 00000000fa8eef2f/0xc8fc0a5179960217 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc8fc0a517996021e expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779796.311059:0:7920:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008817bb86 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7920:1874622881478912:0@lo:104: 00010000:00010000:0.0:1787779796.311076:0:7920:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000e3ee7153/0xc8fc0a517996039f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779796.311591:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787779796.311597:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: 00000000e3382dbd/0xc8fc0a5179960305 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc8fc0a517996030c expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779796.311605:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000e3382dbd already unused, calling callback (000000000bd3cb84) 10000000:00010000:3.0:1787779796.311607:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: 00000000e3382dbd/0xc8fc0a5179960305 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc8fc0a517996030c expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779796.311614:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: 00000000e3382dbd/0xc8fc0a5179960305 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc8fc0a517996030c expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787779796.311620:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: 00000000e3382dbd/0xc8fc0a5179960305 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc8fc0a517996030c expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787779796.311625:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787779796.311673:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: 00000000e3382dbd/0xc8fc0a5179960305 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a517996030c expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779796.311680:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787779796.311709:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: 00000000e3382dbd/0xc8fc0a5179960305 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a517996030c expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779796.311716:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: 00000000e3382dbd/0xc8fc0a5179960305 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a517996030c expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779796.311725:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e0c7e16c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1f575176-36bc-4786-83ee-2fea064a12a9:3644:1874622881479040:0@lo:103: 00010000:00010000:3.0:1787779796.311730:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787779796.311735:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: 00000000fa8eef2f/0xc8fc0a5179960217 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc8fc0a517996021e expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779796.311741:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000fa8eef2f already unused, calling callback (000000000bd3cb84) 10000000:00010000:3.0:1787779796.311751:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: 00000000fa8eef2f/0xc8fc0a5179960217 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc8fc0a517996021e expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779796.311758:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: 00000000fa8eef2f/0xc8fc0a5179960217 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc8fc0a517996021e expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779796.311765:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:00010000:3.0:1787779796.311771:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: 00000000fa8eef2f/0xc8fc0a5179960217 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc8fc0a517996021e expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787779796.311777:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787779796.311804:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: 00000000fa8eef2f/0xc8fc0a5179960217 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a517996021e expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779796.311811:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1787779796.311821:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881479040 00000100:00100000:1.0:1787779796.311826:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881479040 00010000:00010000:3.0:1787779796.311827:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: 00000000fa8eef2f/0xc8fc0a5179960217 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a517996021e expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779796.311835:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: 00000000fa8eef2f/0xc8fc0a5179960217 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a517996021e expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779796.311867:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787779796.311869:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787779796.311871:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787779796.311873:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000000b11bb6b/0xc8fc0a517996030c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc8fc0a5179960305 expref: 18 pid: 6506 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779796.311884:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000348d9ce6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1f575176-36bc-4786-83ee-2fea064a12a9:3641:1874622881479168:0@lo:103: 00000100:00100000:1.0:1787779796.311898:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787779796.311906:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b1994c35 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1f575176-36bc-4786-83ee-2fea064a12a9+18:3644:x1874622881479040:12345-0@lo:103: 00010000:00010000:1.0:1787779796.311916:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1787779796.311922:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787779796.311933:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000000b11bb6b/0xc8fc0a517996030c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc8fc0a5179960305 expref: 18 pid: 6506 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779796.311944:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000000b11bb6b/0xc8fc0a517996030c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc8fc0a5179960305 expref: 18 pid: 6506 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779796.311957:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000000b11bb6b/0xc8fc0a517996030c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc8fc0a5179960305 expref: 18 pid: 6506 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779796.311974:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787779796.311993:0:6499:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1787779796.312001:0:6499:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:1.0:1787779796.312002:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b1994c35 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1f575176-36bc-4786-83ee-2fea064a12a9+17:3644:x1874622881479040:12345-0@lo:103: Request processed in 97us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779796.312010:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787779796.312023:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881479168 00000100:00100000:1.0:1787779796.312026:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881479168 00010000:00010000:1.0:1787779796.312035:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000004a6c7bbe/0xc8fc0a517996021e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc8fc0a5179960217 expref: 17 pid: 6507 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779796.312045:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787779796.312050:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000084c3fb0d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1f575176-36bc-4786-83ee-2fea064a12a9+17:3641:x1874622881479168:12345-0@lo:103: 00010000:00010000:1.0:1787779796.312056:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787779796.312058:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000004a6c7bbe/0xc8fc0a517996021e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc8fc0a5179960217 expref: 17 pid: 6507 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779796.312066:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000004a6c7bbe/0xc8fc0a517996021e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc8fc0a5179960217 expref: 17 pid: 6507 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779796.312074:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000004a6c7bbe/0xc8fc0a517996021e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc8fc0a5179960217 expref: 17 pid: 6507 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779796.312084:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000e3ee7153/0xc8fc0a517996039f lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779796.312091:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e3ee7153/0xc8fc0a517996039f lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779796.312101:0:6497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000e3ee7153/0xc8fc0a517996039f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779796.312117:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000e3ee7153/0xc8fc0a517996039f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779796.312123:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000e3ee7153/0xc8fc0a517996039f lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779796.312140:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000e3ee7153/0xc8fc0a517996039f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779796.312146:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000e3ee7153 already unused, calling callback (000000008129b6a0) 00010000:00010000:1.0:1787779796.312150:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000e3ee7153/0xc8fc0a517996039f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779796.312156:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000e3ee7153/0xc8fc0a517996039f lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779796.312172:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000e3ee7153/0xc8fc0a517996039f lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779796.312193:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787779796.312224:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000084c3fb0d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1f575176-36bc-4786-83ee-2fea064a12a9+16:3641:x1874622881479168:12345-0@lo:103: Request processed in 174us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779796.312230:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787779796.312265:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e0c7e16c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1f575176-36bc-4786-83ee-2fea064a12a9:3644:1874622881479040:0@lo:103: 00000100:00100000:1.0:1787779796.312282:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000348d9ce6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1f575176-36bc-4786-83ee-2fea064a12a9:3641:1874622881479168:0@lo:103: 00010000:00010000:0.0:1787779796.312398:0:7920:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000e3ee7153/0xc8fc0a517996039f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779796.312407:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000e3ee7153/0xc8fc0a517996039f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779796.312413:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000e3ee7153/0xc8fc0a517996039f lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779796.313795:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:2.0:1787779796.313806:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000066f2b96c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1f575176-36bc-4786-83ee-2fea064a12a9+3:7920:x1874622881478912:12345-0@lo:104: Request processed in 2842us (3372us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779796.313816:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:3.0:1787779796.313912:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787779797.086465:0:6509:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787779797.086472:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c04764fa000 from 1 10000000:01000000:3.0:1787779797.086477:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787779797.086524:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: 00000000ae9b9d28/0xc8fc0a51799603a6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779797.086537:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: 00000000ae9b9d28/0xc8fc0a51799603a6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779797.086547:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: 00000000ae9b9d28/0xc8fc0a51799603a6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779797.086570:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001567d464 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881479296:0@lo:101: 00000100:00100000:3.0:1787779797.086644:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779797.086690:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b9a79dc6 going to sleep for 11 seconds 00010000:00010000:3.0:1787779797.086736:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787779797.086802:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881479296 00000100:00100000:1.0:1787779797.086808:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881479296 00000100:00100000:1.0:1787779797.086887:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787779797.086898:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c18463c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+16:6509:x1874622881479296:12345-0@lo:101: 00010000:00010000:1.0:1787779797.086917:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787779797.086929:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000184c5b7c/0xc8fc0a51799603ad lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc8fc0a51799603a6 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779797.086955:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000184c5b7c/0xc8fc0a51799603ad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc8fc0a51799603a6 expref: 17 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779797.086965:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000184c5b7c/0xc8fc0a51799603ad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a51799603a6 expref: 17 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779797.086973:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000184c5b7c, rc 0) 00000100:00100000:1.0:1787779797.087009:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c18463c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+17:6509:x1874622881479296:12345-0@lo:101: Request processed in 116us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779797.087016:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787779797.087165:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001567d464 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881479296:0@lo:101: 00010000:00010000:3.0:1787779797.087179:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: 00000000ae9b9d28/0xc8fc0a51799603a6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a51799603ad expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779797.087188:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: 00000000ae9b9d28/0xc8fc0a51799603a6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc8fc0a51799603ad expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779797.087242:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001567d464 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881479424:0@lo:501: 00000100:00100000:3.0:1787779797.087266:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779797.087288:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b9a79dc6 going to sleep for 11 seconds 00000100:00100000:1.0:1787779797.087724:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881479424 00000100:00100000:1.0:1787779797.087730:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881479424 00000100:00100000:1.0:1787779797.087761:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787779797.087767:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008c728bdb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+17:6509:x1874622881479424:12345-0@lo:501: 00000100:00100000:1.0:1787779797.087917:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008c728bdb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+17:6509:x1874622881479424:12345-0@lo:501: Request processed in 149us (650us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779797.087924:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787779797.089263:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001567d464 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881479424:0@lo:501: 00000100:00100000:3.0:1787779797.089308:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001567d464 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881479552:0@lo:503: 00000100:00100000:3.0:1787779797.089366:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779797.089400:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b9a79dc6 going to sleep for 11 seconds 00000100:00100000:2.0:1787779797.089463:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881479552 00000100:00100000:2.0:1787779797.089470:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881479552 00000100:00100000:2.0:1787779797.089513:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787779797.089520:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ad0ba229 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+17:6509:x1874622881479552:12345-0@lo:503: 00000100:00100000:2.0:1787779797.089613:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ad0ba229 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+17:6509:x1874622881479552:12345-0@lo:503: Request processed in 92us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779797.089621:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787779797.089709:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001567d464 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881479552:0@lo:503: 00000100:00100000:0.0:1787779797.091533:0:7945:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008817bb86 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f575176-36bc-4786-83ee-2fea064a12a9:7945:1874622881479680:0@lo:502: 00000100:00100000:0.0:1787779797.091599:0:7945:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779797.091638:0:7945:0:(client.c:2715:ptlrpc_set_wait()) set 000000008666aea0 going to sleep for 11 seconds 00000100:00100000:1.0:1787779797.100484:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881479680 00000100:00100000:1.0:1787779797.100498:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881479680 00000100:00100000:1.0:1787779797.100552:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787779797.100559:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fa2ae52f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+17:7945:x1874622881479680:12345-0@lo:502: 00000100:00100000:1.0:1787779797.100708:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fa2ae52f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+17:7945:x1874622881479680:12345-0@lo:502: Request processed in 149us (9110us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779797.100716:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787779797.101401:0:7945:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008817bb86 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f575176-36bc-4786-83ee-2fea064a12a9:7945:1874622881479680:0@lo:502: 00000020:01000000:0.0:1787779797.101435:0:7945:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787779797.101445:0:7945:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787779797.101447:0:7945:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787779797.101453:0:7945:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c04764fa000 00000020:00000080:0.0:1787779797.101456:0:7945:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787779797.101502:0:7945:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0461beda40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f575176-36bc-4786-83ee-2fea064a12a9:7945:1874622881479808:0@lo:502: 00000100:00100000:0.0:1787779797.101546:0:7945:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779797.101574:0:7945:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c046ee8f300 going to sleep for 11 seconds 00000100:00100000:3.0:1787779797.101658:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881479808 00000100:00100000:3.0:1787779797.101669:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881479808 00000100:00100000:3.0:1787779797.101703:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787779797.101710:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0442d59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+17:7945:x1874622881479808:12345-0@lo:502: 00000100:00100000:3.0:1787779797.101782:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0442d59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+17:7945:x1874622881479808:12345-0@lo:502: Request processed in 73us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779797.101790:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787779797.101995:0:7945:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0461beda40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f575176-36bc-4786-83ee-2fea064a12a9:7945:1874622881479808:0@lo:502: 00000020:01000000:0.0:1787779797.102014:0:7945:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787779797.102018:0:7945:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787779797.102020:0:7945:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1787779797.102023:0:7945:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:3.0:1787779797.104233:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1787779797.104266:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787779797.104277:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c04766dd600/0xc8fc0a51799603a6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a51799603ad expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779797.104289:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff9c04766dd600/0xc8fc0a51799603a6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a51799603ad expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787779797.104299:0:6509:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787779797.104302:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c044407a000 from 1 10000000:01000000:3.0:1787779797.104304:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787779797.104335:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c04766dc000/0xc8fc0a51799603b4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779797.104343:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff9c04766dc000/0xc8fc0a51799603b4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779797.104353:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff9c04766dc000/0xc8fc0a51799603b4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779797.104372:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477943840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881479936:0@lo:101: 00000100:00100000:3.0:1787779797.104427:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779797.104449:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c047782bc00 going to sleep for 11 seconds 00000100:00100000:3.0:1787779797.104470:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881479936 00000100:00100000:3.0:1787779797.104487:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881479936 00000100:00100000:3.0:1787779797.104524:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787779797.104531:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471775850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+17:6509:x1874622881479936:12345-0@lo:101: 00010000:00010000:3.0:1787779797.104543:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787779797.104555:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c04766ddc00/0xc8fc0a51799603bb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc8fc0a51799603b4 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779797.104576:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c04766ddc00/0xc8fc0a51799603bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc8fc0a51799603b4 expref: 18 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779797.104586:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c04766ddc00/0xc8fc0a51799603bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a51799603b4 expref: 18 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779797.104595:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c04766ddc00, rc 0) 00000100:00100000:3.0:1787779797.104626:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471775850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+18:6509:x1874622881479936:12345-0@lo:101: Request processed in 95us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779797.104633:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787779797.104670:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477943840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881479936:0@lo:101: 00010000:00010000:3.0:1787779797.104681:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff9c04766dc000/0xc8fc0a51799603b4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a51799603bb expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779797.104691:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff9c04766dc000/0xc8fc0a51799603b4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc8fc0a51799603bb expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779797.104737:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477943840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881480064:0@lo:501: 00000100:00100000:3.0:1787779797.104759:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779797.104775:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c047782bc00 going to sleep for 11 seconds 00000100:00100000:1.0:1787779797.107919:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881480064 00000100:00100000:1.0:1787779797.107935:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881480064 00000100:00100000:1.0:1787779797.107994:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787779797.108006:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471775050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+18:6509:x1874622881480064:12345-0@lo:501: 00000100:00100000:1.0:1787779797.108188:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471775050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+18:6509:x1874622881480064:12345-0@lo:501: Request processed in 185us (3426us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779797.108197:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787779797.108566:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477943840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881480064:0@lo:501: 00000100:00100000:3.0:1787779797.108631:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477943840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881480192:0@lo:503: 00000100:00100000:3.0:1787779797.108684:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779797.108722:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c047782bc00 going to sleep for 11 seconds 00000100:00100000:1.0:1787779797.109929:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881480192 00000100:00100000:1.0:1787779797.109939:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881480192 00000100:00100000:1.0:1787779797.109993:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787779797.110001:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471777050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+18:6509:x1874622881480192:12345-0@lo:503: 00000100:00100000:1.0:1787779797.110353:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471777050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+18:6509:x1874622881480192:12345-0@lo:503: Request processed in 350us (1666us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779797.110361:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787779797.110453:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477943840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881480192:0@lo:503: 00000100:00100000:3.0:1787779797.110788:0:7946:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477943840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f575176-36bc-4786-83ee-2fea064a12a9:7946:1874622881480320:0@lo:502: 00000100:00100000:3.0:1787779797.110860:0:7946:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779797.110896:0:7946:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c047782bcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787779797.111001:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881480320 00000100:00100000:1.0:1787779797.111005:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881480320 00000100:00100000:1.0:1787779797.111039:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787779797.111047:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471774850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+18:7946:x1874622881480320:12345-0@lo:502: 00000100:00100000:1.0:1787779797.111332:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471774850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+18:7946:x1874622881480320:12345-0@lo:502: Request processed in 285us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779797.111339:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787779797.113580:0:7946:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477943840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f575176-36bc-4786-83ee-2fea064a12a9:7946:1874622881480320:0@lo:502: 00000020:01000000:3.0:1787779797.113624:0:7946:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787779797.113637:0:7946:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787779797.113639:0:7946:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787779797.113646:0:7946:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c044407a000 00000020:00000080:3.0:1787779797.113649:0:7946:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787779797.113687:0:7946:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477943840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f575176-36bc-4786-83ee-2fea064a12a9:7946:1874622881480448:0@lo:502: 00000100:00100000:3.0:1787779797.113757:0:7946:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779797.113909:0:7946:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c047782bcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787779797.114019:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881480448 00000100:00100000:1.0:1787779797.114026:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881480448 00000100:00100000:1.0:1787779797.114074:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787779797.114083:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471777450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+18:7946:x1874622881480448:12345-0@lo:502: 00000100:00100000:1.0:1787779797.114434:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471777450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+18:7946:x1874622881480448:12345-0@lo:502: Request processed in 350us (676us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779797.114453:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787779797.114533:0:7946:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477943840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f575176-36bc-4786-83ee-2fea064a12a9:7946:1874622881480448:0@lo:502: 00000020:01000000:3.0:1787779797.114555:0:7946:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787779797.114562:0:7946:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787779797.114564:0:7946:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1787779797.114567:0:7946:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:1.0:1787779797.114728:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1787779797.114747:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787779797.114757:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c04766dc000/0xc8fc0a51799603b4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a51799603bb expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779797.114768:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff9c04766dc000/0xc8fc0a51799603b4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a51799603bb expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779798.108047:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787779798.813327:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787779798.813353:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0461955680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881480576:0@lo:41: 00000100:00100000:1.0:1787779798.813418:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779798.813549:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881480576 00000100:00100000:2.0:1787779798.813557:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881480576 00000100:00100000:2.0:1787779798.813605:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787779798.813614:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04618e8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881480576:12345-0@lo:41: 00000004:00000024:2.0:1787779798.813658:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:2.0:1787779798.813714:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04618e8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881480576:12345-0@lo:41: Request processed in 100us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779798.813721:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787779798.813801:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0461955680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881480576:0@lo:41: 00010000:00010000:3.0:1787779799.131944:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787779799.324100:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0461956940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881480704:0@lo:41: 00000100:00100000:1.0:1787779799.324178:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779799.326881:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047798b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874622881481216:0@lo:400: 00000100:00100000:1.0:1787779799.326946:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779799.326992:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787779799.326999:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04618e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1f575176-36bc-4786-83ee-2fea064a12a9:3643:1874622881480832:0@lo:400: 00000100:00100000:1.0:1787779799.327027:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779799.327055:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0458b89680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874622881480960:0@lo:400: 00000100:00100000:1.0:1787779799.327078:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779799.327096:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787779799.327100:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047798a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881481088:0@lo:400: 00000100:00100000:1.0:1787779799.327136:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779799.327165:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881480832 00000100:00100000:1.0:1787779799.327178:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881480832 00000100:00100000:1.0:1787779799.327224:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787779799.327232:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471776850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+18:3643:x1874622881480832:12345-0@lo:400: 00000100:00100000:1.0:1787779799.327283:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471776850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+18:3643:x1874622881480832:12345-0@lo:400: Request processed in 52us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779799.327290:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787779799.327322:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881481216 00000100:00100000:1.0:1787779799.327326:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881481216 00000100:00100000:2.0:1787779799.327453:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881480704 00000100:00100000:2.0:1787779799.327472:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881480704 00000100:00100000:2.0:1787779799.327494:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881481088 00000100:00100000:2.0:1787779799.327497:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881481088 00000100:00100000:2.0:1787779799.327509:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787779799.327516:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04618ea580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881480704:12345-0@lo:41: 00000004:00000024:2.0:1787779799.327543:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:2.0:1787779799.327588:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04618ea580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881480704:12345-0@lo:41: Request processed in 72us (3410us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779799.327594:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787779799.327610:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787779799.327617:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477988f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881481088:12345-0@lo:400: 00000100:00100000:2.0:1787779799.327665:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477988f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881481088:12345-0@lo:400: Request processed in 49us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779799.327671:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787779799.327714:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047798a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881481088:0@lo:400: 00000100:00100000:3.0:1787779799.329508:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881480960 00000100:00100000:3.0:1787779799.329520:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881480960 00000100:00100000:1.0:1787779799.329548:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787779799.329562:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477989680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1874622881481216:12345-0@lo:400: 00000100:00100000:3.0:1787779799.329574:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787779799.329584:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04779883c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874622881480960:12345-0@lo:400: 00000100:00100000:3.0:1787779799.329660:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04779883c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874622881480960:12345-0@lo:400: Request processed in 78us (2581us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779799.329670:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1787779799.329736:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c0458b89680 x1874622881480960/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779815 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787779799.329750:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0458b89680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874622881480960:0@lo:400: 00000100:00100000:2.0:1787779799.330080:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04618e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1f575176-36bc-4786-83ee-2fea064a12a9:3643:1874622881480832:0@lo:400: 00010000:00080000:2.0:1787779799.330102:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c047798b840 x1874622881481216/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779815 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787779799.330130:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047798b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874622881481216:0@lo:400: 00000100:00100000:2.0:1787779799.330153:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0461956940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881480704:0@lo:41: 00000100:00100000:1.0:1787779799.330212:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477989680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1874622881481216:12345-0@lo:400: Request processed in 653us (3264us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779799.330218:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:2.0:1787779800.158693:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787779801.179953:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787779802.204962:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787779803.234216:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787779803.932532:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04619561c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881481344:0@lo:41: 00000100:00100000:2.0:1787779803.932603:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779803.932675:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881481344 00000100:00100000:2.0:1787779803.932682:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881481344 00000100:00100000:2.0:1787779803.932720:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787779803.932728:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0461956940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881481344:12345-0@lo:41: 00000004:00000024:2.0:1787779803.932759:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:2.0:1787779803.932799:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0461956940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881481344:12345-0@lo:41: Request processed in 71us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779803.932806:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787779803.932862:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04619561c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881481344:0@lo:41: 00010000:00010000:0.0:1787779804.252070:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787779804.444760:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477988000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1f575176-36bc-4786-83ee-2fea064a12a9:3641:1874622881481472:0@lo:400: 00000100:00100000:2.0:1787779804.444829:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779804.444965:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04779892c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881481984:0@lo:400: 00000100:00100000:2.0:1787779804.444994:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779804.445021:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787779804.445028:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047798ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874622881481600:0@lo:400: 00000100:00100000:1.0:1787779804.445223:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047798b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874622881481856:0@lo:400: 00000100:00100000:1.0:1787779804.445253:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779804.445274:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787779804.445280:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047798a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881481728:0@lo:400: 00000100:00100000:1.0:1787779804.445301:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779804.445344:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881481472 00000100:00100000:1.0:1787779804.445350:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881481472 00000100:00100000:1.0:1787779804.445391:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787779804.445401:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471777c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+18:3641:x1874622881481472:12345-0@lo:400: 00000100:00100000:1.0:1787779804.445445:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471777c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+18:3641:x1874622881481472:12345-0@lo:400: Request processed in 45us (616us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779804.445451:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787779804.445490:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881481984 00000100:00100000:1.0:1787779804.445504:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881481984 00000100:00100000:1.0:1787779804.445524:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881481728 00000100:00100000:1.0:1787779804.445527:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881481728 00000100:00100000:1.0:1787779804.445540:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787779804.445545:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04619561c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874622881481984:12345-0@lo:400: 00000100:00100000:1.0:1787779804.445579:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04619561c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874622881481984:12345-0@lo:400: Request processed in 34us (585us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779804.445585:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787779804.445596:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787779804.445601:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477989e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881481728:12345-0@lo:400: 00000100:00100000:1.0:1787779804.445632:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477989e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881481728:12345-0@lo:400: Request processed in 30us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779804.445637:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787779804.445668:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047798a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881481728:0@lo:400: 00000100:00100000:2.0:1787779804.445719:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779804.445751:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477988000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1f575176-36bc-4786-83ee-2fea064a12a9:3641:1874622881481472:0@lo:400: 00000100:00100000:2.0:1787779804.445760:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04779892c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881481984:0@lo:400: 00000100:00100000:2.0:1787779804.445777:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787779804.445786:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477988b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881482112:0@lo:41: 00000100:00100000:2.0:1787779804.445809:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779804.445858:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881482112 00000100:00100000:2.0:1787779804.445863:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881482112 00000100:00100000:2.0:1787779804.445883:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787779804.446002:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881481856 00000100:00100000:3.0:1787779804.446006:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881481856 00000100:00100000:3.0:1787779804.446034:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881481600 00000100:00100000:3.0:1787779804.446037:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881481600 00000100:00100000:3.0:1787779804.446054:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787779804.446060:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c047798bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1874622881481856:12345-0@lo:400: 00000100:00100000:3.0:1787779804.446114:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c047798bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1874622881481856:12345-0@lo:400: Request processed in 54us (860us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779804.446121:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787779804.446133:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787779804.446139:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0461955680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874622881481600:12345-0@lo:400: 00000100:00100000:3.0:1787779804.446171:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0461955680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874622881481600:12345-0@lo:400: Request processed in 32us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779804.446177:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1787779804.446211:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c047798b0c0 x1874622881481856/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779820 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779804.446223:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047798b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874622881481856:0@lo:400: 00010000:00080000:3.0:1787779804.446246:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c047798ad00 x1874622881481600/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779820 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779804.446254:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047798ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874622881481600:0@lo:400: 00000100:00100000:2.0:1787779804.446603:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0461957480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874622881482112:12345-0@lo:41: 00000004:00000024:2.0:1787779804.446628:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:2.0:1787779804.446674:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0461957480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874622881482112:12345-0@lo:41: Request processed in 76us (863us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779804.446681:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787779804.447803:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477988b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881482112:0@lo:41: 00010000:00010000:3.0:1787779805.275997:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787779805.628684:0:8421:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787779805.628692:0:8421:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:3.0:1787779805.628694:0:8421:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1787779805.628819:0:8421:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9c046ecd6000 00000020:01000004:3.0:1787779805.628834:0:8421:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1787779805.628882:0:8421:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1787779805.628895:0:8421:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9c0450cecd28) 00000020:00000080:3.0:1787779805.628911:0:8421:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1787779805.671278:0:8421:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1787779805.672190:0:8421:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00080000:01000000:2.0:1787779805.703230:0:8421:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1787779805.704632:0:8421:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1787779805.704645:0:8421:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787779805.704655:0:8421:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xc8fc0a51799603c9 00000020:01000004:2.0:1787779805.704662:0:8421:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:2.0:1787779805.704683:0:8421:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.131@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787779805.704686:0:8421:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.131@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787779805.704693:0:8421:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1787779805.704698:0:8421:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1787779805.704711:0:8421:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9c04431399b8) 00000020:00000080:2.0:1787779805.704720:0:8421:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type ost with refcount 2 00000100:00100000:2.0:1787779805.708137:0:8421:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787779805.708325:0:8421:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1787779805.708331:0:8421:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1787779805.711958:0:8421:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1787779805.711970:0:8421:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1787779805.717074:0:8421:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1787779805.717090:0:8421:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1787779805.723239:0:8421:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787779805.723608:0:8421:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1787779805.723615:0:8421:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1787779805.724962:0:8421:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1787779805.724972:0:8421:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1787779805.757142:0:8421:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787779805.757386:0:8421:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1787779805.757392:0:8421:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1787779805.759692:0:8421:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1787779805.759705:0:8421:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1787779805.760605:0:8421:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1787779805.760613:0:8421:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1787779805.764677:0:8421:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787779805.764903:0:8421:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1787779805.764910:0:8421:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1787779805.765725:0:8421:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1787779805.765734:0:8421:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1787779805.807761:0:8421:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787779805.807971:0:8421:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1787779805.807977:0:8421:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1787779805.808998:0:8421:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1787779805.809006:0:8421:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1787779805.809442:0:8421:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1787779805.809471:0:8421:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:1.0:1787779805.809476:0:8421:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.131@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1787779805.843997:0:8421:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.131@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787779805.844035:0:8421:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.131@tcp, index=0000, flags=0x20062 00000020:01000004:1.0:1787779805.844039:0:8421:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787779805.844041:0:8421:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787779805.844043:0:8421:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787779805.844044:0:8421:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787779805.844045:0:8421:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787779805.844046:0:8421:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787779805.844047:0:8421:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787779805.844048:0:8421:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787779805.844050:0:8421:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787779805.844056:0:8421:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787779805.844057:0:8421:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787779805.844059:0:8421:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:1.0:1787779805.844072:0:8421:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787779805.844073:0:8421:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787779805.844074:0:8421:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787779805.844075:0:8421:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787779805.844076:0:8421:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787779805.844077:0:8421:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787779805.844077:0:8421:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787779805.844078:0:8421:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787779805.844079:0:8421:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787779805.844080:0:8421:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787779805.844081:0:8421:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787779805.844105:0:8421:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1787779805.844551:0:8421:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477989a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:8421:1874622881482240:0@lo:253: 00000100:00100000:1.0:1787779805.846613:0:8421:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779805.846691:0:8421:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0341cb9000 going to sleep for 11 seconds 00000100:00100000:3.0:1787779805.846702:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881482240 00000100:00100000:3.0:1787779805.846712:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881482240 00000100:00100000:3.0:1787779805.846769:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787779805.846779:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471776c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+18:8421:x1874622881482240:12345-0@lo:253: 20000000:01000000:3.0:1787779805.846819:0:6507:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1787779805.846823:0:6507:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:3.0:1787779805.846829:0:6507:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:3.0:1787779805.846832:0:6507:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:3.0:1787779805.847108:0:6507:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787779805.847262:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:3.0:1787779805.847275:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:3.0:1787779805.847305:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:3.0:1787779805.847311:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:3.0:1787779805.847324:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:3.0:1787779805.847352:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:3.0:1787779805.847439:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:3.0:1787779805.847454:0:6507:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.131@tcp 20000000:01000000:3.0:1787779805.847457:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.131@tcp (null) (null) (null) 00000040:00080000:3.0:1787779805.847472:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:3.0:1787779805.847478:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1787779805.847502:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:3.0:1787779805.847509:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.203.131@tcp (null) (null) 00000040:00080000:3.0:1787779805.847523:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:3.0:1787779805.847530:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1787779805.847543:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:3.0:1787779805.847558:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:3.0:1787779805.847639:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].25, 224 off12680 20000000:01000000:3.0:1787779805.847650:0:6507:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.131@tcp 20000000:01000000:3.0:1787779805.847652:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.131@tcp (null) (null) (null) 00000040:00080000:3.0:1787779805.847667:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].26, 88 off12768 20000000:01000000:3.0:1787779805.847672:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1787779805.847685:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].27, 144 off12912 20000000:01000000:3.0:1787779805.847690:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf003 lustre-OST0000_UUID 192.168.203.131@tcp (null) (null) 00000040:00080000:3.0:1787779805.847703:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].28, 152 off13064 20000000:01000000:3.0:1787779805.847709:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1787779805.847721:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].29, 136 off13200 00000040:00080000:3.0:1787779805.847735:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].30, 224 off13424 00000040:00080000:3.0:1787779805.848137:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13448 20000000:01000000:3.0:1787779805.848149:0:6507:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.131@tcp 20000000:01000000:3.0:1787779805.848151:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.131@tcp (null) (null) (null) 00000040:00080000:3.0:1787779805.848166:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13536 20000000:01000000:3.0:1787779805.848172:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1787779805.848186:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13664 20000000:01000000:3.0:1787779805.848191:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.203.131@tcp (null) (null) 00000040:00080000:3.0:1787779805.848218:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13808 20000000:01000000:3.0:1787779805.848225:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1787779805.848238:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13936 00000040:00080000:3.0:1787779805.848252:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14160 20000000:01000000:3.0:1787779805.848265:0:6507:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1787779805.848268:0:6507:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1787779805.848276:0:6507:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1787779805.848326:0:6507:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:3.0:1787779805.848329:0:6507:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:3.0:1787779805.857032:0:8440:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 18 1->4: lustre sys.timeout 20000000:01000000:3.0:1787779805.857104:0:8440:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 18 2->4: lustre sys.timeout 00000040:00080000:3.0:1787779805.857125:0:8440:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 31 count 31 00000040:00080000:2.0:1787779805.857510:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].31, 224 off13648 00000040:00080000:2.0:1787779805.857536:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].32, 80 off13728 00000040:00080000:2.0:1787779805.857552:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].33, 224 off13952 20000000:01000000:2.0:1787779805.857563:0:6507:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1787779805.857566:0:6507:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787779805.858078:0:8441:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 19 1->4: lustre sys.timeout 20000000:01000000:2.0:1787779805.858111:0:8441:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 19 2->4: lustre sys.timeout 00000040:00080000:2.0:1787779805.858213:0:8441:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:3.0:1787779805.858465:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14384 00000040:00080000:3.0:1787779805.858487:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14464 00000040:00080000:3.0:1787779805.858503:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14688 20000000:01000000:3.0:1787779805.858512:0:6507:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1787779805.858514:0:6507:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1787779805.859004:0:8442:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:2.0:1787779805.859192:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:2.0:1787779805.859214:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:2.0:1787779805.859231:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:2.0:1787779805.859243:0:6507:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1787779805.859245:0:6507:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1787779805.859595:0:8443:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 20 1->4: lustre sys.timeout 20000000:01000000:1.0:1787779805.859629:0:8443:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 20 2->4: lustre sys.timeout 00000040:00080000:1.0:1787779805.859645:0:8443:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:2.0:1787779805.859800:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:2.0:1787779805.859819:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:2.0:1787779805.859934:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 10000000:01000000:2.0:1787779805.859951:0:6507:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1787779805.859976:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c04413c8000/0xc8fc0a51799603d7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779805.859993:0:6507:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c04766dcc00/0xc8fc0a51799602a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a517996029c expref: 18 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779805.860002:0:6507:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c04766dd000/0xc8fc0a517996031a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a5179960313 expref: 18 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779805.860008:0:6507:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c044148be00/0xc8fc0a5179960352 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a517996034b expref: 18 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779805.860015:0:6507:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c044148ba00/0xc8fc0a517996036e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a5179960367 expref: 18 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779805.860022:0:6507:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c0440031a00/0xc8fc0a5179960398 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a5179960391 expref: 18 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779805.860029:0:6507:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c04413c8000/0xc8fc0a51799603d7 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779805.860079:0:6507:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c0440031a00/0xc8fc0a5179960398 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc8fc0a5179960391 expref: 18 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779805.860093:0:6507:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c0440031a00/0xc8fc0a5179960398 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc8fc0a5179960391 expref: 18 pid: 6505 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779805.860106:0:6507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04618e8f00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6507:1874622881482368:0@lo:104: 00000100:00100000:2.0:1787779805.860248:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787779805.860342:0:6507:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c044148ba00/0xc8fc0a517996036e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc8fc0a5179960367 expref: 18 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779805.860360:0:6507:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c044148ba00/0xc8fc0a517996036e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc8fc0a5179960367 expref: 18 pid: 6507 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779805.860370:0:6507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0458b89680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6507:1874622881482496:0@lo:104: 00000100:00100000:2.0:1787779805.860393:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787779805.860523:0:6507:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c044148be00/0xc8fc0a5179960352 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc8fc0a517996034b expref: 18 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779805.860531:0:6507:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c044148be00/0xc8fc0a5179960352 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc8fc0a517996034b expref: 18 pid: 6507 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779805.860539:0:6507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c046215e580 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6507:1874622881482624:0@lo:104: 00000100:00100000:2.0:1787779805.860559:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779805.860626:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881482368 00000100:00100000:3.0:1787779805.860633:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881482368 00000100:00100000:3.0:1787779805.860666:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881482496 00000100:00100000:3.0:1787779805.860669:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881482496 00000100:00100000:3.0:1787779805.860683:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787779805.860691:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04618e9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1f575176-36bc-4786-83ee-2fea064a12a9+4:6507:x1874622881482368:12345-0@lo:104: 00010000:00010000:3.0:1787779805.860705:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff9c04766dc400/0xc8fc0a5179960391 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc8fc0a5179960398 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779805.860768:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787779805.860774:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04618e9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1f575176-36bc-4786-83ee-2fea064a12a9+4:6507:x1874622881482368:12345-0@lo:104: Request processed in 84us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779805.860782:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787779805.860800:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787779805.860807:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046215de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1f575176-36bc-4786-83ee-2fea064a12a9+3:6507:x1874622881482496:12345-0@lo:104: 00010000:00010000:3.0:1787779805.860813:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff9c04766dde00/0xc8fc0a5179960367 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc8fc0a517996036e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779805.860870:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787779805.860881:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046215de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1f575176-36bc-4786-83ee-2fea064a12a9+3:6507:x1874622881482496:12345-0@lo:104: Request processed in 75us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779805.860887:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:1.0:1787779805.860968:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787779805.860975:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff9c04766dc400/0xc8fc0a5179960391 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc8fc0a5179960398 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779805.860982:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c04766dc400 already unused, calling callback (ffffffffc139ac20) 10000000:00010000:1.0:1787779805.860986:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff9c04766dc400/0xc8fc0a5179960391 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xc8fc0a5179960398 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779805.860995:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff9c04766dc400/0xc8fc0a5179960391 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xc8fc0a5179960398 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787779805.861001:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff9c04766dc400/0xc8fc0a5179960391 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xc8fc0a5179960398 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787779805.861019:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787779805.861048:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff9c04766dc400/0xc8fc0a5179960391 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a5179960398 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779805.861054:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787779805.861086:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff9c04766dc400/0xc8fc0a5179960391 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a5179960398 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779805.861094:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff9c04766dc400/0xc8fc0a5179960391 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a5179960398 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779805.861108:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787779805.861111:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff9c04766dde00/0xc8fc0a5179960367 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc8fc0a517996036e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779805.861210:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c04766dde00 already unused, calling callback (ffffffffc139ac20) 10000000:00010000:1.0:1787779805.861213:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff9c04766dde00/0xc8fc0a5179960367 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xc8fc0a517996036e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779805.861220:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff9c04766dde00/0xc8fc0a5179960367 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xc8fc0a517996036e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787779805.861226:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff9c04766dde00/0xc8fc0a5179960367 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xc8fc0a517996036e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787779805.861232:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787779805.861247:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff9c04766dde00/0xc8fc0a5179960367 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a517996036e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779805.861254:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787779805.861270:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff9c04766dde00/0xc8fc0a5179960367 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a517996036e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779805.861276:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff9c04766dde00/0xc8fc0a5179960367 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a517996036e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779805.861286:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787779805.861287:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787779805.861289:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787779805.861318:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047798b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1f575176-36bc-4786-83ee-2fea064a12a9:3643:1874622881482752:0@lo:103: 00000100:00100000:1.0:1787779805.861349:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779805.861388:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787779805.861394:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477988780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1f575176-36bc-4786-83ee-2fea064a12a9:3643:1874622881482880:0@lo:103: 00000100:00100000:1.0:1787779805.861414:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779805.861444:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881482752 00000100:00100000:1.0:1787779805.861448:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881482752 00010000:00010000:1.0:1787779805.861467:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c0440031a00/0xc8fc0a5179960398 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc8fc0a5179960391 expref: 19 pid: 6505 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779805.861487:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881482880 00000100:00100000:1.0:1787779805.861490:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881482880 00010000:00010000:1.0:1787779805.861501:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c044148ba00/0xc8fc0a517996036e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc8fc0a5179960367 expref: 20 pid: 6507 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779805.861518:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787779805.861524:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c047798a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1f575176-36bc-4786-83ee-2fea064a12a9+20:3643:x1874622881482752:12345-0@lo:103: 00010000:00010000:1.0:1787779805.861535:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787779805.861539:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c0440031a00/0xc8fc0a5179960398 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc8fc0a5179960391 expref: 20 pid: 6505 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779805.861559:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c0440031a00/0xc8fc0a5179960398 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc8fc0a5179960391 expref: 20 pid: 6505 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779805.861576:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787779805.861611:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c047798a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1f575176-36bc-4786-83ee-2fea064a12a9+20:3643:x1874622881482752:12345-0@lo:103: Request processed in 86us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779805.861617:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787779805.861666:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787779805.861674:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c047798b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1f575176-36bc-4786-83ee-2fea064a12a9+20:3643:x1874622881482880:12345-0@lo:103: 00010000:00010000:3.0:1787779805.861683:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787779805.861688:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c044148ba00/0xc8fc0a517996036e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc8fc0a5179960367 expref: 20 pid: 6507 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779805.861696:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c044148ba00/0xc8fc0a517996036e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc8fc0a5179960367 expref: 20 pid: 6507 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779805.861705:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787779805.861729:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c047798b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1f575176-36bc-4786-83ee-2fea064a12a9+20:3643:x1874622881482880:12345-0@lo:103: Request processed in 57us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779805.861735:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787779805.861928:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477988780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1f575176-36bc-4786-83ee-2fea064a12a9:3643:1874622881482880:0@lo:103: 00000100:00100000:1.0:1787779805.861938:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047798b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1f575176-36bc-4786-83ee-2fea064a12a9:3643:1874622881482752:0@lo:103: 00010000:00010000:2.0:1787779805.862233:0:6507:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c04766dd000/0xc8fc0a517996031a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc8fc0a5179960313 expref: 18 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779805.862244:0:6507:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c04766dd000/0xc8fc0a517996031a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc8fc0a5179960313 expref: 18 pid: 6505 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779805.862254:0:6507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c046215f840 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6507:1874622881483008:0@lo:104: 00000100:00100000:2.0:1787779805.862294:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787779805.862407:0:6507:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c04766dcc00/0xc8fc0a51799602a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc8fc0a517996029c expref: 18 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779805.862416:0:6507:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c04766dcc00/0xc8fc0a51799602a3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc8fc0a517996029c expref: 18 pid: 6506 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779805.862425:0:6507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0345e761c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6507:1874622881483136:0@lo:104: 00000100:00100000:2.0:1787779805.862451:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779805.862462:0:6507:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0443648600 going to sleep for 11 seconds 00010000:00010000:2.0:1787779805.862475:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c0440031a00/0xc8fc0a5179960398 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc8fc0a5179960391 expref: 18 pid: 6505 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779805.862486:0:6507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04618e8f00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6507:1874622881482368:0@lo:104: 00010000:00010000:2.0:1787779805.862496:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c044148ba00/0xc8fc0a517996036e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc8fc0a5179960367 expref: 17 pid: 6507 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779805.862505:0:6507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0458b89680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6507:1874622881482496:0@lo:104: 00000100:00100000:0.0:1787779805.862511:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881482624 00000100:00100000:0.0:1787779805.862518:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881482624 00000100:00100000:3.0:1787779805.862538:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881483008 00000100:00100000:3.0:1787779805.862544:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881483008 00000100:00100000:0.0:1787779805.862577:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881483136 00000100:00100000:0.0:1787779805.862583:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881483136 00000100:00100000:3.0:1787779805.862584:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787779805.862594:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046215e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1f575176-36bc-4786-83ee-2fea064a12a9+5:6507:x1874622881482624:12345-0@lo:104: 00010000:00010000:3.0:1787779805.862604:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff9c04766dc200/0xc8fc0a517996034b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc8fc0a5179960352 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779805.862608:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787779805.862703:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787779805.862712:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046215e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1f575176-36bc-4786-83ee-2fea064a12a9+5:6507:x1874622881482624:12345-0@lo:104: Request processed in 118us (2150us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779805.862718:0:6507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c046215e580 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6507:1874622881482624:0@lo:104: 00000100:00100000:0.0:1787779805.862723:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787779805.862758:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00010000:00010000:3.0:1787779805.862761:0:7453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1787779805.862767:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0345e76d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1f575176-36bc-4786-83ee-2fea064a12a9+4:6507:x1874622881483008:12345-0@lo:104: 00010000:00010000:3.0:1787779805.862769:0:7453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff9c04766dc200/0xc8fc0a517996034b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc8fc0a5179960352 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779805.862779:0:7453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c04766dc200 already unused, calling callback (ffffffffc139ac20) 00010000:00010000:0.0:1787779805.862779:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff9c044148a200/0xc8fc0a5179960313 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc8fc0a517996031a expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787779805.862786:0:7453:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff9c04766dc200/0xc8fc0a517996034b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xc8fc0a5179960352 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779805.862803:0:7453:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff9c04766dc200/0xc8fc0a517996034b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc8fc0a5179960352 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787779805.862810:0:7453:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff9c04766dc200/0xc8fc0a517996034b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc8fc0a5179960352 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787779805.862816:0:7453:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787779805.862835:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787779805.862880:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0345e76d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1f575176-36bc-4786-83ee-2fea064a12a9+4:6507:x1874622881483008:12345-0@lo:104: Request processed in 105us (576us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779805.862887:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787779805.862906:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787779805.862914:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0345e770c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1f575176-36bc-4786-83ee-2fea064a12a9+3:6507:x1874622881483136:12345-0@lo:104: 00000100:00100000:2.0:1787779805.862923:0:6507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c046215f840 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6507:1874622881483008:0@lo:104: 00010000:00010000:0.0:1787779805.862924:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff9c04427dae00/0xc8fc0a517996029c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc8fc0a51799602a3 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779805.862989:0:7453:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff9c04766dc200/0xc8fc0a517996034b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a5179960352 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779805.862996:0:7453:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787779805.862998:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787779805.863005:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0345e770c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1f575176-36bc-4786-83ee-2fea064a12a9+3:6507:x1874622881483136:12345-0@lo:104: Request processed in 92us (553us total) trans 0 rc 0/0 00010000:00010000:3.0:1787779805.863013:0:7453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff9c04766dc200/0xc8fc0a517996034b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a5179960352 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779805.863014:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:3.0:1787779805.863022:0:7453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff9c04766dc200/0xc8fc0a517996034b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a5179960352 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779805.863038:0:7453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787779805.863041:0:7453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff9c044148a200/0xc8fc0a5179960313 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc8fc0a517996031a expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779805.863047:0:7453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c044148a200 already unused, calling callback (ffffffffc139ac20) 10000000:00010000:3.0:1787779805.863049:0:7453:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff9c044148a200/0xc8fc0a5179960313 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc8fc0a517996031a expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779805.863055:0:7453:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff9c044148a200/0xc8fc0a5179960313 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc8fc0a517996031a expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787779805.863075:0:7453:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff9c044148a200/0xc8fc0a5179960313 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc8fc0a517996031a expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787779805.863087:0:7453:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1787779805.863129:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477942580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1f575176-36bc-4786-83ee-2fea064a12a9:3641:1874622881483264:0@lo:103: 00000100:00100000:2.0:1787779805.863157:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779805.863220:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881483264 00000100:00100000:2.0:1787779805.863224:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881483264 00010000:00010000:2.0:1787779805.863240:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c044148be00/0xc8fc0a5179960352 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc8fc0a517996034b expref: 17 pid: 6507 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779805.863261:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787779805.863267:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0345e752c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1f575176-36bc-4786-83ee-2fea064a12a9+17:3641:x1874622881483264:12345-0@lo:103: 00010000:00010000:2.0:1787779805.863275:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787779805.863279:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c044148be00/0xc8fc0a5179960352 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc8fc0a517996034b expref: 17 pid: 6507 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779805.863289:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c044148be00/0xc8fc0a5179960352 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc8fc0a517996034b expref: 17 pid: 6507 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779805.863322:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c044148be00/0xc8fc0a5179960352 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc8fc0a517996034b expref: 17 pid: 6507 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779805.863334:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787779805.863362:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0345e752c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1f575176-36bc-4786-83ee-2fea064a12a9+16:3641:x1874622881483264:12345-0@lo:103: Request processed in 95us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779805.863368:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787779805.863391:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477942580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1f575176-36bc-4786-83ee-2fea064a12a9:3641:1874622881483264:0@lo:103: 00000100:00100000:2.0:1787779805.863413:0:6507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0345e761c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6507:1874622881483136:0@lo:104: 00010000:00010000:2.0:1787779805.863438:0:6507:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c04413c8000/0xc8fc0a51799603d7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779805.864001:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787779805.864009:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff9c04427dae00/0xc8fc0a517996029c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc8fc0a51799602a3 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779805.864018:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c04427dae00 already unused, calling callback (ffffffffc139ac20) 10000000:00010000:0.0:1787779805.864022:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff9c04427dae00/0xc8fc0a517996029c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc8fc0a51799602a3 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779805.864031:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff9c04427dae00/0xc8fc0a517996029c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc8fc0a51799602a3 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787779805.864038:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff9c04427dae00/0xc8fc0a517996029c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc8fc0a51799602a3 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787779805.864044:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787779805.864888:0:7453:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff9c044148a200/0xc8fc0a5179960313 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a517996031a expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779805.864888:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff9c04427dae00/0xc8fc0a517996029c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a51799602a3 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779805.864908:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787779805.864912:0:7453:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787779805.864931:0:7453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff9c044148a200/0xc8fc0a5179960313 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a517996031a expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779805.864938:0:7453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff9c044148a200/0xc8fc0a5179960313 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a517996031a expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779805.864951:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787779805.864953:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787779805.864954:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787779805.865003:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0461beed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1f575176-36bc-4786-83ee-2fea064a12a9:3642:1874622881483392:0@lo:103: 00010000:00010000:0.0:1787779805.865054:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff9c04427dae00/0xc8fc0a517996029c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a51799602a3 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779805.865073:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787779805.865076:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff9c04427dae00/0xc8fc0a517996029c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a51799602a3 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779805.865144:0:7921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881483392 00000100:00100000:3.0:1787779805.865150:0:7921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881483392 00010000:00010000:3.0:1787779805.865177:0:7921:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c04766dcc00/0xc8fc0a51799602a3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc8fc0a517996029c expref: 16 pid: 6506 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779805.865206:0:7921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787779805.865215:0:7921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0345e761c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1f575176-36bc-4786-83ee-2fea064a12a9+16:3642:x1874622881483392:12345-0@lo:103: 00010000:00010000:3.0:1787779805.865226:0:7921:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787779805.865231:0:7921:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c04766dcc00/0xc8fc0a51799602a3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc8fc0a517996029c expref: 16 pid: 6506 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779805.865240:0:7921:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c04766dcc00/0xc8fc0a51799602a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc8fc0a517996029c expref: 16 pid: 6506 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779805.865253:0:7921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c04766dcc00/0xc8fc0a51799602a3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc8fc0a517996029c expref: 16 pid: 6506 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779805.865881:0:7921:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787779805.865958:0:7921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0345e761c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1f575176-36bc-4786-83ee-2fea064a12a9+15:3642:x1874622881483392:12345-0@lo:103: Request processed in 742us (896us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779805.865967:0:7921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:2.0:1787779805.865990:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787779805.866031:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0461beed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1f575176-36bc-4786-83ee-2fea064a12a9:3642:1874622881483392:0@lo:103: 00010000:00010000:0.0:1787779805.866103:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787779805.866194:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787779805.866206:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477941a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1f575176-36bc-4786-83ee-2fea064a12a9:3644:1874622881483520:0@lo:103: 00010000:00010000:0.0:1787779805.866554:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787779805.866558:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787779805.866623:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779805.866730:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881483520 00000100:00100000:2.0:1787779805.866736:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881483520 00010000:00010000:2.0:1787779805.866759:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c04766dd000/0xc8fc0a517996031a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc8fc0a5179960313 expref: 15 pid: 6505 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779805.866817:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787779805.866826:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046099e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1f575176-36bc-4786-83ee-2fea064a12a9+15:3644:x1874622881483520:12345-0@lo:103: 00010000:00010000:2.0:1787779805.866857:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787779805.866875:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c04766dd000/0xc8fc0a517996031a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc8fc0a5179960313 expref: 15 pid: 6505 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779805.866886:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c04766dd000/0xc8fc0a517996031a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc8fc0a5179960313 expref: 15 pid: 6505 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779805.866902:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c04766dd000/0xc8fc0a517996031a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc8fc0a5179960313 expref: 15 pid: 6505 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779805.866916:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c04413c8000/0xc8fc0a51799603d7 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779805.866926:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c04413c8000/0xc8fc0a51799603d7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779805.866940:0:6499:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c04413c8000/0xc8fc0a51799603d7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779805.866947:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c04413c8000/0xc8fc0a51799603d7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779805.866953:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c04413c8000/0xc8fc0a51799603d7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779805.866960:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c04413c8000/0xc8fc0a51799603d7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779805.866966:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c04413c8000 already unused, calling callback (ffffffffc0d97420) 00010000:00010000:2.0:1787779805.866970:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c04413c8000/0xc8fc0a51799603d7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779805.866978:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c04413c8000/0xc8fc0a51799603d7 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779805.867008:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c04413c8000/0xc8fc0a51799603d7 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779805.867019:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787779805.867072:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046099e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1f575176-36bc-4786-83ee-2fea064a12a9+14:3644:x1874622881483520:12345-0@lo:103: Request processed in 237us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779805.867079:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:3.0:1787779805.867186:0:6507:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c04413c8000/0xc8fc0a51799603d7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779805.867195:0:6507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c04413c8000/0xc8fc0a51799603d7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779805.867201:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c04413c8000/0xc8fc0a51799603d7 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787779805.867213:0:6507:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1787779805.867343:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477941a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1f575176-36bc-4786-83ee-2fea064a12a9:3644:1874622881483520:0@lo:103: 00000100:00100000:2.0:1787779805.876242:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471776c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+13:8421:x1874622881482240:12345-0@lo:253: Request processed in 29455us (29633us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779805.876259:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787779805.876775:0:8421:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477989a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:8421:1874622881482240:0@lo:253: 10000000:01000000:1.0:1787779805.876790:0:8421:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1787779805.876794:0:8421:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787779805.876796:0:8421:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787779805.876797:0:8421:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787779805.876799:0:8421:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:1.0:1787779805.876800:0:8421:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787779805.876801:0:8421:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787779805.876803:0:8421:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787779805.876804:0:8421:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1787779805.876806:0:8421:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787779805.876808:0:8421:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787779805.876830:0:8421:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9c046ecd6000 from lustre-OST0000 10000000:01000000:1.0:1787779805.876887:0:8421:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1787779805.876891:0:8421:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1787779805.876940:0:8421:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9c04515699b8 local copy 10000000:01000000:0.0:1787779805.876946:0:8421:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787779805.876985:0:8421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c0440030e00/0xc8fc0a51799603de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779805.876996:0:8421:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.131@tcp lock: ffff9c0440030e00/0xc8fc0a51799603de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779805.877006:0:8421:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff9c0440030e00/0xc8fc0a51799603de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779805.877037:0:8421:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0461beed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:8421:1874622881483648:0@lo:101: 00000100:00100000:0.0:1787779805.877088:0:8421:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779805.877126:0:8421:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c044366b180 going to sleep for 11 seconds 00000100:00100000:1.0:1787779805.877413:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881483648 00000100:00100000:1.0:1787779805.877419:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881483648 00000100:00100000:1.0:1787779805.877481:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787779805.877489:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471777850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+13:8421:x1874622881483648:12345-0@lo:101: 00010000:00010000:1.0:1787779805.877501:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787779805.877514:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c044148a400/0xc8fc0a51799603e5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc8fc0a51799603de expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779805.877535:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c044148a400/0xc8fc0a51799603e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc8fc0a51799603de expref: 14 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779805.877545:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c044148a400/0xc8fc0a51799603e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a51799603de expref: 14 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779805.877552:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c044148a400, rc 0) 00000100:00100000:1.0:1787779805.877596:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471777850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+14:8421:x1874622881483648:12345-0@lo:101: Request processed in 108us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779805.877602:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787779805.877639:0:8421:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0461beed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:8421:1874622881483648:0@lo:101: 00010000:00010000:0.0:1787779805.877653:0:8421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff9c0440030e00/0xc8fc0a51799603de lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xc8fc0a51799603e5 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779805.877663:0:8421:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff9c0440030e00/0xc8fc0a51799603de lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xc8fc0a51799603e5 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779805.877755:0:8421:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0461beed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:8421:1874622881483776:0@lo:501: 00000100:00100000:0.0:1787779805.877783:0:8421:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779805.877814:0:8421:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c044366b180 going to sleep for 11 seconds 00000100:00100000:2.0:1787779805.877947:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881483776 00000100:00100000:2.0:1787779805.877952:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881483776 00000100:00100000:2.0:1787779805.877985:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787779805.877993:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471776050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+14:8421:x1874622881483776:12345-0@lo:501: 00000100:00100000:2.0:1787779805.878078:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471776050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+14:8421:x1874622881483776:12345-0@lo:501: Request processed in 85us (294us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787779805.878085:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787779805.878194:0:8421:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0461beed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:8421:1874622881483776:0@lo:501: 10000000:01000000:0.0:1787779805.878207:0:8421:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.131@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1787779805.878224:0:8421:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.131@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1787779805.878229:0:8421:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c0440030e00/0xc8fc0a51799603de lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xc8fc0a51799603e5 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779805.878237:0:8421:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c0440030e00/0xc8fc0a51799603de lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xc8fc0a51799603e5 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779805.878244:0:8421:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.131@tcp lock: ffff9c0440030e00/0xc8fc0a51799603de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xc8fc0a51799603e5 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779805.878267:0:8421:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787779805.878287:0:8421:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9c046ecd6000 10000000:01000000:0.0:1787779805.878291:0:8421:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787779805.878295:0:8421:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1787779805.878298:0:8421:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787779805.878301:0:8421:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1787779805.878304:0:8421:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1787779805.878320:0:8421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c0440031a00/0xc8fc0a51799603ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779805.878328:0:8421:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff9c0440031a00/0xc8fc0a51799603ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779805.878336:0:8421:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff9c0440031a00/0xc8fc0a51799603ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779805.878347:0:8421:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0461beed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:8421:1874622881483904:0@lo:101: 00000100:00100000:0.0:1787779805.878380:0:8421:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779805.878407:0:8421:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c044366bf00 going to sleep for 11 seconds 00000100:00100000:2.0:1787779805.878457:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881483904 00000100:00100000:2.0:1787779805.878461:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881483904 00000100:00100000:2.0:1787779805.878493:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787779805.878500:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471774450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+14:8421:x1874622881483904:12345-0@lo:101: 00010000:00010000:2.0:1787779805.878507:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787779805.878516:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c04413c8e00/0xc8fc0a51799603f3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc8fc0a51799603ec expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779805.878532:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c04413c8e00/0xc8fc0a51799603f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc8fc0a51799603ec expref: 15 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779805.878553:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c04413c8e00/0xc8fc0a51799603f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a51799603ec expref: 15 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779805.878560:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c04413c8e00, rc 0) 00000100:00100000:2.0:1787779805.878599:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471774450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+15:8421:x1874622881483904:12345-0@lo:101: Request processed in 99us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779805.878605:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787779805.878671:0:8421:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0461beed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:8421:1874622881483904:0@lo:101: 00010000:00010000:0.0:1787779805.878682:0:8421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff9c0440031a00/0xc8fc0a51799603ec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a51799603f3 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779805.878690:0:8421:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff9c0440031a00/0xc8fc0a51799603ec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc8fc0a51799603f3 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779805.878738:0:8421:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0461beed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:8421:1874622881484032:0@lo:501: 00000100:00100000:0.0:1787779805.878761:0:8421:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779805.878782:0:8421:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c044366bf00 going to sleep for 11 seconds 00010000:00010000:3.0:1787779805.878835:0:7453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787779805.878882:0:7453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff9c0440030e00/0xc8fc0a51799603de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xc8fc0a51799603e5 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779805.878889:0:7453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0440030e00 already unused, calling callback (ffffffffc139ac20) 10000000:00010000:3.0:1787779805.878893:0:7453:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff9c0440030e00/0xc8fc0a51799603de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xc8fc0a51799603e5 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779805.878901:0:7453:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff9c0440030e00/0xc8fc0a51799603de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xc8fc0a51799603e5 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787779805.878908:0:7453:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff9c0440030e00/0xc8fc0a51799603de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xc8fc0a51799603e5 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787779805.878915:0:7453:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1787779805.878925:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881484032 00000100:00100000:1.0:1787779805.878930:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881484032 00010000:00010000:3.0:1787779805.878937:0:7453:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff9c0440030e00/0xc8fc0a51799603de lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xc8fc0a51799603e5 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779805.878955:0:7453:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1787779805.878955:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787779805.878965:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471775450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+15:8421:x1874622881484032:12345-0@lo:501: 00010000:00010000:3.0:1787779805.878975:0:7453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff9c0440030e00/0xc8fc0a51799603de lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xc8fc0a51799603e5 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779805.878983:0:7453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff9c0440030e00/0xc8fc0a51799603de lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xc8fc0a51799603e5 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779805.878997:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787779805.878999:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787779805.879000:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787779805.879071:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471775450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+15:8421:x1874622881484032:12345-0@lo:501: Request processed in 97us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779805.879078:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787779805.879104:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787779805.879127:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477943480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1f575176-36bc-4786-83ee-2fea064a12a9:3643:1874622881484160:0@lo:103: 00000100:00100000:1.0:1787779805.879155:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779805.879189:0:8421:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0461beed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:8421:1874622881484032:0@lo:501: 00000100:00100000:0.0:1787779805.879219:0:8421:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0461beed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:8421:1874622881484288:0@lo:503: 00000100:00100000:0.0:1787779805.879256:0:8421:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779805.879277:0:8421:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c044366bf00 going to sleep for 11 seconds 00000100:00100000:1.0:1787779805.879299:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881484288 00000100:00100000:1.0:1787779805.879304:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881484288 00000100:00100000:2.0:1787779805.879331:0:7921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881484160 00000100:00100000:2.0:1787779805.879336:0:7921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881484160 00000100:00100000:1.0:1787779805.879338:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787779805.879355:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471774c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+16:8421:x1874622881484288:12345-0@lo:503: 00000100:00100000:2.0:1787779805.879374:0:7921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787779805.879384:0:7921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477989a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1f575176-36bc-4786-83ee-2fea064a12a9+16:3643:x1874622881484160:12345-0@lo:103: 00010000:00010000:2.0:1787779805.879395:0:7921:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787779805.879407:0:7921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c044148a400/0xc8fc0a51799603e5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc8fc0a51799603de expref: 16 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779805.879418:0:7921:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787779805.879438:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471774c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+15:8421:x1874622881484288:12345-0@lo:503: Request processed in 85us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779805.879446:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787779805.879460:0:7921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477989a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1f575176-36bc-4786-83ee-2fea064a12a9+14:3643:x1874622881484160:12345-0@lo:103: Request processed in 77us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779805.879467:0:7921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787779805.879498:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477943480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1f575176-36bc-4786-83ee-2fea064a12a9:3643:1874622881484160:0@lo:103: 00000100:00100000:0.0:1787779805.879559:0:8421:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0461beed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:8421:1874622881484288:0@lo:503: 00000040:00080000:0.0:1787779805.879783:0:8421:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787779805.880346:0:8421:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0461beed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:8421:1874622881484416:0@lo:502: 00000100:00100000:0.0:1787779805.880394:0:8421:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779805.880427:0:8421:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c044366bf00 going to sleep for 11 seconds 00000100:00100000:2.0:1787779805.880522:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881484416 00000100:00100000:2.0:1787779805.880527:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881484416 00000100:00100000:2.0:1787779805.880604:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787779805.880613:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471775c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+14:8421:x1874622881484416:12345-0@lo:502: 00000100:00100000:2.0:1787779805.880707:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471775c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+14:8421:x1874622881484416:12345-0@lo:502: Request processed in 95us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779805.880724:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787779805.880799:0:8421:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0461beed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:8421:1874622881484416:0@lo:502: 00000040:00080000:0.0:1787779805.881038:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1787779805.881075:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1787779805.881091:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1787779805.881102:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1787779805.881125:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1787779805.881138:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1787779805.881156:0:8421:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0461beed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:8421:1874622881484544:0@lo:502: 00000100:00100000:0.0:1787779805.881192:0:8421:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779805.882684:0:8421:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c044366bf00 going to sleep for 11 seconds 00000100:00100000:1.0:1787779805.882795:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881484544 00000100:00100000:1.0:1787779805.882803:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881484544 00000100:00100000:1.0:1787779805.882873:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787779805.882883:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471774050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+14:8421:x1874622881484544:12345-0@lo:502: 00000100:00100000:1.0:1787779805.883007:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471774050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+14:8421:x1874622881484544:12345-0@lo:502: Request processed in 124us (1813us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779805.883029:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787779805.883152:0:8421:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0461beed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:8421:1874622881484544:0@lo:502: 00000040:00080000:0.0:1787779805.883225:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1787779805.883237:0:8421:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:0.0:1787779805.883738:0:8444:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787779805.883746:0:8444:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:0.0:1787779805.883752:0:8444:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787779805.883754:0:8444:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1787779805.883759:0:8444:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787779805.883773:0:8444:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9c046eceb370) 00000020:00000080:0.0:1787779805.883792:0:8444:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000080:0.0:1787779805.883797:0:8444:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787779805.883904:0:8444:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c046ecd6000 from lustre-OST0000, refs=2 00080000:01000000:0.0:1787779805.883912:0:8444:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787779805.883919:0:8444:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xc8fc0a5179960401 00010000:00010000:0.0:1787779805.888695:0:8444:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:02000400:0.0:1787779805.890126:0:8444:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:0.0:1787779805.893195:0:8444:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1787779805.893553:0:8444:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:0.0:1787779805.898569:0:8444:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:0.0:1787779805.900160:0:8444:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:0.0:1787779805.906288:0:8444:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:0.0:1787779805.907573:0:8444:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1787779805.908729:0:8444:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787779805.908739:0:8444:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787779805.908742:0:8444:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1787779805.908754:0:8444:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787779805.908758:0:8444:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787779805.908759:0:8444:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787779805.908762:0:8444:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787779805.908764:0:8444:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787779805.908785:0:8444:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787779805.908788:0:8444:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787779805.908789:0:8444:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787779805.908792:0:8444:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1787779805.909096:0:8421:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:2.0:1787779805.909122:0:8421:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1787779805.909143:0:8421:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c0440031a00/0xc8fc0a51799603ec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a51799603f3 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779805.909155:0:8421:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff9c0440031a00/0xc8fc0a51799603ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a51799603f3 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787779805.909163:0:8421:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c046ecd6000 from 1 10000000:01000000:2.0:1787779805.909165:0:8421:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787779805.909200:0:8421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c04413c8800/0xc8fc0a5179960408 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779805.909208:0:8421:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff9c04413c8800/0xc8fc0a5179960408 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779805.909217:0:8421:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff9c04413c8800/0xc8fc0a5179960408 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779805.909238:0:8421:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0345e752c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:8421:1874622881484672:0@lo:101: 00000100:00100000:2.0:1787779805.909362:0:8421:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779805.909404:0:8421:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0443648000 going to sleep for 11 seconds 00000100:00100000:1.0:1787779805.909675:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881484672 00000100:00100000:1.0:1787779805.909682:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881484672 00000100:00100000:1.0:1787779805.911166:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787779805.911182:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471776450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+14:8421:x1874622881484672:12345-0@lo:101: 00010000:00010000:1.0:1787779805.911199:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787779805.911216:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c044148ae00/0xc8fc0a517996040f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc8fc0a5179960408 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779805.911241:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c044148ae00/0xc8fc0a517996040f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc8fc0a5179960408 expref: 15 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779805.911253:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c044148ae00/0xc8fc0a517996040f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a5179960408 expref: 15 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779805.911261:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c044148ae00, rc 0) 00000100:00100000:1.0:1787779805.911331:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471776450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+15:8421:x1874622881484672:12345-0@lo:101: Request processed in 154us (1969us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779805.911345:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787779805.911472:0:8421:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0345e752c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:8421:1874622881484672:0@lo:101: 00010000:00010000:3.0:1787779805.911489:0:8421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff9c04413c8800/0xc8fc0a5179960408 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a517996040f expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779805.911498:0:8421:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff9c04413c8800/0xc8fc0a5179960408 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc8fc0a517996040f expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779805.911593:0:8421:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477943c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:8421:1874622881484800:0@lo:501: 00000100:00100000:3.0:1787779805.911625:0:8421:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779805.917588:0:8421:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0460968000 going to sleep for 11 seconds 00000100:00100000:2.0:1787779805.917686:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881484800 00000100:00100000:2.0:1787779805.917695:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881484800 00000100:00100000:2.0:1787779805.917739:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787779805.917747:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471772050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+15:8421:x1874622881484800:12345-0@lo:501: 00000100:00100000:2.0:1787779805.918398:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471772050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+15:8421:x1874622881484800:12345-0@lo:501: Request processed in 649us (6770us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779805.918422:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787779805.918782:0:8421:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477943c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:8421:1874622881484800:0@lo:501: 00000100:00100000:0.0:1787779805.919187:0:8421:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477943c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:8421:1874622881484928:0@lo:503: 00000100:00100000:0.0:1787779805.919425:0:8421:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779805.919452:0:8421:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c044366bd80 going to sleep for 11 seconds 00000100:00100000:1.0:1787779805.920461:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881484928 00000100:00100000:1.0:1787779805.920470:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881484928 00000100:00100000:1.0:1787779805.920525:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787779805.920534:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471770450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+15:8421:x1874622881484928:12345-0@lo:503: 00000100:00100000:1.0:1787779805.920671:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471770450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+15:8421:x1874622881484928:12345-0@lo:503: Request processed in 137us (1245us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779805.920678:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787779805.920873:0:8421:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477943c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:8421:1874622881484928:0@lo:503: 00000040:00080000:0.0:1787779805.921147:0:8421:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787779805.921505:0:8421:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0461beed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:8421:1874622881485056:0@lo:502: 00000100:00100000:0.0:1787779805.921554:0:8421:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779805.921766:0:8421:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c044366bd80 going to sleep for 11 seconds 00000100:00100000:3.0:1787779805.921892:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881485056 00000100:00100000:3.0:1787779805.921898:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881485056 00000100:00100000:3.0:1787779805.922074:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787779805.922083:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471771450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+15:8421:x1874622881485056:12345-0@lo:502: 00000100:00100000:3.0:1787779805.922186:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471771450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+15:8421:x1874622881485056:12345-0@lo:502: Request processed in 104us (631us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779805.922213:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787779805.922282:0:8421:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0461beed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:8421:1874622881485056:0@lo:502: 00000040:00080000:0.0:1787779805.922472:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1787779805.922498:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1787779805.922520:0:8421:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0461beed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:8421:1874622881485184:0@lo:502: 00000100:00100000:0.0:1787779805.922553:0:8421:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779805.922820:0:8421:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c044366bd80 going to sleep for 11 seconds 00000100:00100000:2.0:1787779805.922969:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881485184 00000100:00100000:2.0:1787779805.922974:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881485184 00000100:00100000:2.0:1787779805.923001:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787779805.923008:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471770c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+15:8421:x1874622881485184:12345-0@lo:502: 00000100:00100000:2.0:1787779805.923183:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471770c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+15:8421:x1874622881485184:12345-0@lo:502: Request processed in 174us (628us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779805.923252:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787779805.923470:0:8421:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0461beed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:8421:1874622881485184:0@lo:502: 00000040:00080000:0.0:1787779805.923519:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1787779805.923528:0:8421:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1787779805.924299:0:8448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787779805.924440:0:8448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787779805.924442:0:8448:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787779805.924450:0:8448:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c046ecd6000 00000020:00000080:2.0:1787779805.924453:0:8448:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787779805.924467:0:8448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787779805.924470:0:8448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787779805.924471:0:8448:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1787779805.924474:0:8448:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1787779805.924617:0:8421:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1787779805.924640:0:8421:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787779805.924701:0:8421:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c04413c8800/0xc8fc0a5179960408 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a517996040f expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779805.924712:0:8421:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff9c04413c8800/0xc8fc0a5179960408 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a517996040f expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787779805.924755:0:8421:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787779805.924758:0:8421:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9c046ecd6000 10000000:01000000:0.0:1787779805.924761:0:8421:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9c046ecd6000 10000000:01000000:0.0:1787779805.924764:0:8421:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787779805.924770:0:8421:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c046ecd6000 from 1 10000000:01000000:0.0:1787779805.924773:0:8421:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787779805.924800:0:8421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c0440031000/0xc8fc0a5179960416 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779805.924808:0:8421:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff9c0440031000/0xc8fc0a5179960416 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779805.924818:0:8421:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff9c0440031000/0xc8fc0a5179960416 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779805.925050:0:8421:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0461beed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:8421:1874622881485312:0@lo:101: 00000100:00100000:0.0:1787779805.925113:0:8421:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779805.927581:0:8421:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c044366bd80 going to sleep for 11 seconds 00000100:00100000:2.0:1787779805.928677:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881485312 00000100:00100000:2.0:1787779805.928688:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881485312 00000100:00100000:2.0:1787779805.928782:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1787779805.928792:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471771c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+15:8421:x1874622881485312:12345-0@lo:101: 00010000:00010000:2.0:1787779805.928808:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787779805.928825:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c04413c9e00/0xc8fc0a517996041d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc8fc0a5179960416 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779805.928881:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c04413c9e00/0xc8fc0a517996041d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc8fc0a5179960416 expref: 16 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779805.928892:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c04413c9e00/0xc8fc0a517996041d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a5179960416 expref: 16 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779805.928917:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c04413c9e00, rc 0) 00000100:00100000:2.0:1787779805.928983:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471771c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+16:8421:x1874622881485312:12345-0@lo:101: Request processed in 193us (3870us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779805.928990:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787779805.929113:0:8421:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0461beed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:8421:1874622881485312:0@lo:101: 00010000:00010000:0.0:1787779805.929130:0:8421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff9c0440031000/0xc8fc0a5179960416 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a517996041d expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779805.929139:0:8421:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff9c0440031000/0xc8fc0a5179960416 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc8fc0a517996041d expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779805.929263:0:8421:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0461beed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:8421:1874622881485440:0@lo:501: 00000100:00100000:0.0:1787779805.929297:0:8421:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779805.929747:0:8421:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c044366bd80 going to sleep for 11 seconds 00000100:00100000:1.0:1787779805.929808:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881485440 00000100:00100000:1.0:1787779805.929813:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881485440 00000100:00100000:1.0:1787779805.929872:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787779805.929880:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471770050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+16:8421:x1874622881485440:12345-0@lo:501: 00000100:00100000:1.0:1787779805.929990:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471770050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+16:8421:x1874622881485440:12345-0@lo:501: Request processed in 110us (691us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779805.929997:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1787779805.930468:0:8421:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0461beed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:8421:1874622881485440:0@lo:501: 00000100:00100000:0.0:1787779805.930507:0:8421:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0461beed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:8421:1874622881485568:0@lo:503: 00000100:00100000:0.0:1787779805.930556:0:8421:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779805.930576:0:8421:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c044366bd80 going to sleep for 11 seconds 00000100:00100000:1.0:1787779805.930633:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881485568 00000100:00100000:1.0:1787779805.930638:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881485568 00000100:00100000:1.0:1787779805.930659:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787779805.930665:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471772450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+16:8421:x1874622881485568:12345-0@lo:503: 00000100:00100000:1.0:1787779805.930756:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471772450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+16:8421:x1874622881485568:12345-0@lo:503: Request processed in 91us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779805.930763:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1787779805.930875:0:8421:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0461beed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:8421:1874622881485568:0@lo:503: 00000040:00080000:0.0:1787779805.931169:0:8421:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787779805.931605:0:8421:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0461beed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:8421:1874622881485696:0@lo:502: 00000100:00100000:0.0:1787779805.931650:0:8421:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779805.931676:0:8421:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c044366b9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787779805.931739:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881485696 00000100:00100000:2.0:1787779805.931744:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881485696 00000100:00100000:2.0:1787779805.931773:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787779805.931781:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471771850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+16:8421:x1874622881485696:12345-0@lo:502: 00000100:00100000:2.0:1787779805.931908:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471771850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+16:8421:x1874622881485696:12345-0@lo:502: Request processed in 127us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779805.931915:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1787779805.932115:0:8421:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0461beed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:8421:1874622881485696:0@lo:502: 00000040:00080000:0.0:1787779805.932574:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1787779805.932600:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1787779805.932611:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1787779805.932622:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1787779805.932632:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1787779805.932659:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1787779805.932672:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1787779805.932683:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1787779805.932694:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1787779805.932706:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1787779805.932717:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1787779805.932728:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1787779805.932740:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1787779805.932763:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1787779805.932775:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1787779805.932787:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1787779805.932799:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1787779805.932811:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1787779805.932824:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1787779805.932871:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1787779805.932891:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1787779805.932923:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1787779805.932939:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1787779805.932952:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1787779805.932965:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:0.0:1787779805.932977:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:0.0:1787779805.932989:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:0.0:1787779805.933000:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:0.0:1787779805.933011:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:0.0:1787779805.933024:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:0.0:1787779805.933037:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:0.0:1787779805.933049:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:0.0:1787779805.933075:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:0.0:1787779805.933091:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:0.0:1787779805.933103:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:0.0:1787779805.933117:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:0.0:1787779805.933130:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000100:00100000:0.0:1787779805.933166:0:8421:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0461beed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:8421:1874622881485824:0@lo:502: 00000100:00100000:0.0:1787779805.934697:0:8421:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779805.934781:0:8421:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c044366b9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787779805.934935:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881485824 00000100:00100000:2.0:1787779805.934943:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881485824 00000100:00100000:2.0:1787779805.935034:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787779805.935044:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471771050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+16:8421:x1874622881485824:12345-0@lo:502: 00000100:00100000:2.0:1787779805.935187:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471771050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+16:8421:x1874622881485824:12345-0@lo:502: Request processed in 144us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779805.935195:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1787779805.935271:0:8421:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0461beed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:8421:1874622881485824:0@lo:502: 00000040:00080000:0.0:1787779805.935363:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:0.0:1787779805.935377:0:8421:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:0.0:1787779805.936219:0:8449:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1787779805.936241:0:8449:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9c046ece99b8) 00000020:00000080:0.0:1787779805.936262:0:8449:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:0.0:1787779805.936592:0:8449:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c046ecd6000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787779805.936597:0:8449:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c046ecd6000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787779805.936600:0:8449:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c046ecd6000 3 00010000:00080000:0.0:1787779805.936628:0:8449:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c04777a2800@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.131@tcp at head 00010000:00010000:0.0:1787779805.942598:0:8449:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-5 is initialized 00000020:00000080:0.0:1787779805.942921:0:8449:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1787779805.942965:0:8449:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787779805.942980:0:8449:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xc8fc0a517996042b 00000100:00080000:0.0:1787779805.942991:0:8449:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787779805.942997:0:8449:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9c04777a2800 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:0.0:1787779805.943033:0:8449:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c0461beed00 x1874622881485952/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787779805.943071:0:8449:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000020:01000004:0.0:1787779805.943250:0:8449:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1787779805.943264:0:8449:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9c046ececd28) 00000020:00000080:0.0:1787779805.943276:0:8449:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:01000004:0.0:1787779805.943371:0:8449:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c046ecd6000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787779805.943375:0:8449:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c046ecd6000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787779805.943378:0:8449:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c046ecd6000 3 00010000:00080000:0.0:1787779805.943406:0:8449:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c044408b000@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.131@tcp at head 00000100:00100000:3.0:1787779805.943963:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0461beed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1874622881485952:0@lo:38: 00000100:00100000:3.0:1787779805.944028:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779805.944111:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881485952 00000100:00100000:3.0:1787779805.944118:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881485952 00000100:00100000:3.0:1787779805.944154:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787779805.944162:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477941e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3640:x1874622881485952:12345-0@lo:38: 00010000:00080000:3.0:1787779805.944186:0:6512:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 213 last 0 00000020:00000080:3.0:1787779805.944215:0:6512:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xc8fc0a5179960439 00000004:00100000:3.0:1787779805.944235:0:6512:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787779805.944263:0:6512:0:(import.c:65:import_set_state_nolock()) ffff9c0345e56800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787779805.944311:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477941e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1874622881485952:12345-0@lo:38: Request processed in 148us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779805.944318:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1787779805.944356:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c0461beed00 x1874622881485952/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787779815 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779805.944365:0:3640:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787779805.944373:0:3640:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1787779805.944379:0:3640:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1787779805.944383:0:3640:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787779805.944385:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9c04777a2800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787779805.944391:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0461beed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1874622881485952:0@lo:38: 00000100:00100000:1.0:1787779805.944725:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477988780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874622881486208:0@lo:400: 00000100:00100000:1.0:1787779805.944758:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779805.944779:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787779805.944784:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047798b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1874622881486080:0@lo:400: 00000100:00100000:1.0:1787779805.944815:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779805.944863:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047798a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874622881486336:0@lo:400: 00000100:00100000:1.0:1787779805.944885:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779805.944902:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787779805.944909:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047798b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881486464:0@lo:400: 00000100:00100000:1.0:1787779805.944928:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779805.944959:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881486208 00000100:00100000:1.0:1787779805.944963:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881486208 00000100:00100000:1.0:1787779805.944987:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881486464 00000100:00100000:1.0:1787779805.944989:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881486464 00000100:00100000:1.0:1787779805.944999:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787779805.945005:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c047798a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1874622881486208:12345-0@lo:400: 00000100:00100000:1.0:1787779805.945044:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c047798a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1874622881486208:12345-0@lo:400: Request processed in 39us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779805.945049:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787779805.945074:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787779805.945082:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c047798ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881486464:12345-0@lo:400: 00000100:00100000:1.0:1787779805.945113:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c047798ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881486464:12345-0@lo:400: Request processed in 32us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779805.945119:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787779805.945136:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881486080 00000100:00100000:1.0:1787779805.945139:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881486080 00000100:00100000:1.0:1787779805.945158:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881486336 00000100:00100000:1.0:1787779805.945161:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881486336 00000100:00100000:1.0:1787779805.945175:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787779805.945180:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c047798a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1874622881486080:12345-0@lo:400: 00000100:00100000:1.0:1787779805.945221:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c047798a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1874622881486080:12345-0@lo:400: Request processed in 40us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779805.945232:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787779805.945243:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787779805.945248:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477988b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1874622881486336:12345-0@lo:400: 00000100:00100000:1.0:1787779805.945274:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477988b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1874622881486336:12345-0@lo:400: Request processed in 26us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779805.945278:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787779805.945550:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047798b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881486464:0@lo:400: 00010000:00080000:1.0:1787779805.945563:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c047798a940 x1874622881486336/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779821 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787779805.945573:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047798a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874622881486336:0@lo:400: 00010000:00080000:1.0:1787779805.945603:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c047798b480 x1874622881486080/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779821 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787779805.945613:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047798b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1874622881486080:0@lo:400: 00000100:00100000:1.0:1787779805.945625:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477988780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874622881486208:0@lo:400: 00010000:00010000:0.0:1787779805.947242:0:8449:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-6 is initialized 00000020:00000080:0.0:1787779805.949877:0:8449:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:0.0:1787779805.949929:0:8449:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787779805.949944:0:8449:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xc8fc0a5179960440 00000100:00080000:0.0:1787779805.949956:0:8449:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787779805.949962:0:8449:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9c044408b000 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:0.0:1787779805.950368:0:8449:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c0461bed680 x1874622881486592/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787779805.950411:0:8449:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000040:00080000:0.0:1787779805.950703:0:8449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00100000:1.0:1787779805.950925:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0461bed680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3640:1874622881486592:0@lo:38: 00000100:00100000:1.0:1787779805.950999:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779805.951053:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881486592 00000100:00100000:1.0:1787779805.951071:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881486592 00000100:00100000:1.0:1787779805.951103:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787779805.951109:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477988780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1874622881486592:12345-0@lo:38: 00010000:00080000:1.0:1787779805.951133:0:6513:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 213 last 0 00000020:00000080:1.0:1787779805.951164:0:6513:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xc8fc0a5179960447 00000004:00100000:1.0:1787779805.951178:0:6513:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787779805.951216:0:6513:0:(import.c:65:import_set_state_nolock()) ffff9c0341d3e000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787779805.951265:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477988780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1874622881486592:12345-0@lo:38: Request processed in 154us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779805.951272:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1787779805.951309:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c0461bed680 x1874622881486592/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787779815 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787779805.951317:0:3640:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787779805.951325:0:3640:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 1 00000100:00080000:1.0:1787779805.951331:0:3640:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1787779805.951335:0:3640:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1787779805.951337:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9c044408b000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787779805.951342:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0461bed680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3640:1874622881486592:0@lo:38: 00000020:01000000:3.0:1787779805.954249:0:8421:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:3.0:1787779805.954295:0:8421:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787779805.954317:0:8421:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c0440031000/0xc8fc0a5179960416 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a517996041d expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779805.954336:0:8421:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff9c0440031000/0xc8fc0a5179960416 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a517996041d expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787779805.958907:0:8421:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787779805.958910:0:8421:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787779805.958911:0:8421:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787779805.958913:0:8421:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787779805.958914:0:8421:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787779805.958916:0:8421:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787779805.958917:0:8421:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787779805.958918:0:8421:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787779805.958920:0:8421:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787779805.958921:0:8421:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787779805.958923:0:8421:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787779805.958927:0:8421:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:3.0:1787779805.958929:0:8421:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787779805.958931:0:8421:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787779805.958932:0:8421:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787779805.958933:0:8421:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787779805.958934:0:8421:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787779805.958935:0:8421:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787779805.958936:0:8421:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787779805.958937:0:8421:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787779805.958938:0:8421:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787779805.958939:0:8421:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787779805.958940:0:8421:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787779805.958969:0:8421:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1787779805.958987:0:8421:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477940000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:8421:1874622881486720:0@lo:253: 00000100:00100000:3.0:1787779805.959054:0:8421:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779805.959430:0:8421:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0460968cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787779805.962251:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881486720 00000100:00100000:0.0:1787779805.962263:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881486720 00000100:00100000:0.0:1787779805.962319:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787779805.962331:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471773050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+16:8421:x1874622881486720:12345-0@lo:253: 20000000:01000000:0.0:1787779805.962414:0:6505:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1787779805.962427:0:6505:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1787779805.971514:0:6505:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787779805.971534:0:6505:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1787779805.971652:0:6528:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787779805.971658:0:6528:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787779805.971679:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c04413c8c00/0xc8fc0a517996044e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779805.971696:0:6528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c0440031e00/0xc8fc0a5179960344 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a517996033d expref: 16 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779805.971703:0:6528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c044148a000/0xc8fc0a5179960360 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a5179960359 expref: 16 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779805.971732:0:6528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c04413c8c00/0xc8fc0a517996044e lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779805.971762:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471773050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+16:8421:x1874622881486720:12345-0@lo:253: Request processed in 9434us (12707us total) trans 0 rc 0/0 00010000:00010000:2.0:1787779805.971767:0:6528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c044148a000/0xc8fc0a5179960360 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc8fc0a5179960359 expref: 16 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779805.971773:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00010000:00010000:2.0:1787779805.971780:0:6528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c044148a000/0xc8fc0a5179960360 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc8fc0a5179960359 expref: 16 pid: 6507 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779805.971793:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0345e761c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6528:1874622881486848:0@lo:104: 00000100:00100000:2.0:1787779805.971829:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779805.971880:0:6496:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787779805.971891:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881486848 00010000:00010000:2.0:1787779805.971896:0:6528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c0440031e00/0xc8fc0a5179960344 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc8fc0a517996033d expref: 15 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779805.971897:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881486848 00010000:00010000:2.0:1787779805.971904:0:6528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c0440031e00/0xc8fc0a5179960344 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc8fc0a517996033d expref: 15 pid: 6505 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779805.971913:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0345e74b40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6528:1874622881486976:0@lo:104: 00000100:00100000:1.0:1787779805.971933:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787779805.971934:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779805.971941:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046efab050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1f575176-36bc-4786-83ee-2fea064a12a9+3:6528:x1874622881486848:12345-0@lo:104: 00000100:00100000:2.0:1787779805.971945:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0346b500c0 going to sleep for 11 seconds 00010000:00010000:1.0:1787779805.971953:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff9c04766dda00/0xc8fc0a5179960359 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc8fc0a5179960360 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779805.972000:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787779805.972006:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046efab050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1f575176-36bc-4786-83ee-2fea064a12a9+3:6528:x1874622881486848:12345-0@lo:104: Request processed in 66us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779805.972015:0:6495:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:1.0:1787779805.972018:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787779805.972022:0:6495:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00000100:00100000:1.0:1787779805.972056:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881486976 00000100:00100000:1.0:1787779805.972072:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881486976 00000100:00100000:1.0:1787779805.972089:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787779805.972094:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0345e76940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1f575176-36bc-4786-83ee-2fea064a12a9+3:6528:x1874622881486976:12345-0@lo:104: 00010000:00010000:1.0:1787779805.972102:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff9c04766dce00/0xc8fc0a517996033d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc8fc0a5179960344 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779805.972135:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787779805.972140:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0345e76940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1f575176-36bc-4786-83ee-2fea064a12a9+3:6528:x1874622881486976:12345-0@lo:104: Request processed in 45us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779805.972146:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:1.0:1787779805.972160:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787779805.972165:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff9c04766dda00/0xc8fc0a5179960359 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc8fc0a5179960360 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779805.972167:0:8421:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477940000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:8421:1874622881486720:0@lo:253: 00010000:00010000:1.0:1787779805.972172:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c04766dda00 already unused, calling callback (ffffffffc139ac20) 10000000:00010000:1.0:1787779805.972176:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff9c04766dda00/0xc8fc0a5179960359 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc8fc0a5179960360 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787779805.972177:0:8421:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1787779805.972181:0:8421:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787779805.972182:0:8421:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787779805.972183:0:8421:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00010000:00010000:1.0:1787779805.972185:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff9c04766dda00/0xc8fc0a5179960359 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc8fc0a5179960360 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787779805.972185:0:8421:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787779805.972186:0:8421:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787779805.972187:0:8421:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787779805.972189:0:8421:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787779805.972190:0:8421:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787779805.972191:0:8421:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 10000000:00010000:1.0:1787779805.972192:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff9c04766dda00/0xc8fc0a5179960359 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc8fc0a5179960360 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787779805.972193:0:8421:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787779805.972194:0:8421:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787779805.972197:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000020:02000000:0.0:1787779805.972207:0:8421:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:1.0:1787779805.972221:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff9c04766dda00/0xc8fc0a5179960359 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a5179960360 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779805.972235:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787779805.972253:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff9c04766dda00/0xc8fc0a5179960359 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a5179960360 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779805.972261:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff9c04766dda00/0xc8fc0a5179960359 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a5179960360 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779805.972271:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787779805.972275:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff9c04766dce00/0xc8fc0a517996033d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc8fc0a5179960344 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779805.972281:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c04766dce00 already unused, calling callback (ffffffffc139ac20) 10000000:00010000:1.0:1787779805.972283:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff9c04766dce00/0xc8fc0a517996033d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc8fc0a5179960344 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779805.972289:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff9c04766dce00/0xc8fc0a517996033d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc8fc0a5179960344 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787779805.972295:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff9c04766dce00/0xc8fc0a517996033d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc8fc0a5179960344 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787779805.972311:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787779805.972325:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff9c04766dce00/0xc8fc0a517996033d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a5179960344 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779805.972331:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787779805.972337:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff9c04766dce00/0xc8fc0a517996033d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a5179960344 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779805.973574:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff9c04766dce00/0xc8fc0a517996033d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a5179960344 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779805.973604:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787779805.973606:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787779805.973609:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787779805.973620:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787779805.973645:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047798b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1f575176-36bc-4786-83ee-2fea064a12a9:3641:1874622881487104:0@lo:103: 00000100:00100000:1.0:1787779805.973694:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779805.973734:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787779805.973740:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047798a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1f575176-36bc-4786-83ee-2fea064a12a9:3641:1874622881487232:0@lo:103: 00000100:00100000:1.0:1787779805.973763:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779805.973807:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881487104 00000100:00100000:1.0:1787779805.973812:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881487104 00010000:00010000:1.0:1787779805.973864:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c044148a000/0xc8fc0a5179960360 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc8fc0a5179960359 expref: 16 pid: 6507 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779805.973888:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881487232 00000100:00100000:1.0:1787779805.973891:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881487232 00010000:00010000:1.0:1787779805.973906:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c0440031e00/0xc8fc0a5179960344 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc8fc0a517996033d expref: 17 pid: 6505 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779805.973924:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787779805.973933:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c047798b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1f575176-36bc-4786-83ee-2fea064a12a9+17:3641:x1874622881487104:12345-0@lo:103: 00010000:00010000:1.0:1787779805.973945:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787779805.973951:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c044148a000/0xc8fc0a5179960360 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc8fc0a5179960359 expref: 17 pid: 6507 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779805.973962:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c044148a000/0xc8fc0a5179960360 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc8fc0a5179960359 expref: 17 pid: 6507 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779805.973989:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787779805.974022:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c047798b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1f575176-36bc-4786-83ee-2fea064a12a9+17:3641:x1874622881487104:12345-0@lo:103: Request processed in 90us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779805.974029:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787779805.974045:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787779805.974051:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c047798b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1f575176-36bc-4786-83ee-2fea064a12a9+16:3641:x1874622881487232:12345-0@lo:103: 00010000:00010000:1.0:1787779805.974058:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787779805.974073:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c0440031e00/0xc8fc0a5179960344 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc8fc0a517996033d expref: 16 pid: 6505 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779805.974083:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c0440031e00/0xc8fc0a5179960344 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc8fc0a517996033d expref: 16 pid: 6505 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779805.974095:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c04413c8c00/0xc8fc0a517996044e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779805.974102:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c04413c8c00/0xc8fc0a517996044e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787779805.974115:0:6498:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002587631s 00010000:00010000:1.0:1787779805.974120:0:6498:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c04413c8c00/0xc8fc0a517996044e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779805.974128:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c04413c8c00/0xc8fc0a517996044e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779805.974134:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c04413c8c00/0xc8fc0a517996044e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779805.974140:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c04413c8c00/0xc8fc0a517996044e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779805.974152:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c04413c8c00 already unused, calling callback (ffffffffc0d97420) 00010000:00010000:1.0:1787779805.974156:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c04413c8c00/0xc8fc0a517996044e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779805.974164:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c04413c8c00/0xc8fc0a517996044e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779805.974172:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c04413c8c00/0xc8fc0a517996044e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779805.974182:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787779805.974209:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c047798b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1f575176-36bc-4786-83ee-2fea064a12a9+16:3641:x1874622881487232:12345-0@lo:103: Request processed in 158us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779805.974216:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787779805.974256:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047798a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1f575176-36bc-4786-83ee-2fea064a12a9:3641:1874622881487232:0@lo:103: 00000100:00100000:1.0:1787779805.974266:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047798b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1f575176-36bc-4786-83ee-2fea064a12a9:3641:1874622881487104:0@lo:103: 00010000:00010000:2.0:1787779805.974434:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c044148a000/0xc8fc0a5179960360 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc8fc0a5179960359 expref: 15 pid: 6507 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779805.974445:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0345e761c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6528:1874622881486848:0@lo:104: 00010000:00010000:2.0:1787779805.974454:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c0440031e00/0xc8fc0a5179960344 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc8fc0a517996033d expref: 14 pid: 6505 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779805.974462:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0345e74b40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6528:1874622881486976:0@lo:104: 00010000:00010000:2.0:1787779805.974494:0:6528:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c04413c8c00/0xc8fc0a517996044e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779805.974503:0:6528:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c04413c8c00/0xc8fc0a517996044e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779805.974509:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c04413c8c00/0xc8fc0a517996044e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779805.974515:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c04413c8c00/0xc8fc0a517996044e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:0.0:1787779805.979207:0:8421:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:0.0:1787779805.979529:0:8421:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:0.0:1787779805.979746:0:8421:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:0.0:1787779805.980024:0:8421:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:0.0:1787779805.980230:0:8421:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:0.0:1787779805.980458:0:8421:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:0.0:1787779805.981631:0:8421:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1787779805.994084:0:8421:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1787779805.994093:0:8421:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1787779805.994129:0:8421:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787779805.994174:0:8421:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.131@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787779805.994195:0:8421:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1787779805.994218:0:8421:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:2.0:1787779805.994948:0:8421:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787779805.995138:0:8421:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:3.0:1787779806.300137:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787779806.898242:0:8506:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787779806.898543:0:8506:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:1.0:1787779807.003990:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787779807.003997:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c04764fa000 from 30 10000000:01000000:1.0:1787779807.004003:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787779807.004048:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c044148ba00/0xc8fc0a5179960455 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779807.004088:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff9c044148ba00/0xc8fc0a5179960455 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779807.004100:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff9c044148ba00/0xc8fc0a5179960455 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779807.004124:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047798b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881487360:0@lo:101: 00000100:00100000:1.0:1787779807.004204:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779807.004247:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0477ba0480 going to sleep for 11 seconds 00000100:00100000:2.0:1787779807.006413:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881487360 00000100:00100000:2.0:1787779807.006556:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881487360 00000100:00100000:2.0:1787779807.006621:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1787779807.006631:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471770850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+14:6509:x1874622881487360:12345-0@lo:101: 00010000:00010000:2.0:1787779807.006647:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787779807.006666:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c04413c8200/0xc8fc0a517996045c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc8fc0a5179960455 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779807.006695:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c04413c8200/0xc8fc0a517996045c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc8fc0a5179960455 expref: 15 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779807.006706:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c04413c8200/0xc8fc0a517996045c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a5179960455 expref: 15 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779807.006729:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c04413c8200, rc 0) 00000100:00100000:2.0:1787779807.006801:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471770850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+15:6509:x1874622881487360:12345-0@lo:101: Request processed in 171us (2597us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779807.006808:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1787779807.006897:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047798b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881487360:0@lo:101: 00010000:00010000:2.0:1787779807.006914:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff9c044148ba00/0xc8fc0a5179960455 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a517996045c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779807.006925:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff9c044148ba00/0xc8fc0a5179960455 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc8fc0a517996045c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779807.006994:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0345e74b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881487488:0@lo:501: 00000100:00100000:2.0:1787779807.007028:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779807.007048:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c04778b2900 going to sleep for 11 seconds 00000100:00100000:2.0:1787779807.007072:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881487488 00000100:00100000:2.0:1787779807.007076:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881487488 00000100:00100000:2.0:1787779807.007148:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787779807.007155:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471773450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+15:6509:x1874622881487488:12345-0@lo:501: 00000100:00100000:2.0:1787779807.007260:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471773450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+15:6509:x1874622881487488:12345-0@lo:501: Request processed in 104us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779807.007266:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787779807.007323:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0345e74b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881487488:0@lo:501: 00000100:00100000:2.0:1787779807.007348:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0345e74b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881487616:0@lo:503: 00000100:00100000:2.0:1787779807.007383:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779807.007396:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c04779ae600 going to sleep for 11 seconds 00000100:00100000:3.0:1787779807.007537:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881487616 00000100:00100000:3.0:1787779807.007542:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881487616 00000100:00100000:3.0:1787779807.007574:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787779807.007582:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471772850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+15:6509:x1874622881487616:12345-0@lo:503: 00000100:00100000:3.0:1787779807.007665:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471772850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+15:6509:x1874622881487616:12345-0@lo:503: Request processed in 83us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779807.007672:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787779807.008041:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0345e74b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881487616:0@lo:503: 00000100:00100000:3.0:1787779807.012699:0:8511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477942d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f575176-36bc-4786-83ee-2fea064a12a9:8511:1874622881487744:0@lo:502: 00000100:00100000:3.0:1787779807.012783:0:8511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779807.012828:0:8511:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0445fbfe40 going to sleep for 11 seconds 00000100:00100000:1.0:1787779807.013237:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881487744 00000100:00100000:1.0:1787779807.013244:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881487744 00000100:00100000:1.0:1787779807.013295:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1787779807.013305:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471773c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+15:8511:x1874622881487744:12345-0@lo:502: 00000100:00100000:1.0:1787779807.013425:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471773c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+15:8511:x1874622881487744:12345-0@lo:502: Request processed in 121us (641us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779807.013433:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787779807.013535:0:8511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477942d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f575176-36bc-4786-83ee-2fea064a12a9:8511:1874622881487744:0@lo:502: 00000100:00100000:3.0:1787779807.013581:0:8511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477942d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f575176-36bc-4786-83ee-2fea064a12a9:8511:1874622881487872:0@lo:502: 00000100:00100000:3.0:1787779807.013612:0:8511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779807.013639:0:8511:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0460968d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787779807.013690:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881487872 00000100:00100000:2.0:1787779807.013695:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881487872 00000100:00100000:2.0:1787779807.013725:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1787779807.013731:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471772c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+15:8511:x1874622881487872:12345-0@lo:502: 00000100:00100000:2.0:1787779807.013804:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471772c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+15:8511:x1874622881487872:12345-0@lo:502: Request processed in 73us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779807.013811:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787779807.014013:0:8511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477942d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f575176-36bc-4786-83ee-2fea064a12a9:8511:1874622881487872:0@lo:502: 00000040:00080000:3.0:1787779807.014032:0:8511:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1787779807.014179:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1787779807.014199:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787779807.014208:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c044148ba00/0xc8fc0a5179960455 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a517996045c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779807.014219:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff9c044148ba00/0xc8fc0a5179960455 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a517996045c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787779807.014228:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787779807.014231:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c04764fa000 from 5 10000000:01000000:2.0:1787779807.014234:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787779807.014258:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c04413c9600/0xc8fc0a5179960463 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779807.014266:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff9c04413c9600/0xc8fc0a5179960463 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779807.014275:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff9c04413c9600/0xc8fc0a5179960463 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779807.014287:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0345e74b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881488000:0@lo:101: 00000100:00100000:2.0:1787779807.014338:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779807.014368:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c04779aeb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787779807.014563:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881488000 00000100:00100000:3.0:1787779807.014568:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881488000 00000100:00100000:3.0:1787779807.014604:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787779807.014612:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471773850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+15:6509:x1874622881488000:12345-0@lo:101: 00010000:00010000:3.0:1787779807.014621:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787779807.014634:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c04766dcc00/0xc8fc0a517996046a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc8fc0a5179960463 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779807.014654:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c04766dcc00/0xc8fc0a517996046a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc8fc0a5179960463 expref: 16 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779807.014665:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c04766dcc00/0xc8fc0a517996046a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a5179960463 expref: 16 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779807.014684:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c04766dcc00, rc 0) 00000100:00100000:3.0:1787779807.014717:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471773850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+16:6509:x1874622881488000:12345-0@lo:101: Request processed in 106us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779807.014723:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787779807.016872:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0345e74b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881488000:0@lo:101: 00010000:00010000:2.0:1787779807.016898:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff9c04413c9600/0xc8fc0a5179960463 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a517996046a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779807.016909:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff9c04413c9600/0xc8fc0a5179960463 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc8fc0a517996046a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779807.016969:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0345e74b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881488128:0@lo:256: 00000100:00100000:2.0:1787779807.017023:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779807.017070:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c04779aeb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787779807.019447:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881488128 00000100:00100000:0.0:1787779807.019459:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881488128 00000100:00100000:0.0:1787779807.019502:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787779807.019511:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046098c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+16:6509:x1874622881488128:12345-0@lo:256: 20000000:01000000:0.0:1787779807.019533:0:6505:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787779807.019549:0:6505:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787779807.019552:0:6505:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:0.0:1787779807.019661:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046098c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+16:6509:x1874622881488128:12345-0@lo:256: Request processed in 150us (2637us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779807.019668:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787779807.020448:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0345e74b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881488128:0@lo:256: 10000000:01000000:2.0:1787779807.020500:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787779807.020510:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c04413c9600/0xc8fc0a5179960463 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a517996046a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779807.020522:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff9c04413c9600/0xc8fc0a5179960463 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a517996046a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787779807.020530:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1787779807.020533:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 25 10000000:01000000:2.0:1787779807.020536:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1787779807.020564:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c04413c8000/0xc8fc0a5179960471 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779807.020572:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff9c04413c8000/0xc8fc0a5179960471 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779807.020591:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff9c04413c8000/0xc8fc0a5179960471 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779807.020609:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0345e74b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881488256:0@lo:101: 00000100:00100000:2.0:1787779807.020651:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779807.020689:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c04779aeb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787779807.020948:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881488256 00000100:00100000:3.0:1787779807.020954:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881488256 00000100:00100000:3.0:1787779807.022246:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787779807.022259:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046098e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+16:6509:x1874622881488256:12345-0@lo:101: 00010000:00010000:3.0:1787779807.022274:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787779807.022290:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c04766dc200/0xc8fc0a5179960478 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc8fc0a5179960471 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779807.022326:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c04766dc200/0xc8fc0a5179960478 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc8fc0a5179960471 expref: 17 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779807.022336:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c04766dc200/0xc8fc0a5179960478 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a5179960471 expref: 17 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779807.022345:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c04766dc200, rc 0) 00000100:00100000:3.0:1787779807.022414:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046098e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+17:6509:x1874622881488256:12345-0@lo:101: Request processed in 148us (1752us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779807.022429:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787779807.023115:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0345e74b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881488256:0@lo:101: 00010000:00010000:3.0:1787779807.023135:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff9c04413c8000/0xc8fc0a5179960471 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a5179960478 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779807.023145:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff9c04413c8000/0xc8fc0a5179960471 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc8fc0a5179960478 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779807.023218:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477942d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881488384:0@lo:501: 00000100:00100000:3.0:1787779807.023253:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779807.023392:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0460968d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787779807.026978:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881488384 00000100:00100000:0.0:1787779807.026991:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881488384 00000100:00100000:0.0:1787779807.027050:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787779807.027069:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046098d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+17:6509:x1874622881488384:12345-0@lo:501: 00000100:00100000:0.0:1787779807.027234:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046098d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+17:6509:x1874622881488384:12345-0@lo:501: Request processed in 167us (3980us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779807.027242:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787779807.027339:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477942d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881488384:0@lo:501: 00000100:00100000:3.0:1787779807.027382:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477942d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881488512:0@lo:503: 00000100:00100000:3.0:1787779807.027446:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779807.027485:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0460968d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787779807.027714:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881488512 00000100:00100000:0.0:1787779807.027719:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881488512 00000100:00100000:0.0:1787779807.027750:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787779807.027757:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046098d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+17:6509:x1874622881488512:12345-0@lo:503: 00000100:00100000:0.0:1787779807.027834:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046098d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+17:6509:x1874622881488512:12345-0@lo:503: Request processed in 77us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779807.027867:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787779807.028149:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477942d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881488512:0@lo:503: 00000100:00100000:3.0:1787779807.028585:0:8514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477942d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f575176-36bc-4786-83ee-2fea064a12a9:8514:1874622881488640:0@lo:502: 00000100:00100000:3.0:1787779807.028621:0:8514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779807.028651:0:8514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0476660e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787779807.029807:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881488640 00000100:00100000:0.0:1787779807.029816:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881488640 00000100:00100000:0.0:1787779807.029892:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787779807.029902:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046098f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+17:8514:x1874622881488640:12345-0@lo:502: 00000100:00100000:0.0:1787779807.030038:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046098f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+17:8514:x1874622881488640:12345-0@lo:502: Request processed in 139us (1416us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779807.030046:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787779807.030156:0:8514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477942d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f575176-36bc-4786-83ee-2fea064a12a9:8514:1874622881488640:0@lo:502: 00000020:01000000:3.0:1787779807.030183:0:8514:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787779807.030190:0:8514:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1787779807.030196:0:8514:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787779807.030198:0:8514:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1787779807.030204:0:8514:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787779807.030208:0:8514:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.131@tcp to nid 0x20000c0a8cb83 (192.168.203.131@tcp) 00000020:01000000:3.0:1787779807.030227:0:8514:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1787779807.030229:0:8514:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787779807.030252:0:8514:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9c0476624d28) 00000020:00000080:3.0:1787779807.030271:0:8514:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:3.0:1787779807.030276:0:8514:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787779807.030369:0:8514:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:3.0:1787779807.030375:0:8514:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:3.0:1787779807.030384:0:8514:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xc8fc0a5179960486 00010000:00080000:3.0:1787779807.030609:0:8514:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c04811d9000@lustre-OST0000-osc-MDT0001: add connection 192.168.203.131@tcp at head 00010000:00010000:3.0:1787779807.030825:0:8514:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-7 is initialized 00000040:01000000:3.0:1787779807.041279:0:8514:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1787779807.041311:0:8514:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:3.0:1787779807.041587:0:8514:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787779807.043195:0:8514:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787779807.043361:0:8514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:3.0:1787779807.043479:0:8514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:2.0:1787779807.049710:0:8516:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787779807.049718:0:8516:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1787779807.050690:0:8514:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1787779807.050704:0:8514:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787779807.050747:0:8514:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1787779807.050771:0:8514:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xc8fc0a517996048d 00000100:00080000:1.0:1787779807.050782:0:8514:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787779807.050788:0:8514:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9c04811d9000 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:1.0:1787779807.050824:0:8514:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c047798a940 x1874622881488768/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787779807.050872:0:8514:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:1.0:1787779807.051138:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04779892c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1874622881488896:0@lo:400: 00000100:00100000:1.0:1787779807.051202:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779807.051242:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04619552c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1874622881489408:0@lo:400: 00000100:00100000:1.0:1787779807.051266:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779807.051287:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787779807.051293:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477988000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881489024:0@lo:400: 00000100:00100000:1.0:1787779807.051411:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779807.051434:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477af30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1874622881489536:0@lo:400: 00000100:00100000:1.0:1787779807.051470:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779807.051497:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047798b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874622881489152:0@lo:400: 00000100:00100000:1.0:1787779807.051519:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779807.051541:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787779807.051547:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0461954000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881489280:0@lo:400: 00000100:00100000:1.0:1787779807.051566:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779807.051596:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881488896 00000100:00100000:1.0:1787779807.051602:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881488896 00000100:00100000:1.0:1787779807.051632:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881489408 00000100:00100000:1.0:1787779807.051635:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881489408 00000100:00100000:1.0:1787779807.051664:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881489536 00000100:00100000:1.0:1787779807.051666:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881489536 00000100:00100000:1.0:1787779807.051678:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881489152 00000100:00100000:1.0:1787779807.051681:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881489152 00000100:00100000:1.0:1787779807.051695:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787779807.051702:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477af12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1874622881488896:12345-0@lo:400: 00000100:00100000:1.0:1787779807.051752:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477af12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1874622881488896:12345-0@lo:400: Request processed in 49us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779807.051759:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787779807.051776:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787779807.051782:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477af0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1874622881489408:12345-0@lo:400: 00000100:00100000:1.0:1787779807.051808:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477af0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1874622881489408:12345-0@lo:400: Request processed in 26us (541us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779807.051814:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787779807.051824:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787779807.051829:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477af3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1874622881489536:12345-0@lo:400: 00000100:00100000:1.0:1787779807.051879:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477af3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1874622881489536:12345-0@lo:400: Request processed in 49us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779807.051892:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787779807.051904:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787779807.051910:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477af1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874622881489152:12345-0@lo:400: 00000100:00100000:3.0:1787779807.052109:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047798a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1874622881488768:0@lo:8: 00000100:00100000:3.0:1787779807.052141:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787779807.052332:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787779807.052337:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787779807.052362:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881488768 00000100:00100000:0.0:1787779807.052367:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881488768 00000100:00100000:0.0:1787779807.052399:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787779807.052404:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477942d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3640:x1874622881488768:12345-0@lo:8: 00000100:00100000:1.0:1787779807.052424:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477af1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874622881489152:12345-0@lo:400: Request processed in 32us (423us total) trans 0 rc 0/0 00010000:00080000:0.0:1787779807.052427:0:8427:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 215 last 0 00000100:00100000:1.0:1787779807.052431:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000020:00000080:0.0:1787779807.052460:0:8427:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xc8fc0a5179960494 00000100:00100000:1.0:1787779807.052461:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881489024 00000100:00100000:1.0:1787779807.052464:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881489024 00000100:00100000:1.0:1787779807.052479:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881489280 00000100:00100000:1.0:1787779807.052481:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881489280 00000100:00100000:1.0:1787779807.052491:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787779807.052496:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477af2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881489024:12345-0@lo:400: 00002000:00100000:0.0:1787779807.052502:0:8427:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9c0481213800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113939 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:0.0:1787779807.052506:0:8427:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00000001:00000004:0.0:1787779807.052510:0:8427:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:1.0:1787779807.052529:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477af2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881489024:12345-0@lo:400: Request processed in 33us (1119us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779807.052534:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787779807.052545:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787779807.052550:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477af03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874622881489280:12345-0@lo:400: 00002000:00100000:0.0:1787779807.052563:0:8427:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:1.0:1787779807.052573:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477af03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874622881489280:12345-0@lo:400: Request processed in 24us (1007us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779807.052579:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787779807.052620:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0461954000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881489280:0@lo:400: 00010000:00080000:1.0:1787779807.052632:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c047798b480 x1874622881489152/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779823 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787779807.052641:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047798b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874622881489152:0@lo:400: 00000100:00100000:1.0:1787779807.052671:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477988000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881489024:0@lo:400: 00010000:00080000:1.0:1787779807.052689:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0477af30c0 x1874622881489536/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779823 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787779807.052699:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477af30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1874622881489536:0@lo:400: 00010000:00080000:1.0:1787779807.052709:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c04779892c0 x1874622881488896/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779823 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787779807.052718:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04779892c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1874622881488896:0@lo:400: 00010000:00080000:1.0:1787779807.052727:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c04619552c0 x1874622881489408/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779823 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787779807.052736:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04619552c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1874622881489408:0@lo:400: 00002000:00080000:0.0:1787779807.052760:0:8427:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:0.0:1787779807.052782:0:8427:0:(import.c:65:import_set_state_nolock()) ffff9c0481212800 : changing import state from RECOVER to FULL 00000020:01000000:1.0:1787779807.052808:0:8514:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787779807.052813:0:8514:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787779807.052816:0:8514:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000100:00100000:0.0:1787779807.052817:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477942d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3640:x1874622881488768:12345-0@lo:8: Request processed in 412us (674us total) trans 0 rc 0/0 00000020:01000000:1.0:1787779807.052819:0:8514:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787779807.052822:0:8514:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000100:00100000:0.0:1787779807.052823:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000020:00000080:1.0:1787779807.052824:0:8514:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787779807.052827:0:8514:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787779807.052828:0:8514:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1787779807.052867:0:8514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477af30c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f575176-36bc-4786-83ee-2fea064a12a9:8514:1874622881489664:0@lo:502: 00000100:00100000:1.0:1787779807.052907:0:8514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779807.052925:0:8514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0477ba0300 going to sleep for 11 seconds 00000100:00100000:3.0:1787779807.053106:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881489664 00000100:00100000:3.0:1787779807.053111:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881489664 00000100:00100000:3.0:1787779807.053210:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787779807.053217:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046098c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+17:8514:x1874622881489664:12345-0@lo:502: 00000100:00100000:3.0:1787779807.053310:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046098c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+17:8514:x1874622881489664:12345-0@lo:502: Request processed in 93us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779807.053317:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787779807.055016:0:8514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477af30c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f575176-36bc-4786-83ee-2fea064a12a9:8514:1874622881489664:0@lo:502: 00000020:01000000:1.0:1787779807.055067:0:8514:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787779807.055075:0:8514:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787779807.055077:0:8514:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787779807.055082:0:8514:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 34 count 34 00000020:01000000:0.0:1787779807.055164:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 25-33 (rc=0) 10000000:01000000:0.0:1787779807.055184:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1787779807.055194:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c04413c8000/0xc8fc0a5179960471 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a5179960478 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779807.055205:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff9c04413c8000/0xc8fc0a5179960471 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a5179960478 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787779807.055228:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787779807.055230:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c044407a000 from 30 10000000:01000000:0.0:1787779807.055233:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787779807.055264:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c0440030400/0xc8fc0a517996049b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779807.055271:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff9c0440030400/0xc8fc0a517996049b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779807.055280:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff9c0440030400/0xc8fc0a517996049b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779807.055301:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0461beda40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881489792:0@lo:101: 00000100:00100000:0.0:1787779807.055352:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779807.055391:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0450cc4b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787779807.055936:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881489792 00000100:00100000:3.0:1787779807.055943:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881489792 00000100:00100000:3.0:1787779807.055980:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787779807.055987:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046098f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+17:6509:x1874622881489792:12345-0@lo:101: 00010000:00010000:3.0:1787779807.055999:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787779807.056013:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c04766dd400/0xc8fc0a51799604a2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc8fc0a517996049b expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779807.056035:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c04766dd400/0xc8fc0a51799604a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc8fc0a517996049b expref: 18 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779807.056045:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c04766dd400/0xc8fc0a51799604a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a517996049b expref: 18 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779807.056075:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c04766dd400, rc 0) 00000100:00100000:3.0:1787779807.056118:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046098f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+18:6509:x1874622881489792:12345-0@lo:101: Request processed in 131us (765us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779807.056124:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787779807.056162:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0461beda40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881489792:0@lo:101: 00010000:00010000:3.0:1787779807.056174:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff9c0440030400/0xc8fc0a517996049b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a51799604a2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779807.056183:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff9c0440030400/0xc8fc0a517996049b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xc8fc0a51799604a2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779807.056236:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477940780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881489920:0@lo:501: 00000100:00100000:3.0:1787779807.056260:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779807.056274:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0476660000 going to sleep for 11 seconds 00010000:00080000:3.0:1787779807.056301:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c047798a940 x1874622881488768/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787779817 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779807.056311:0:3640:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787779807.056318:0:3640:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 1 00000100:00080000:3.0:1787779807.056325:0:3640:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787779807.056330:0:3640:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1787779807.056333:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9c04811d9000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1787779807.056344:0:3640:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787779807.056349:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047798a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1874622881488768:0@lo:8: 00000100:00100000:3.0:1787779807.056375:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881489920 00000100:00100000:3.0:1787779807.056378:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881489920 00000100:00100000:3.0:1787779807.056402:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787779807.056407:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046098e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+18:6509:x1874622881489920:12345-0@lo:501: 00000100:00100000:3.0:1787779807.056508:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046098e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+18:6509:x1874622881489920:12345-0@lo:501: Request processed in 100us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779807.056514:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787779807.056537:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477940780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881489920:0@lo:501: 00000100:00100000:3.0:1787779807.056563:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477940780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881490048:0@lo:503: 00000100:00100000:3.0:1787779807.056599:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779807.056613:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0476660000 going to sleep for 11 seconds 00000100:00100000:3.0:1787779807.056623:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881490048 00000100:00100000:3.0:1787779807.056626:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881490048 00000100:00100000:3.0:1787779807.056641:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787779807.056647:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046098fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+18:6509:x1874622881490048:12345-0@lo:503: 00000100:00100000:3.0:1787779807.056718:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046098fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+18:6509:x1874622881490048:12345-0@lo:503: Request processed in 71us (118us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779807.056725:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787779807.056761:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477940780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881490048:0@lo:503: 00000004:00080000:2.0:1787779807.057174:0:8516:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1787779807.057235:0:8516:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 215061395331ns, next at 0ns, rc = 0 00080000:00080000:2.0:1787779807.057241:0:8516:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:2.0:1787779807.058678:0:7442:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:2.0:1787779807.059437:0:8517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0345e761c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8517:1874622881490176:0@lo:700: 00000100:00100000:2.0:1787779807.059503:0:8517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779807.059538:0:8517:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c04779aea80 going to sleep for 11 seconds 00000100:00100000:1.0:1787779807.059653:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881490176 00000100:00100000:1.0:1787779807.059664:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881490176 00000100:00080000:0.0:1787779807.059697:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787779807.059729:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787779807.059738:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0345e77840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:8517:x1874622881490176:12345-0@lo:700: 00000100:00100000:1.0:1787779807.059770:0:8436:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477af0f00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8436:1874622881490304:0@lo:700: 00000100:00100000:1.0:1787779807.059799:0:8436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779807.059816:0:8436:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0477ba0300 going to sleep for 11 seconds 00000100:00100000:1.0:1787779807.059832:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881490304 00000100:00100000:1.0:1787779807.059856:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881490304 00000100:00100000:1.0:1787779807.059884:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787779807.059891:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477af0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8436:x1874622881490304:12345-0@lo:700: 00000100:00100000:2.0:1787779807.067500:0:8520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0345e75680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f575176-36bc-4786-83ee-2fea064a12a9:8520:1874622881490432:0@lo:502: 00000100:00100000:2.0:1787779807.067581:0:8520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779807.067894:0:8520:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c04779ae6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787779807.071632:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881490432 00000100:00100000:0.0:1787779807.071647:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881490432 00000100:00100000:0.0:1787779807.071697:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787779807.071706:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046098ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+18:8520:x1874622881490432:12345-0@lo:502: 00000100:00100000:0.0:1787779807.072890:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046098ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+18:8520:x1874622881490432:12345-0@lo:502: Request processed in 1180us (5304us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779807.072901:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787779807.072998:0:8520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0345e75680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f575176-36bc-4786-83ee-2fea064a12a9:8520:1874622881490432:0@lo:502: 00000100:00100000:0.0:1787779807.073075:0:8520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0461beda40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f575176-36bc-4786-83ee-2fea064a12a9:8520:1874622881490560:0@lo:502: 00000100:00100000:0.0:1787779807.073123:0:8520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779807.073152:0:8520:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0442d4a6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787779807.073381:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881490560 00000100:00100000:2.0:1787779807.073387:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881490560 00000100:00100000:2.0:1787779807.073428:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787779807.073436:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046098f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+18:8520:x1874622881490560:12345-0@lo:502: 00000100:00100000:2.0:1787779807.073528:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046098f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+18:8520:x1874622881490560:12345-0@lo:502: Request processed in 92us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779807.073535:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 40000000:02000000:0.0:1787779807.076188:0:6519:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost 00000100:00100000:0.0:1787779807.081622:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477af0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8436:x1874622881490304:12345-0@lo:700: Request processed in 21723us (21813us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779807.081637:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787779807.081706:0:8436:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0477af0f00 x1874622881490304/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787779823 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787779807.081722:0:8436:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477af0f00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8436:1874622881490304:0@lo:700: 40000000:02000000:0.0:1787779807.081734:0:8436:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] 00000001:00100000:0.0:1787779807.098581:0:8423:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:0.0:1787779807.098698:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0345e77840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:8517:x1874622881490176:12345-0@lo:700: Request processed in 38956us (39190us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779807.098714:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787779807.098767:0:8520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0461beda40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f575176-36bc-4786-83ee-2fea064a12a9:8520:1874622881490560:0@lo:502: 00000040:00080000:0.0:1787779807.098807:0:8520:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1787779807.099049:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1787779807.099081:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787779807.099092:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c0440030400/0xc8fc0a517996049b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a51799604a2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779807.099103:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff9c0440030400/0xc8fc0a517996049b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a51799604a2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787779807.099112:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787779807.099114:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c044407a000 from 5 10000000:01000000:3.0:1787779807.099122:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787779807.099153:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c04766dc600/0xc8fc0a51799604a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779807.099162:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff9c04766dc600/0xc8fc0a51799604a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:2.0:1787779807.099162:0:8517:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0345e761c0 x1874622881490176/t0(0) o700->lustre-OST0000-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787779823 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1787779807.099171:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff9c04766dc600/0xc8fc0a51799604a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779807.099180:0:8517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0345e761c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8517:1874622881490176:0@lo:700: 00000100:00100000:3.0:1787779807.099189:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477940780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881490688:0@lo:101: 00000100:00100000:3.0:1787779807.099231:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779807.099268:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0476660000 going to sleep for 11 seconds 00000100:00100000:3.0:1787779807.099288:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881490688 00000100:00100000:3.0:1787779807.099293:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881490688 00000100:00100000:3.0:1787779807.099397:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1787779807.099406:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046098e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+18:6509:x1874622881490688:12345-0@lo:101: 00010000:00010000:3.0:1787779807.099419:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787779807.099536:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c04766dca00/0xc8fc0a51799604b0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc8fc0a51799604a9 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779807.099560:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c04766dca00/0xc8fc0a51799604b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc8fc0a51799604a9 expref: 19 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779807.099569:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c04766dca00/0xc8fc0a51799604b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a51799604a9 expref: 19 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779807.099578:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c04766dca00, rc 0) 00000100:00100000:3.0:1787779807.099608:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046098e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+19:6509:x1874622881490688:12345-0@lo:101: Request processed in 203us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779807.099623:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1787779807.099656:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477940780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881490688:0@lo:101: 00010000:00010000:3.0:1787779807.099668:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff9c04766dc600/0xc8fc0a51799604a9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a51799604b0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779807.099677:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff9c04766dc600/0xc8fc0a51799604a9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc8fc0a51799604b0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779807.099717:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477940780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881490816:0@lo:256: 00000100:00100000:3.0:1787779807.099745:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779807.099766:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0476660000 going to sleep for 11 seconds 00000100:00100000:3.0:1787779807.099780:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881490816 00000100:00100000:3.0:1787779807.099784:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881490816 00000100:00100000:3.0:1787779807.099806:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1787779807.099812:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046098c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+19:6509:x1874622881490816:12345-0@lo:256: 20000000:01000000:3.0:1787779807.099824:0:6505:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787779807.099860:0:6505:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787779807.099863:0:6505:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:3.0:1787779807.100068:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046098c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+19:6509:x1874622881490816:12345-0@lo:256: Request processed in 128us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779807.100077:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1787779807.100110:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477940780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881490816:0@lo:256: 10000000:01000000:3.0:1787779807.100145:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787779807.100150:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c04766dc600/0xc8fc0a51799604a9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a51799604b0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779807.100159:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff9c04766dc600/0xc8fc0a51799604a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a51799604b0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787779807.100171:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1787779807.100173:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:3.0:1787779807.100176:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1787779807.100192:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c04766dd800/0xc8fc0a51799604b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779807.101219:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff9c04766dd800/0xc8fc0a51799604b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779807.101237:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff9c04766dd800/0xc8fc0a51799604b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779807.101254:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477940780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881490944:0@lo:101: 00000100:00100000:3.0:1787779807.102048:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779807.102098:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0476660000 going to sleep for 11 seconds 00000100:00100000:3.0:1787779807.102119:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881490944 00000100:00100000:3.0:1787779807.102125:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881490944 00000100:00100000:3.0:1787779807.102166:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1787779807.102173:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046098d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+19:6509:x1874622881490944:12345-0@lo:101: 00010000:00010000:3.0:1787779807.102186:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787779807.102202:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c04766dce00/0xc8fc0a51799604be lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xc8fc0a51799604b7 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779807.102225:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c04766dce00/0xc8fc0a51799604be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc8fc0a51799604b7 expref: 20 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779807.102236:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c04766dce00/0xc8fc0a51799604be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a51799604b7 expref: 20 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779807.102255:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c04766dce00, rc 0) 00000100:00100000:3.0:1787779807.102632:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046098d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+20:6509:x1874622881490944:12345-0@lo:101: Request processed in 458us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779807.102640:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1787779807.102686:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477940780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881490944:0@lo:101: 00010000:00010000:3.0:1787779807.102700:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff9c04766dd800/0xc8fc0a51799604b7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a51799604be expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779807.102709:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff9c04766dd800/0xc8fc0a51799604b7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xc8fc0a51799604be expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779807.102772:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477940780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881491072:0@lo:501: 00000100:00100000:3.0:1787779807.102798:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779807.102812:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0476660000 going to sleep for 11 seconds 00000100:00100000:3.0:1787779807.102824:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881491072 00000100:00100000:3.0:1787779807.102828:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881491072 00000100:00100000:3.0:1787779807.102874:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1787779807.102881:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046098cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+20:6509:x1874622881491072:12345-0@lo:501: 00000100:00100000:3.0:1787779807.105155:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046098cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+20:6509:x1874622881491072:12345-0@lo:501: Request processed in 2267us (2350us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779807.105168:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1787779807.105242:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477940780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881491072:0@lo:501: 00000100:00100000:3.0:1787779807.105284:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477940780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881491200:0@lo:503: 00000100:00100000:3.0:1787779807.105325:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779807.105351:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0476660000 going to sleep for 11 seconds 00000100:00100000:3.0:1787779807.105369:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881491200 00000100:00100000:3.0:1787779807.105374:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881491200 00000100:00100000:3.0:1787779807.105405:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1787779807.105412:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046098dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+20:6509:x1874622881491200:12345-0@lo:503: 00000100:00100000:3.0:1787779807.106205:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046098dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+20:6509:x1874622881491200:12345-0@lo:503: Request processed in 790us (878us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779807.106213:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1787779807.106263:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477940780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881491200:0@lo:503: 00000100:00100000:0.0:1787779807.107063:0:8524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0461beda40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f575176-36bc-4786-83ee-2fea064a12a9:8524:1874622881491328:0@lo:502: 00000100:00100000:0.0:1787779807.107120:0:8524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779807.107157:0:8524:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0442d4af00 going to sleep for 11 seconds 00000100:00100000:3.0:1787779807.107562:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881491328 00000100:00100000:3.0:1787779807.107570:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881491328 00000004:00080000:2.0:1787779807.107755:0:8517:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:2.0:1787779807.107773:0:8517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0345e743c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8517:1874622881491584:0@lo:7: 00000100:00100000:2.0:1787779807.107805:0:8517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779807.107828:0:8517:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c04779aea80 going to sleep for 11 seconds 00000100:00100000:3.0:1787779807.108089:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1787779807.108103:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046082b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+20:8524:x1874622881491328:12345-0@lo:502: 00000100:00100000:1.0:1787779807.108201:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0345e761c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881491456:0@lo:13: 00000100:00100000:3.0:1787779807.108215:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046082b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+20:8524:x1874622881491328:12345-0@lo:502: Request processed in 118us (1094us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779807.108223:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1787779807.108233:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779807.108288:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881491584 00000100:00100000:1.0:1787779807.108292:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881491584 00000100:00100000:1.0:1787779807.108320:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787779807.108325:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0345e74f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8517:x1874622881491584:12345-0@lo:7: 00000100:00100000:2.0:1787779807.109112:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881491456 00000100:00100000:2.0:1787779807.109118:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881491456 00000100:00100000:2.0:1787779807.109150:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787779807.109159:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477af2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3641:x1874622881491456:12345-0@lo:13: 00002000:00000024:2.0:1787779807.109177:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923931136 avail 3692408832 00000100:00100000:2.0:1787779807.109225:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477af2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3641:x1874622881491456:12345-0@lo:13: Request processed in 67us (990us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779807.109232:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787779807.110084:0:8524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0461beda40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f575176-36bc-4786-83ee-2fea064a12a9:8524:1874622881491328:0@lo:502: 00000020:01000000:0.0:1787779807.110123:0:8524:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787779807.110131:0:8524:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1787779807.110138:0:8524:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787779807.110140:0:8524:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1787779807.110145:0:8524:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787779807.110150:0:8524:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.131@tcp to nid 0x20000c0a8cb83 (192.168.203.131@tcp) 00000020:01000000:0.0:1787779807.110173:0:8524:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1787779807.110176:0:8524:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787779807.110205:0:8524:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9c0477a18000) 00000020:00000080:0.0:1787779807.110225:0:8524:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:0.0:1787779807.110231:0:8524:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787779807.110324:0:8524:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1787779807.110330:0:8524:0:(osd_handler.c:8925:osd_obd_connect()) connect #6 00000020:00000080:0.0:1787779807.110337:0:8524:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc8fc0a51799604cc 00010000:00080000:0.0:1787779807.110373:0:8524:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c0481216800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.131@tcp at head 00010000:00010000:0.0:1787779807.110614:0:8524:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-8 is initialized 00010000:00080000:3.0:1787779807.114446:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0345e761c0 x1874622881491456/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779823 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779807.114474:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0345e761c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881491456:0@lo:13: 00002000:00080000:1.0:1787779807.117636:0:8430:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:1.0:1787779807.117645:0:8430:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x1:0x0] 00000100:00100000:1.0:1787779807.118865:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0345e74f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8517:x1874622881491584:12345-0@lo:7: Request processed in 10529us (11049us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779807.118878:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000040:01000000:1.0:1787779807.123384:0:8524:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1787779807.123407:0:8524:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1787779807.123615:0:8524:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787779807.126008:0:8524:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787779807.126167:0:8524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:1.0:1787779807.126253:0:8524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00010000:00080000:3.0:1787779807.128216:0:8517:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0345e743c0 x1874622881491584/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787779823 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779807.128236:0:8517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0345e743c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8517:1874622881491584:0@lo:7: 00000004:00080000:3.0:1787779807.128251:0:8517:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x1:0x0] 00000100:00100000:3.0:1787779807.128366:0:8517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477940780 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8517:1874622881491712:0@lo:5: 00000100:00100000:3.0:1787779807.128422:0:8517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779807.128467:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881491712 00000100:00100000:3.0:1787779807.128479:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881491712 00000100:00100000:3.0:1787779807.128529:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787779807.128538:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477940000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8517:x1874622881491712:12345-0@lo:5: 00002000:00080000:3.0:1787779807.128563:0:8428:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:3.0:1787779807.128594:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477940000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8517:x1874622881491712:12345-0@lo:5: Request processed in 57us (172us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779807.128600:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787779807.128627:0:8517:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0476660000 going to sleep for 11 seconds 00010000:00080000:3.0:1787779807.128638:0:8517:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0477940780 x1874622881491712/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787779823 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779807.128646:0:8517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477940780 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8517:1874622881491712:0@lo:5: 00000004:00080000:3.0:1787779807.128654:0:8517:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x1:0x0] from OST, last_created [0x280000400:0x1:0x0]last_used is [0x280000400:0x1:0x0] 00000100:00100000:3.0:1787779807.128672:0:8517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477940780 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8517:1874622881491840:0@lo:5: 00000100:00100000:3.0:1787779807.128689:0:8517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779807.128706:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881491840 00000100:00100000:3.0:1787779807.128709:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881491840 00000100:00100000:3.0:1787779807.128728:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787779807.128734:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477943c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8517:x1874622881491840:12345-0@lo:5: 00002000:00080000:3.0:1787779807.128757:0:8428:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:3.0:1787779807.130324:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477943c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:8517:x1874622881491840:12345-0@lo:5: Request processed in 1586us (1629us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1787779807.130333:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787779807.130399:0:8517:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0476660000 going to sleep for 11 seconds 00010000:00080000:3.0:1787779807.130420:0:8517:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0477940780 x1874622881491840/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787779823 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779807.130434:0:8517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477940780 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8517:1874622881491840:0@lo:5: 00000004:00080000:3.0:1787779807.130455:0:8517:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:3.0:1787779807.130490:0:8517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477943480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8517:1874622881491968:0@lo:900: 00000100:00100000:3.0:1787779807.130519:0:8517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779807.130546:0:8517:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0476660000 going to sleep for 11 seconds 00000100:00100000:2.0:1787779807.131156:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881491968 00000100:00100000:2.0:1787779807.131163:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881491968 00000100:00100000:2.0:1787779807.131203:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787779807.131212:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477941a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8517:x1874622881491968:12345-0@lo:900: 00000100:00100000:2.0:1787779807.131263:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477941a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8517:x1874622881491968:12345-0@lo:900: Request processed in 52us (743us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779807.131270:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000040:00080000:1.0:1787779807.133578:0:8525:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787779807.133587:0:8525:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00010000:00080000:3.0:1787779807.135153:0:8517:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0477943480 x1874622881491968/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787779823 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779807.135171:0:8517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477943480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8517:1874622881491968:0@lo:900: 00000020:00000080:3.0:1787779807.138259:0:8524:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787779807.138274:0:8524:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1787779807.138514:0:8524:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1787779807.138540:0:8524:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc8fc0a51799604d3 00000100:00080000:3.0:1787779807.138551:0:8524:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787779807.138557:0:8524:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9c0481216800 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:3.0:1787779807.138590:0:8524:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c0477943480 x1874622881492096/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787779807.138610:0:8524:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1787779807.138662:0:8524:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787779807.138666:0:8524:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787779807.138668:0:8524:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1787779807.138671:0:8524:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787779807.138675:0:8524:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787779807.138676:0:8524:0:(obd_config.c:1563:class_process_config()) marker 28 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787779807.138679:0:8524:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787779807.138681:0:8524:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1787779807.138707:0:8524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04779412c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f575176-36bc-4786-83ee-2fea064a12a9:8524:1874622881492224:0@lo:502: 00000100:00100000:3.0:1787779807.138783:0:8524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779807.138815:0:8524:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0460968d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787779807.138856:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477943480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1874622881492096:0@lo:8: 00000100:00100000:3.0:1787779807.138887:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779807.138920:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881492224 00000100:00100000:3.0:1787779807.138925:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881492224 00000100:00100000:3.0:1787779807.140184:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1787779807.140198:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0460828850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+20:8524:x1874622881492224:12345-0@lo:502: 00000100:00100000:3.0:1787779807.140358:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0460828850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+20:8524:x1874622881492224:12345-0@lo:502: Request processed in 164us (1574us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779807.140365:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1787779807.141333:0:8524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04779412c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f575176-36bc-4786-83ee-2fea064a12a9:8524:1874622881492224:0@lo:502: 00000020:01000000:2.0:1787779807.141372:0:8524:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787779807.141382:0:8524:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787779807.141384:0:8524:0:(obd_config.c:1563:class_process_config()) marker 28 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787779807.141389:0:8524:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000100:00100000:1.0:1787779807.142273:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881492096 00000100:00100000:1.0:1787779807.142282:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881492096 00000100:00100000:1.0:1787779807.142316:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787779807.142323:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477942580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3640:x1874622881492096:12345-0@lo:8: 00010000:00080000:1.0:1787779807.142351:0:8427:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 215 last 0 00000020:00000080:1.0:1787779807.142378:0:8427:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc8fc0a51799604da 00002000:00100000:1.0:1787779807.142391:0:8427:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9c0341d38000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113939 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1787779807.142396:0:8427:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1787779807.142399:0:8427:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1787779807.142470:0:8427:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787779807.142493:0:8427:0:(import.c:65:import_set_state_nolock()) ffff9c0341d3a800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787779807.142562:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477942580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3640:x1874622881492096:12345-0@lo:8: Request processed in 237us (3674us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779807.142569:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1787779807.142616:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0477943480 x1874622881492096/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787779817 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787779807.142626:0:3640:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787779807.142634:0:3640:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1787779807.142641:0:3640:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1787779807.142646:0:3640:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1787779807.142648:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9c0481216800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1787779807.142657:0:3640:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1787779807.142661:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477943480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1874622881492096:0@lo:8: 00000004:00080000:1.0:1787779807.142691:0:8525:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1787779807.143855:0:8525:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 215148014584ns, next at 0ns, rc = 0 00080000:00080000:1.0:1787779807.143867:0:8525:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:1.0:1787779807.144970:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477af1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881492352:0@lo:13: 00000100:00100000:1.0:1787779807.145037:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779807.145235:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881492352 00000100:00100000:1.0:1787779807.145242:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881492352 00000100:00080000:0.0:1787779807.145273:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787779807.145302:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787779807.145313:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477af3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3642:x1874622881492352:12345-0@lo:13: 00002000:00000024:0.0:1787779807.145333:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923808256 avail 3692285952 00000100:00100000:1.0:1787779807.145351:0:8431:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:1.0:1787779807.145359:0:8431:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:0.0:1787779807.145378:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477af3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3642:x1874622881492352:12345-0@lo:13: Request processed in 67us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779807.145385:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787779807.145424:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0477af1a40 x1874622881492352/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779823 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787779807.145441:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477af1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881492352:0@lo:13: 00000004:00080000:1.0:1787779807.145478:0:8527:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:1.0:1787779807.145499:0:8527:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477af3c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8527:1874622881492480:0@lo:7: 00000100:00100000:1.0:1787779807.145525:0:8527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779807.145541:0:8527:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c04778356c0 going to sleep for 11 seconds 00000004:00080000:2.0:1787779807.146651:0:6491:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000020:01000000:3.0:1787779807.147110:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:3.0:1787779807.147142:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1787779807.147153:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c04766dd800/0xc8fc0a51799604b7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a51799604be expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779807.147166:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff9c04766dd800/0xc8fc0a51799604b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a51799604be expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787779807.147176:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1787779807.147179:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9c04515699b8 from 1 10000000:01000000:3.0:1787779807.147182:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787779807.147213:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c04766dda00/0xc8fc0a51799604e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779807.147222:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff9c04766dda00/0xc8fc0a51799604e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779807.147232:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff9c04766dda00/0xc8fc0a51799604e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779807.147250:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477940f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881492608:0@lo:101: 00000100:00100000:3.0:1787779807.147310:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779807.147344:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c04778dce40 going to sleep for 11 seconds 00000100:00100000:3.0:1787779807.147362:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881492608 00000100:00100000:3.0:1787779807.147368:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881492608 00000100:00100000:3.0:1787779807.147475:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1787779807.147485:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0448bf3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+20:6509:x1874622881492608:12345-0@lo:101: 00010000:00010000:3.0:1787779807.147497:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787779807.147510:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c04766dd000/0xc8fc0a51799604e8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xc8fc0a51799604e1 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779807.147531:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c04766dd000/0xc8fc0a51799604e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc8fc0a51799604e1 expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779807.147541:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c04766dd000/0xc8fc0a51799604e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a51799604e1 expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779807.147549:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c04766dd000, rc 0) 00000100:00100000:3.0:1787779807.147593:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0448bf3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+21:6509:x1874622881492608:12345-0@lo:101: Request processed in 110us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779807.147599:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1787779807.147632:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881492480 00000100:00100000:3.0:1787779807.147636:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881492480 00000100:00100000:3.0:1787779807.147666:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787779807.147672:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477af1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8527:x1874622881492480:12345-0@lo:7: 00000100:00100000:2.0:1787779807.147855:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477940f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881492608:0@lo:101: 00010000:00010000:2.0:1787779807.147868:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff9c04766dda00/0xc8fc0a51799604e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a51799604e8 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779807.147876:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff9c04766dda00/0xc8fc0a51799604e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xc8fc0a51799604e8 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779807.147942:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0345e74780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881492736:0@lo:501: 00000100:00100000:2.0:1787779807.147972:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779807.147999:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c04779ae240 going to sleep for 11 seconds 00000100:00100000:1.0:1787779807.148690:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881492736 00000100:00100000:1.0:1787779807.148697:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881492736 00000100:00100000:1.0:1787779807.148741:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1787779807.148749:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c045ab81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+21:6509:x1874622881492736:12345-0@lo:501: 00000100:00100000:1.0:1787779807.148835:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c045ab81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+21:6509:x1874622881492736:12345-0@lo:501: Request processed in 86us (862us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787779807.148857:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1787779807.148894:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0345e74780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881492736:0@lo:501: 10000000:01000000:1.0:1787779807.148927:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787779807.148936:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c04766dda00/0xc8fc0a51799604e1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a51799604e8 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779807.149019:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff9c04766dda00/0xc8fc0a51799604e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a51799604e8 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1787779807.157373:0:8427:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:2.0:1787779807.157383:0:8427:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:2.0:1787779807.157762:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477af1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8527:x1874622881492480:12345-0@lo:7: Request processed in 10086us (12231us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779807.157778:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1787779807.157886:0:8527:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0477af3c00 x1874622881492480/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787779823 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787779807.157901:0:8527:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477af3c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8527:1874622881492480:0@lo:7: 00000004:00080000:1.0:1787779807.157922:0:8527:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:1.0:1787779807.157958:0:8527:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477af3c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8527:1874622881492864:0@lo:5: 00000100:00100000:1.0:1787779807.158005:0:8527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779807.158026:0:8527:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c04778356c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787779807.158158:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881492864 00000100:00100000:3.0:1787779807.158165:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881492864 00000100:00100000:3.0:1787779807.158212:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787779807.158221:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477af0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8527:x1874622881492864:12345-0@lo:5: 00002000:00080000:3.0:1787779807.158244:0:8428:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1787779807.158253:0:8428:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000001:00080000:1.0:1787779807.162753:0:8423:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00000001:00100000:1.0:1787779807.162772:0:8423:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1787779807.162777:0:8423:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000100:00100000:3.0:1787779807.163073:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477af0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:8527:x1874622881492864:12345-0@lo:5: Request processed in 4848us (5063us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1787779807.163152:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1787779807.163239:0:8527:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0477af3c00 x1874622881492864/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787779823 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787779807.163250:0:8527:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1787779807.163256:0:8527:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477af3c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8527:1874622881492864:0@lo:5: 00000004:00080000:1.0:1787779807.163271:0:8527:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:1.0:1787779807.163328:0:8527:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477af3c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8527:1874622881492992:0@lo:700: 00000100:00100000:1.0:1787779807.163361:0:8527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779807.163390:0:8527:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c04778356c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787779807.163496:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881492992 00000100:00100000:3.0:1787779807.163502:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881492992 00000100:00100000:3.0:1787779807.163544:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787779807.163551:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477af2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8527:x1874622881492992:12345-0@lo:700: 00000100:00100000:1.0:1787779807.176405:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477af2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8527:x1874622881492992:12345-0@lo:700: Request processed in 12846us (13034us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779807.176420:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787779807.176565:0:8527:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0477af3c00 x1874622881492992/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787779823 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779807.176585:0:8527:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477af3c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8527:1874622881492992:0@lo:700: 00000004:02000040:3.0:1787779807.180036:0:8527:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 00000100:00100000:3.0:1787779807.187585:0:8527:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04779403c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8527:1874622881493120:0@lo:5: 00000100:00100000:3.0:1787779807.187655:0:8527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779807.189748:0:8527:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c04778dc3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787779807.192896:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881493120 00000100:00100000:2.0:1787779807.192910:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881493120 00000100:00100000:2.0:1787779807.193069:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787779807.193080:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477941680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:8527:x1874622881493120:12345-0@lo:5: 00002000:00080000:2.0:1787779807.197160:0:8427:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:2.0:1787779807.197182:0:8427:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2 00000100:00100000:2.0:1787779807.201469:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477941680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8527:x1874622881493120:12345-0@lo:5: Request processed in 8384us (13805us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1787779807.201483:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1787779807.201660:0:8527:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c04779403c0 x1874622881493120/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787779823 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779807.201677:0:8527:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04779403c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8527:1874622881493120:0@lo:5: 00000004:00080000:3.0:1787779807.201690:0:8527:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x1:0x0]-[0x280000401:0x21:0x0] 00010000:00010000:1.0:1787779807.328737:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787779808.352631:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787779809.057590:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0461beda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881493248:0@lo:41: 00000100:00100000:0.0:1787779809.057666:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779809.057766:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881493248 00000100:00100000:0.0:1787779809.057778:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881493248 00000100:00100000:0.0:1787779809.057825:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787779809.057834:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0461bed680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881493248:12345-0@lo:41: 00000004:00000024:0.0:1787779809.057892:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:0.0:1787779809.057959:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0461bed680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881493248:12345-0@lo:41: Request processed in 125us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779809.057966:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787779809.058264:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0461beda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881493248:0@lo:41: 00010000:00010000:0.0:1787779809.374614:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787779809.564785:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477af21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881493376:0@lo:41: 00000100:00100000:2.0:1787779809.564881:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779809.564913:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881493376 00000100:00100000:3.0:1787779809.564921:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881493376 00000100:00100000:3.0:1787779809.564969:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787779809.564979:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0345e75e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881493376:12345-0@lo:41: 00000004:00000024:3.0:1787779809.565009:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:2.0:1787779809.565703:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477af21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881493376:0@lo:41: 00000100:00100000:3.0:1787779809.566012:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0345e75e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881493376:12345-0@lo:41: Request processed in 684us (781us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779809.566030:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00010000:1.0:1787779810.404169:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787779811.420997:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787779811.427097:0:8805:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg331-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1787779812.124064:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477942940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881493504:0@lo:13: 00000100:00100000:3.0:1787779812.124303:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779812.124864:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881493504 00000100:00100000:1.0:1787779812.124875:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881493504 00000100:00100000:1.0:1787779812.124961:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787779812.124974:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04779430c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881493504:12345-0@lo:13: 00002000:00000024:1.0:1787779812.125045:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787779812.125114:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04779430c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881493504:12345-0@lo:13: Request processed in 144us (822us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779812.125123:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1787779812.125156:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787779812.125292:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0477942940 x1874622881493504/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779828 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779812.125433:0:3641:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1787779812.125468:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477942940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881493504:0@lo:13: 00000020:00000004:1.0:1787779812.319337:0:8857:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787779812.320121:0:8857:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787779812.448364:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787779812.636676:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477943840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881493632:0@lo:13: 00000100:00100000:3.0:1787779812.636790:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477942940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1f575176-36bc-4786-83ee-2fea064a12a9:3643:1874622881493760:0@lo:400: 00000100:00100000:1.0:1787779812.636797:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779812.636913:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779812.636926:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477940b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1874622881494144:0@lo:400: 00000100:00100000:3.0:1787779812.636970:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477940f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881494272:0@lo:400: 00000100:00100000:1.0:1787779812.636975:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779812.637024:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04779812c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881494656:0@lo:400: 00000100:00100000:3.0:1787779812.637034:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779812.637062:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779812.637129:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04779421c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881494016:0@lo:400: 00000100:00100000:3.0:1787779812.637379:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787779812.637389:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477940780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1874622881493888:0@lo:400: 00000100:00100000:3.0:1787779812.637423:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779812.637457:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779812.637499:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04779412c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1874622881494528:0@lo:400: 00000100:00100000:3.0:1787779812.639658:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477943480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1874622881494400:0@lo:400: 00000100:00100000:1.0:1787779812.639660:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881494144 00000100:00100000:1.0:1787779812.639679:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881494144 00000100:00100000:3.0:1787779812.639733:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779812.640394:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881493760 00000100:00100000:3.0:1787779812.640404:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881493760 00000100:00100000:3.0:1787779812.640452:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1787779812.640462:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c045ab83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+21:3643:x1874622881493760:12345-0@lo:400: 00000100:00100000:3.0:1787779812.640522:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c045ab83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+21:3643:x1874622881493760:12345-0@lo:400: Request processed in 62us (3611us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779812.640529:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1787779812.640637:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881494272 00000100:00100000:3.0:1787779812.640643:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881494272 00000100:00100000:3.0:1787779812.640671:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881494016 00000100:00100000:3.0:1787779812.640675:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881494016 00000100:00100000:3.0:1787779812.640691:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787779812.640903:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477980b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881494272:12345-0@lo:400: 00000100:00100000:2.0:1787779812.640911:0:8529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881493632 00000100:00100000:2.0:1787779812.640915:0:8529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881493632 00000100:00100000:2.0:1787779812.640956:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787779812.640966:0:8529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477af30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3642:x1874622881493632:12345-0@lo:13: 00002000:00000024:2.0:1787779812.640985:0:8529:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787779812.641261:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477980b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881494272:12345-0@lo:400: Request processed in 562us (4227us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779812.641268:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787779812.641284:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787779812.641291:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0461beed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881494016:12345-0@lo:400: 00000100:00100000:2.0:1787779812.641318:0:8529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477af30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3642:x1874622881493632:12345-0@lo:13: Request processed in 355us (4526us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779812.641323:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0461beed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881494016:12345-0@lo:400: Request processed in 34us (3868us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779812.641326:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787779812.641329:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787779812.641367:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1787779812.641400:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0477943840 x1874622881493632/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779828 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787779812.641433:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477943840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881493632:0@lo:13: 00000100:00100000:3.0:1787779812.641644:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04779421c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881494016:0@lo:400: 00000100:00100000:3.0:1787779812.641818:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477942940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1f575176-36bc-4786-83ee-2fea064a12a9:3643:1874622881493760:0@lo:400: 00000100:00100000:3.0:1787779812.641831:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477940f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881494272:0@lo:400: 00000100:00100000:1.0:1787779812.642590:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881493888 00000100:00100000:1.0:1787779812.642602:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881493888 00000100:00100000:1.0:1787779812.642648:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881494528 00000100:00100000:3.0:1787779812.642649:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881494400 00000100:00100000:1.0:1787779812.642655:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881494528 00000100:00100000:3.0:1787779812.642659:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881494400 00000100:00100000:1.0:1787779812.642692:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787779812.642706:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477af3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1874622881494144:12345-0@lo:400: 00000100:00100000:1.0:1787779812.642820:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477af3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1874622881494144:12345-0@lo:400: Request processed in 116us (5848us total) trans 0 rc 0/0 00010000:00080000:0.0:1787779812.642903:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0477940b40 x1874622881494144/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779828 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787779812.642917:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477940b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1874622881494144:0@lo:400: 00000100:00100000:3.0:1787779812.644066:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787779812.644087:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477982940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1874622881493888:12345-0@lo:400: 00000100:00100000:3.0:1787779812.645030:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477982940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1874622881493888:12345-0@lo:400: Request processed in 948us (7601us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779812.645042:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787779812.645070:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787779812.645082:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477981680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1874622881494528:12345-0@lo:400: 00000100:00100000:3.0:1787779812.645733:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477981680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1874622881494528:12345-0@lo:400: Request processed in 654us (4364us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779812.645753:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787779812.645769:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787779812.645776:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477983840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1874622881494400:12345-0@lo:400: 00000100:00100000:3.0:1787779812.645808:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477983840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1874622881494400:12345-0@lo:400: Request processed in 33us (6078us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779812.645813:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787779812.646066:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881494656 00000100:00100000:3.0:1787779812.646074:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881494656 00000100:00100000:3.0:1787779812.646236:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787779812.646245:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477af1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3642:x1874622881494656:12345-0@lo:400: 00000100:00100000:3.0:1787779812.646292:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477af1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3642:x1874622881494656:12345-0@lo:400: Request processed in 49us (9231us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779812.646302:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1787779812.646366:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c04779412c0 x1874622881494528/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779828 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00080000:0.0:1787779812.646373:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0477940780 x1874622881493888/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779828 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779812.646382:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04779412c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1874622881494528:0@lo:400: 00000100:00100000:0.0:1787779812.646411:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477940780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1874622881493888:0@lo:400: 00010000:00080000:0.0:1787779812.646433:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0477943480 x1874622881494400/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779828 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787779812.646444:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477943480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1874622881494400:0@lo:400: 00010000:00080000:3.0:1787779812.646587:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c04779812c0 x1874622881494656/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779828 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779812.646600:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04779812c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881494656:0@lo:400: 00000100:00100000:1.0:1787779812.650776:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:1.0:1787779812.651003:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787779812.651020:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787779812.651026:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:1.0:1787779813.158914:0:8423:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00010000:00010000:1.0:1787779813.468249:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787779814.172259:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787779814.173084:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0461bec780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881494784:0@lo:41: 00000100:00100000:2.0:1787779814.173233:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779814.177315:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881494784 00000100:00100000:3.0:1787779814.177338:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881494784 00000100:00100000:3.0:1787779814.177441:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787779814.177454:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0345e77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881494784:12345-0@lo:41: 00000004:00000024:3.0:1787779814.177511:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:3.0:1787779814.177639:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0345e77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881494784:12345-0@lo:41: Request processed in 187us (4406us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779814.177667:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787779814.177908:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0461bec780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881494784:0@lo:41: 00010000:00010000:0.0:1787779814.498976:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787779814.686281:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477af0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881494912:0@lo:41: 00000100:00100000:2.0:1787779814.686396:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779814.686817:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881494912 00000100:00100000:0.0:1787779814.686828:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881494912 00000100:00100000:0.0:1787779814.686928:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787779814.686938:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0345e74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881494912:12345-0@lo:41: 00000004:00000024:0.0:1787779814.686983:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1787779814.687058:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0345e74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881494912:12345-0@lo:41: Request processed in 121us (662us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779814.687084:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787779814.687366:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477af0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881494912:0@lo:41: 00000020:00000004:2.0:1787779815.185421:0:8958:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787779815.185758:0:8958:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787779815.516580:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1787779816.192742:0:9006:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787779816.192757:0:9006:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:1.0:1787779816.541391:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787779817.246453:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0461bec780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881495040:0@lo:13: 00000100:00100000:3.0:1787779817.246529:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779817.246656:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881495040 00000100:00100000:0.0:1787779817.246665:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881495040 00000100:00100000:0.0:1787779817.246725:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787779817.246736:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04779803c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881495040:12345-0@lo:13: 00002000:00000024:0.0:1787779817.246764:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787779817.246806:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04779803c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881495040:12345-0@lo:13: Request processed in 74us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779817.246813:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1787779817.247341:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787779817.247391:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0461bec780 x1874622881495040/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779833 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779817.247411:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0461bec780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881495040:0@lo:13: 00010000:00010000:2.0:1787779817.564182:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787779817.756207:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04779412c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881495552:0@lo:400: 00000100:00100000:2.0:1787779817.756278:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779817.756351:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477940f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1874622881496064:0@lo:400: 00000100:00100000:2.0:1787779817.756382:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779817.756413:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1787779817.756419:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0461beda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1f575176-36bc-4786-83ee-2fea064a12a9:3641:1874622881495296:0@lo:400: 00000100:00100000:2.0:1787779817.756486:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779817.756511:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477943480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874622881495680:0@lo:400: 00000100:00100000:2.0:1787779817.756533:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779817.756550:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477942940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881496192:0@lo:400: 00000100:00100000:2.0:1787779817.756590:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779817.756618:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0461bec780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874622881495424:0@lo:400: 00000100:00100000:2.0:1787779817.756641:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779817.756660:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477940b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1874622881495936:0@lo:400: 00000100:00100000:2.0:1787779817.756683:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779817.756699:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787779817.756704:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477980f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881495168:0@lo:13: 00000100:00100000:2.0:1787779817.756725:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779817.756742:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477940780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881495808:0@lo:400: 00000100:00100000:2.0:1787779817.756761:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779817.756788:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881495296 00000100:00100000:2.0:1787779817.756795:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881495296 00000100:00100000:2.0:1787779817.756886:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1787779817.756896:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0478612050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+21:3641:x1874622881495296:12345-0@lo:400: 00000100:00100000:2.0:1787779817.756946:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0478612050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+21:3641:x1874622881495296:12345-0@lo:400: Request processed in 51us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779817.756953:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1787779817.757014:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881496064 00000100:00100000:2.0:1787779817.757019:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881496064 00000100:00100000:2.0:1787779817.757053:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881495680 00000100:00100000:2.0:1787779817.757057:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881495680 00000100:00100000:2.0:1787779817.757069:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881495424 00000100:00100000:2.0:1787779817.757078:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881495424 00000100:00100000:2.0:1787779817.757092:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881495936 00000100:00100000:2.0:1787779817.757095:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881495936 00000100:00100000:2.0:1787779817.757111:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787779817.757118:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0345e74780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1874622881496064:12345-0@lo:400: 00000100:00100000:2.0:1787779817.757150:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0345e74780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1874622881496064:12345-0@lo:400: Request processed in 33us (767us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779817.757155:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787779817.757167:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787779817.757172:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0345e743c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874622881495680:12345-0@lo:400: 00000100:00100000:2.0:1787779817.757199:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0345e743c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874622881495680:12345-0@lo:400: Request processed in 27us (665us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779817.757204:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787779817.757215:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787779817.757221:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0345e75680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874622881495424:12345-0@lo:400: 00000100:00100000:2.0:1787779817.757252:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0345e75680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874622881495424:12345-0@lo:400: Request processed in 31us (610us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779817.757258:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787779817.757269:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787779817.757275:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0345e74b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1874622881495936:12345-0@lo:400: 00000100:00100000:2.0:1787779817.757301:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0345e74b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1874622881495936:12345-0@lo:400: Request processed in 27us (617us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779817.757307:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787779817.757326:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881496192 00000100:00100000:2.0:1787779817.757329:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881496192 00000100:00100000:2.0:1787779817.757353:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787779817.757361:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0345e761c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874622881496192:12345-0@lo:400: 00000100:00100000:2.0:1787779817.757401:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0345e761c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874622881496192:12345-0@lo:400: Request processed in 40us (810us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779817.757407:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787779817.757430:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881495168 00000100:00100000:2.0:1787779817.757434:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881495168 00000100:00100000:2.0:1787779817.757456:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787779817.757462:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0345e76d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881495168:12345-0@lo:13: 00002000:00000024:2.0:1787779817.757477:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787779817.757508:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0345e76d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881495168:12345-0@lo:13: Request processed in 46us (781us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779817.757514:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787779817.757533:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881495552 00000100:00100000:2.0:1787779817.757536:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881495552 00000100:00100000:2.0:1787779817.757552:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881495808 00000100:00100000:2.0:1787779817.757555:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881495808 00000100:00100000:2.0:1787779817.757567:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787779817.757573:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0345e76580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881495552:12345-0@lo:400: 00000100:00100000:2.0:1787779817.757605:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0345e76580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881495552:12345-0@lo:400: Request processed in 32us (1327us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779817.757611:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787779817.757623:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787779817.757629:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0345e770c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881495808:12345-0@lo:400: 00000100:00100000:2.0:1787779817.757671:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0345e770c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881495808:12345-0@lo:400: Request processed in 42us (909us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779817.757676:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:2.0:1787779817.757692:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787779817.757696:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787779817.757705:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1787779817.757754:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0477980f00 x1874622881495168/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779833 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787779817.757771:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:2.0:1787779817.757789:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477980f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881495168:0@lo:13: 00000100:00100000:2.0:1787779817.757801:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477940780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881495808:0@lo:400: 00010000:00080000:2.0:1787779817.757809:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0461bec780 x1874622881495424/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779833 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787779817.757818:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0461bec780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874622881495424:0@lo:400: 00010000:00080000:2.0:1787779817.757827:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0477940b40 x1874622881495936/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779833 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787779817.757835:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477940b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1874622881495936:0@lo:400: 00000100:00100000:2.0:1787779817.757894:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0461beda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1f575176-36bc-4786-83ee-2fea064a12a9:3641:1874622881495296:0@lo:400: 00010000:00080000:2.0:1787779817.757904:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0477943480 x1874622881495680/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779833 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787779817.757912:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477943480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874622881495680:0@lo:400: 00010000:00080000:2.0:1787779817.757920:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0477942940 x1874622881496192/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779833 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787779817.757927:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477942940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881496192:0@lo:400: 00000100:00100000:2.0:1787779817.757935:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04779412c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881495552:0@lo:400: 00010000:00080000:2.0:1787779817.757943:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0477940f00 x1874622881496064/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779833 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787779817.757951:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477940f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1874622881496064:0@lo:400: 00010000:00010000:0.0:1787779818.589827:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787779819.292542:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04779421c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881496320:0@lo:41: 00000100:00100000:1.0:1787779819.292612:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779819.292711:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881496320 00000100:00100000:2.0:1787779819.292718:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881496320 00000100:00100000:2.0:1787779819.292770:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787779819.292787:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477af21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881496320:12345-0@lo:41: 00000004:00000024:2.0:1787779819.292822:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:2.0:1787779819.294525:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477af21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881496320:12345-0@lo:41: Request processed in 1733us (1904us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779819.294536:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787779819.294649:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04779421c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881496320:0@lo:41: 00010000:00010000:2.0:1787779819.621884:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787779819.804109:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047798a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881496448:0@lo:41: 00000100:00100000:0.0:1787779819.804182:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779819.804470:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881496448 00000100:00100000:1.0:1787779819.804478:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881496448 00000100:00100000:1.0:1787779819.804530:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787779819.804540:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477943840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881496448:12345-0@lo:41: 00000004:00000024:1.0:1787779819.804581:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1787779819.804635:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477943840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881496448:12345-0@lo:41: Request processed in 96us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779819.804643:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787779819.804812:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047798a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881496448:0@lo:41: 00010000:00010000:2.0:1787779820.641851:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787779821.660187:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787779822.372468:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047798b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881496576:0@lo:13: 00000100:00100000:1.0:1787779822.372535:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779822.372612:0:8529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881496576 00000100:00100000:1.0:1787779822.372620:0:8529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881496576 00000100:00100000:1.0:1787779822.372671:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787779822.372681:0:8529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477988000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881496576:12345-0@lo:13: 00002000:00000024:1.0:1787779822.372709:0:8529:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787779822.372753:0:8529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477988000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881496576:12345-0@lo:13: Request processed in 74us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779822.372760:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:1.0:1787779822.372782:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787779822.372812:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c047798b480 x1874622881496576/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779838 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787779822.372830:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047798b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881496576:0@lo:13: 00010000:00010000:3.0:1787779822.687087:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787779822.878148:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0345e75a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1874622881496832:0@lo:400: 00000100:00100000:2.0:1787779822.878264:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779822.878325:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0461bec780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1874622881497344:0@lo:400: 00000100:00100000:2.0:1787779822.878348:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779822.878378:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787779822.878384:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0345e77c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881496960:0@lo:400: 00000100:00100000:2.0:1787779822.878409:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779822.878425:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c046215de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1874622881497472:0@lo:400: 00000100:00100000:2.0:1787779822.878441:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779822.878465:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881496832 00000100:00100000:2.0:1787779822.878471:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881496832 00000100:00100000:2.0:1787779822.878509:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881497344 00000100:00100000:2.0:1787779822.878511:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881497344 00000100:00100000:2.0:1787779822.878526:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881497472 00000100:00100000:2.0:1787779822.878528:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881497472 00000100:00100000:2.0:1787779822.878541:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787779822.878547:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046215f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1874622881496832:12345-0@lo:400: 00000100:00100000:2.0:1787779822.878603:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046215f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1874622881496832:12345-0@lo:400: Request processed in 55us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779822.878609:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787779822.878623:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787779822.878628:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046215e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1874622881497344:12345-0@lo:400: 00000100:00100000:2.0:1787779822.878646:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046215e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1874622881497344:12345-0@lo:400: Request processed in 19us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779822.878651:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787779822.878658:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787779822.878664:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04618e9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1874622881497472:12345-0@lo:400: 00000100:00100000:2.0:1787779822.878687:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04618e9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1874622881497472:12345-0@lo:400: Request processed in 23us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779822.878692:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:2.0:1787779822.878729:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c046215de00 x1874622881497472/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779838 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787779822.878743:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c046215de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1874622881497472:0@lo:400: 00010000:00080000:2.0:1787779822.878753:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0345e75a40 x1874622881496832/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779838 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787779822.878773:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0345e75a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1874622881496832:0@lo:400: 00010000:00080000:2.0:1787779822.878783:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0461bec780 x1874622881497344/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779838 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787779822.878791:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0461bec780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1874622881497344:0@lo:400: 00000100:00100000:0.0:1787779822.878924:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477af0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874622881497088:0@lo:400: 00000100:00100000:0.0:1787779822.878963:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779822.878987:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c046215e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881497600:0@lo:400: 00000100:00100000:0.0:1787779822.879011:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779822.879031:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787779822.879036:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0345e752c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1f575176-36bc-4786-83ee-2fea064a12a9:3641:1874622881496704:0@lo:400: 00000100:00100000:0.0:1787779822.879059:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779822.879078:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0461beda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881497216:0@lo:400: 00000100:00100000:0.0:1787779822.879094:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779822.879117:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881497600 00000100:00100000:0.0:1787779822.879125:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881497600 00000100:00100000:0.0:1787779822.879154:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787779822.879159:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477942940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1874622881497600:12345-0@lo:400: 00000100:00100000:0.0:1787779822.879188:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477942940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1874622881497600:12345-0@lo:400: Request processed in 29us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779822.879193:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787779822.879209:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881496704 00000100:00100000:0.0:1787779822.879211:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881496704 00000100:00100000:0.0:1787779822.879229:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1787779822.879234:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0478610450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+21:3641:x1874622881496704:12345-0@lo:400: 00000100:00100000:0.0:1787779822.879255:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0478610450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+21:3641:x1874622881496704:12345-0@lo:400: Request processed in 21us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779822.879260:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1787779822.879288:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881496960 00000100:00100000:0.0:1787779822.879293:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881496960 00000100:00100000:0.0:1787779822.879308:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881497216 00000100:00100000:0.0:1787779822.879311:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881497216 00000100:00100000:0.0:1787779822.879324:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787779822.879329:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0458b89680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881496960:12345-0@lo:400: 00000100:00100000:0.0:1787779822.879362:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0458b89680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881496960:12345-0@lo:400: Request processed in 33us (952us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779822.879368:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787779822.879379:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787779822.879385:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477943480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874622881497216:12345-0@lo:400: 00000100:00100000:0.0:1787779822.879416:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477943480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874622881497216:12345-0@lo:400: Request processed in 32us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779822.879422:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787779822.879451:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0345e752c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1f575176-36bc-4786-83ee-2fea064a12a9:3641:1874622881496704:0@lo:400: 00000100:00100000:0.0:1787779822.879468:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0461beda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881497216:0@lo:400: 00010000:00080000:0.0:1787779822.879476:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c046215e940 x1874622881497600/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779838 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787779822.879485:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c046215e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881497600:0@lo:400: 00000100:00100000:0.0:1787779822.879510:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0345e77c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881496960:0@lo:400: 00000100:00100000:2.0:1787779822.879655:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881497088 00000100:00100000:2.0:1787779822.879660:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881497088 00000100:00100000:0.0:1787779822.879741:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787779822.879750:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477981a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881497728:0@lo:13: 00000100:00100000:0.0:1787779822.879785:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779822.879811:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881497728 00000100:00100000:0.0:1787779822.879815:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881497728 00000100:00100000:0.0:1787779822.879863:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787779822.879870:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477940b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874622881497728:12345-0@lo:13: 00002000:00000024:0.0:1787779822.879883:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787779822.879917:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477940b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874622881497728:12345-0@lo:13: Request processed in 48us (131us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779822.879923:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1787779822.879958:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0477981a40 x1874622881497728/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779838 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787779822.879972:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477981a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881497728:0@lo:13: 00000100:00100000:2.0:1787779822.880087:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787779822.880096:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04779412c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874622881497088:12345-0@lo:400: 00000100:00100000:2.0:1787779822.880140:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04779412c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874622881497088:12345-0@lo:400: Request processed in 46us (1176us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779822.880145:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:0.0:1787779822.880198:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0477af0f00 x1874622881497088/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779838 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787779822.880208:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477af0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874622881497088:0@lo:400: 00000100:00080000:1.0:1787779822.880379:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787779822.880384:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787779822.880387:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787779823.710639:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787779824.414256:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787779824.414282:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04618e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881497856:0@lo:41: 00000100:00100000:1.0:1787779824.414419:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779824.414605:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881497856 00000100:00100000:1.0:1787779824.414612:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881497856 00000100:00100000:1.0:1787779824.414656:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787779824.414664:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c047798b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881497856:12345-0@lo:41: 00000004:00000024:1.0:1787779824.414711:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:1.0:1787779824.414757:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c047798b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881497856:12345-0@lo:41: Request processed in 93us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779824.414764:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787779824.414808:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04618e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881497856:0@lo:41: 00010000:00010000:1.0:1787779824.732026:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787779824.924071:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477940f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881497984:0@lo:41: 00000100:00100000:2.0:1787779824.924145:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779824.924308:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881497984 00000100:00100000:0.0:1787779824.924317:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881497984 00000100:00100000:0.0:1787779824.924376:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787779824.924385:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04618e8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881497984:12345-0@lo:41: 00000004:00000024:0.0:1787779824.924419:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1787779824.924477:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04618e8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881497984:12345-0@lo:41: Request processed in 93us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779824.924485:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787779824.924869:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477940f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881497984:0@lo:41: 00000020:01000004:2.0:1787779825.669622:0:9506:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787779825.669627:0:9506:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:2.0:1787779825.669628:0:9506:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1787779825.669769:0:9506:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9c0346bcb000 00000020:01000004:2.0:1787779825.669783:0:9506:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1787779825.669796:0:9506:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1787779825.669808:0:9506:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9c044313cd28) 00000020:00000080:2.0:1787779825.669823:0:9506:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1787779825.731555:0:9506:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:0.0:1787779825.731616:0:9506:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00080000:01000000:2.0:1787779825.769599:0:9506:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1787779825.769785:0:9506:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1787779825.769799:0:9506:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787779825.769811:0:9506:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xc8fc0a51799604f6 00000020:01000004:2.0:1787779825.769818:0:9506:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:2.0:1787779825.769860:0:9506:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.131@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787779825.769864:0:9506:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.131@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787779825.769870:0:9506:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1787779825.769895:0:9506:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:2.0:1787779825.769900:0:9506:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.131@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00010000:00010000:3.0:1787779825.771207:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1787779825.788742:0:9506:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.131@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787779825.788785:0:9506:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.131@tcp, index=0001, flags=0x20062 00000020:01000004:2.0:1787779825.788789:0:9506:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787779825.788790:0:9506:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787779825.788796:0:9506:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787779825.788797:0:9506:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787779825.788798:0:9506:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787779825.788799:0:9506:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787779825.788800:0:9506:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787779825.788802:0:9506:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787779825.788803:0:9506:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787779825.788804:0:9506:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787779825.788805:0:9506:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787779825.788809:0:9506:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:2.0:1787779825.788811:0:9506:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787779825.788812:0:9506:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787779825.788813:0:9506:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787779825.788813:0:9506:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787779825.788814:0:9506:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787779825.788815:0:9506:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787779825.788816:0:9506:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787779825.788817:0:9506:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787779825.788818:0:9506:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787779825.788818:0:9506:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787779825.788819:0:9506:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787779825.789143:0:9506:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1787779825.789227:0:9506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04618e8b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:9506:1874622881498112:0@lo:253: 00000100:00100000:2.0:1787779825.789303:0:9506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779825.789447:0:9506:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0346be29c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787779825.789539:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881498112 00000100:00100000:3.0:1787779825.789546:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881498112 00000100:00100000:3.0:1787779825.789628:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1787779825.789639:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0478611450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+21:9506:x1874622881498112:12345-0@lo:253: 20000000:01000000:3.0:1787779825.789668:0:6506:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1787779825.789672:0:6506:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:3.0:1787779825.789677:0:6506:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:3.0:1787779825.789681:0:6506:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:3.0:1787779825.789989:0:6506:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787779825.790115:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 20000000:01000000:3.0:1787779825.790127:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:3.0:1787779825.790144:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 128 off8544 20000000:01000000:3.0:1787779825.790150:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:3.0:1787779825.790172:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 112 off8656 00000040:00080000:3.0:1787779825.790189:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8880 00000040:00080000:3.0:1787779825.790269:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 20000000:01000000:3.0:1787779825.790291:0:6506:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.131@tcp 20000000:01000000:3.0:1787779825.790293:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.131@tcp (null) (null) (null) 00000040:00080000:3.0:1787779825.790317:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 88 off14232 20000000:01000000:3.0:1787779825.790324:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1787779825.790456:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 144 off14376 20000000:01000000:3.0:1787779825.790464:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.203.131@tcp (null) (null) 00000040:00080000:3.0:1787779825.790480:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 152 off14528 20000000:01000000:3.0:1787779825.790487:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1787779825.790501:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 136 off14664 00000040:00080000:3.0:1787779825.790514:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14888 00000040:00080000:3.0:1787779825.790576:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].34, 224 off14176 20000000:01000000:3.0:1787779825.790585:0:6506:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.131@tcp 20000000:01000000:3.0:1787779825.790587:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.131@tcp (null) (null) (null) 00000040:00080000:3.0:1787779825.790599:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].35, 88 off14264 20000000:01000000:3.0:1787779825.790604:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1787779825.790614:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].36, 144 off14408 20000000:01000000:3.0:1787779825.790618:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf003 lustre-OST0001_UUID 192.168.203.131@tcp (null) (null) 00000040:00080000:3.0:1787779825.790631:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].37, 152 off14560 20000000:01000000:3.0:1787779825.790636:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1787779825.790646:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].38, 136 off14696 00000040:00080000:3.0:1787779825.790660:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].39, 224 off14920 00000040:00080000:3.0:1787779825.791064:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14912 20000000:01000000:3.0:1787779825.791074:0:6506:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.131@tcp 20000000:01000000:3.0:1787779825.791075:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.131@tcp (null) (null) (null) 00000040:00080000:3.0:1787779825.791087:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 88 off15000 20000000:01000000:3.0:1787779825.791091:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1787779825.791102:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 128 off15128 20000000:01000000:3.0:1787779825.791105:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.203.131@tcp (null) (null) 00000040:00080000:3.0:1787779825.791115:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].42, 144 off15272 20000000:01000000:3.0:1787779825.791120:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1787779825.791130:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].43, 128 off15400 00000040:00080000:3.0:1787779825.791142:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].44, 224 off15624 20000000:01000000:3.0:1787779825.791161:0:6506:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1787779825.791163:0:6506:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1787779825.791166:0:6506:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1787779825.791204:0:6506:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1787779825.791207:0:6506:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:1.0:1787779825.797486:0:9512:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 5 count 5 00000040:00080000:3.0:1787779825.798123:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9104 00000040:00080000:3.0:1787779825.798153:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 80 off9184 00000040:00080000:3.0:1787779825.798413:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9408 20000000:01000000:3.0:1787779825.798427:0:6506:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:3.0:1787779825.798430:0:6506:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:1.0:1787779825.798722:0:9513:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 25 1->4: lustre sys.timeout 20000000:01000000:1.0:1787779825.798742:0:9513:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 25 2->4: lustre sys.timeout 00000040:00080000:1.0:1787779825.798758:0:9513:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 40 count 40 00000040:00080000:3.0:1787779825.798982:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].40, 224 off15144 00000040:00080000:3.0:1787779825.799001:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].41, 80 off15224 00000040:00080000:3.0:1787779825.799015:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].42, 224 off15448 20000000:01000000:3.0:1787779825.799024:0:6506:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1787779825.799027:0:6506:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1787779825.799505:0:9514:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 36 marker 26 1->4: lustre sys.timeout 20000000:01000000:1.0:1787779825.799525:0:9514:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 38 marker 26 2->4: lustre sys.timeout 00000040:00080000:1.0:1787779825.799542:0:9514:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000040:00080000:3.0:1787779825.799674:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].45, 224 off15848 00000040:00080000:3.0:1787779825.799692:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].46, 80 off15928 00000040:00080000:3.0:1787779825.799706:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].47, 224 off16152 20000000:01000000:3.0:1787779825.799714:0:6506:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1787779825.799716:0:6506:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1787779825.800489:0:9515:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 27 1->4: lustre sys.timeout 20000000:01000000:1.0:1787779825.800523:0:9515:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 27 2->4: lustre sys.timeout 00000040:00080000:1.0:1787779825.800535:0:9515:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:3.0:1787779825.800689:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:3.0:1787779825.800707:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 80 off9712 00000040:00080000:3.0:1787779825.800719:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9936 20000000:01000000:3.0:1787779825.800729:0:6506:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1787779825.800731:0:6506:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787779825.801234:0:9516:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 28 1->4: lustre sys.timeout 20000000:01000000:2.0:1787779825.801253:0:9516:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 28 2->4: lustre sys.timeout 00000040:00080000:2.0:1787779825.801268:0:9516:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 40 count 40 00000040:00080000:3.0:1787779825.801528:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 224 off15112 00000040:00080000:3.0:1787779825.801549:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 80 off15192 00000040:00080000:3.0:1787779825.801577:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 224 off15416 10000000:01000000:3.0:1787779825.801593:0:6506:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1787779825.801613:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c04766dde00/0xc8fc0a51799604fd lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779825.801629:0:6506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c04413c8e00/0xc8fc0a51799603f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a51799603ec expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779825.801647:0:6506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c04413c9e00/0xc8fc0a517996041d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a5179960416 expref: 21 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779825.801652:0:6506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c04413c8200/0xc8fc0a517996045c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a5179960455 expref: 21 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779825.801658:0:6506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c04766dc200/0xc8fc0a5179960478 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a5179960471 expref: 21 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779825.801664:0:6506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c04766dd400/0xc8fc0a51799604a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a517996049b expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779825.801671:0:6506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c04766dce00/0xc8fc0a51799604be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a51799604b7 expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779825.801676:0:6506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c04766dd000/0xc8fc0a51799604e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a51799604e1 expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779825.801683:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c04766dde00/0xc8fc0a51799604fd lrc: 10/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779825.801719:0:6506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c04766dd000/0xc8fc0a51799604e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc8fc0a51799604e1 expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779825.801733:0:6506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c04766dd000/0xc8fc0a51799604e8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc8fc0a51799604e1 expref: 21 pid: 6506 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779825.801748:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477983c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6506:1874622881498240:0@lo:104: 00000100:00100000:3.0:1787779825.801806:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787779825.802030:0:6506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c04766dce00/0xc8fc0a51799604be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc8fc0a51799604b7 expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779825.802039:0:6506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c04766dce00/0xc8fc0a51799604be lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc8fc0a51799604b7 expref: 21 pid: 6506 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779825.802047:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477980000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6506:1874622881498368:0@lo:104: 00000100:00100000:3.0:1787779825.802081:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787779825.802299:0:6506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c04766dd400/0xc8fc0a51799604a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc8fc0a517996049b expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779825.802308:0:6506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c04766dd400/0xc8fc0a51799604a2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc8fc0a517996049b expref: 21 pid: 6505 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779825.802316:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04779821c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6506:1874622881498496:0@lo:104: 00000100:00100000:3.0:1787779825.802453:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779825.802502:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881498240 00000100:00100000:0.0:1787779825.802508:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881498240 00000100:00100000:0.0:1787779825.802832:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881498368 00000100:00100000:0.0:1787779825.802857:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881498368 00010000:00010000:3.0:1787779825.804199:0:6506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c04766dc200/0xc8fc0a5179960478 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc8fc0a5179960471 expref: 21 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779825.804217:0:6506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c04766dc200/0xc8fc0a5179960478 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc8fc0a5179960471 expref: 21 pid: 6507 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779825.804230:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477983480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6506:1874622881498624:0@lo:104: 00000100:00100000:2.0:1787779825.804245:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881498496 00000100:00100000:2.0:1787779825.804252:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881498496 00000100:00100000:3.0:1787779825.804266:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779825.804286:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881498624 00000100:00100000:2.0:1787779825.804290:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881498624 00010000:00010000:3.0:1787779825.804296:0:6506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c04413c8200/0xc8fc0a517996045c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc8fc0a5179960455 expref: 21 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779825.804306:0:6506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c04413c8200/0xc8fc0a517996045c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc8fc0a5179960455 expref: 21 pid: 6507 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779825.804309:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787779825.804321:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477981e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:1f575176-36bc-4786-83ee-2fea064a12a9+6:6506:x1874622881498240:12345-0@lo:104: 00000100:00100000:3.0:1787779825.804322:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477982580 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6506:1874622881498752:0@lo:104: 00010000:00010000:2.0:1787779825.804335:0:8454:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff9c04766dda00/0xc8fc0a51799604e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xc8fc0a51799604e8 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779825.804367:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787779825.804387:0:6506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c04413c9e00/0xc8fc0a517996041d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc8fc0a5179960416 expref: 21 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779825.804396:0:6506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c04413c9e00/0xc8fc0a517996041d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc8fc0a5179960416 expref: 21 pid: 6507 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779825.804405:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477980f00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6506:1874622881498880:0@lo:104: 00000100:00100000:3.0:1787779825.804425:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787779825.804438:0:6506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c04413c8e00/0xc8fc0a51799603f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc8fc0a51799603ec expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779825.804445:0:6506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c04413c8e00/0xc8fc0a51799603f3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc8fc0a51799603ec expref: 21 pid: 6505 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779825.804453:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04779812c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6506:1874622881499008:0@lo:104: 00000100:00100000:3.0:1787779825.804470:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0346c21840 going to sleep for 11 seconds 00010000:00010000:2.0:1787779825.804472:0:8454:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787779825.804480:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477981e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:1f575176-36bc-4786-83ee-2fea064a12a9+6:6506:x1874622881498240:12345-0@lo:104: Request processed in 161us (2673us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779825.804489:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787779825.804493:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477983c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6506:1874622881498240:0@lo:104: 00000100:00100000:2.0:1787779825.804516:0:8454:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787779825.804535:0:8454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779825.804544:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881498752 00000100:00100000:2.0:1787779825.804547:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881498752 00000100:00100000:2.0:1787779825.804561:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881498880 00000100:00100000:2.0:1787779825.804564:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881498880 00000100:00100000:2.0:1787779825.804572:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881499008 00000100:00100000:2.0:1787779825.804575:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881499008 00000100:00100000:2.0:1787779825.804584:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787779825.804590:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477982d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:1f575176-36bc-4786-83ee-2fea064a12a9+8:6506:x1874622881498368:12345-0@lo:104: 00010000:00010000:2.0:1787779825.804597:0:8454:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff9c04766dd800/0xc8fc0a51799604b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xc8fc0a51799604be expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779825.804644:0:8454:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787779825.804649:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477982d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:1f575176-36bc-4786-83ee-2fea064a12a9+8:6506:x1874622881498368:12345-0@lo:104: Request processed in 59us (2568us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779825.804655:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787779825.804834:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477980000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6506:1874622881498368:0@lo:104: 00000100:00100000:2.0:1787779825.804868:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787779825.805199:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787779825.805210:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477981a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1f575176-36bc-4786-83ee-2fea064a12a9+7:6506:x1874622881498624:12345-0@lo:104: 00010000:00010000:1.0:1787779825.805230:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff9c04413c8000/0xc8fc0a5179960471 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xc8fc0a5179960478 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779825.805284:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1787779825.805290:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477981a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1f575176-36bc-4786-83ee-2fea064a12a9+7:6506:x1874622881498624:12345-0@lo:104: Request processed in 84us (1024us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779825.805297:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787779825.805309:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04779830c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:1f575176-36bc-4786-83ee-2fea064a12a9+6:6506:x1874622881498496:12345-0@lo:104: 00000100:00100000:1.0:1787779825.805316:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00010000:00010000:2.0:1787779825.805320:0:8454:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff9c0440030400/0xc8fc0a517996049b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xc8fc0a51799604a2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779825.805336:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477980780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1f575176-36bc-4786-83ee-2fea064a12a9+6:6506:x1874622881498752:12345-0@lo:104: 00010000:00010000:1.0:1787779825.805347:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff9c044148ba00/0xc8fc0a5179960455 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xc8fc0a517996045c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779825.805357:0:8454:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1787779825.805368:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04779830c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:1f575176-36bc-4786-83ee-2fea064a12a9+6:6506:x1874622881498496:12345-0@lo:104: Request processed in 492us (2915us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779825.805376:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00010000:1.0:1787779825.805386:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:1.0:1787779825.805393:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477980780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1f575176-36bc-4786-83ee-2fea064a12a9+5:6506:x1874622881498752:12345-0@lo:104: Request processed in 70us (1026us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779825.805394:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787779825.805404:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787779825.805419:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787779825.805427:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0461beda40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1f575176-36bc-4786-83ee-2fea064a12a9+4:6506:x1874622881499008:12345-0@lo:104: 00010000:00010000:1.0:1787779825.805434:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff9c0440031a00/0xc8fc0a51799603ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xc8fc0a51799603f3 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779825.805459:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:1.0:1787779825.805464:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0461beda40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1f575176-36bc-4786-83ee-2fea064a12a9+4:6506:x1874622881499008:12345-0@lo:104: Request processed in 39us (930us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779825.805470:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787779825.805475:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0341d6bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:1f575176-36bc-4786-83ee-2fea064a12a9+4:6506:x1874622881498880:12345-0@lo:104: 00010000:00010000:2.0:1787779825.805485:0:8454:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff9c0440031000/0xc8fc0a5179960416 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xc8fc0a517996041d expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779825.805490:0:7453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1787779825.805497:0:7453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff9c04766dda00/0xc8fc0a51799604e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xc8fc0a51799604e8 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779825.805511:0:7453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c04766dda00 already unused, calling callback (ffffffffc139ac20) 10000000:00010000:1.0:1787779825.805516:0:7453:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff9c04766dda00/0xc8fc0a51799604e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xc8fc0a51799604e8 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779825.805521:0:8454:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00010000:00010000:1.0:1787779825.805525:0:7453:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff9c04766dda00/0xc8fc0a51799604e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xc8fc0a51799604e8 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779825.805529:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0341d6bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:1f575176-36bc-4786-83ee-2fea064a12a9+3:6506:x1874622881498880:12345-0@lo:104: Request processed in 125us (1101us total) trans 0 rc 0/0 10000000:00010000:1.0:1787779825.805540:0:7453:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff9c04766dda00/0xc8fc0a51799604e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xc8fc0a51799604e8 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779825.805544:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 10000000:01000000:1.0:1787779825.805552:0:7453:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787779825.805582:0:7453:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff9c04766dda00/0xc8fc0a51799604e1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a51799604e8 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779825.805588:0:7453:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787779825.805606:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1787779825.805607:0:7453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff9c04766dda00/0xc8fc0a51799604e1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a51799604e8 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779825.805613:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff9c04766dd800/0xc8fc0a51799604b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xc8fc0a51799604be expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779825.805618:0:7453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff9c04766dda00/0xc8fc0a51799604e1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a51799604e8 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779825.805624:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c04766dd800 already unused, calling callback (ffffffffc139ac20) 10000000:00010000:2.0:1787779825.805629:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff9c04766dd800/0xc8fc0a51799604b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0xc8fc0a51799604be expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779825.805636:0:7453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1787779825.805637:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff9c04766dd800/0xc8fc0a51799604b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xc8fc0a51799604be expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779825.805642:0:7453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff9c04413c8000/0xc8fc0a5179960471 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xc8fc0a5179960478 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779825.805650:0:7453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c04413c8000 already unused, calling callback (ffffffffc139ac20) 10000000:00010000:1.0:1787779825.805653:0:7453:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff9c04413c8000/0xc8fc0a5179960471 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xc8fc0a5179960478 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779825.805669:0:7453:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff9c04413c8000/0xc8fc0a5179960471 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xc8fc0a5179960478 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787779825.805676:0:7453:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff9c04413c8000/0xc8fc0a5179960471 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xc8fc0a5179960478 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787779825.805682:0:7453:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787779825.805695:0:7453:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff9c04413c8000/0xc8fc0a5179960471 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a5179960478 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779825.805701:0:7453:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787779825.805706:0:7453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff9c04413c8000/0xc8fc0a5179960471 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a5179960478 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779825.805713:0:7453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff9c04413c8000/0xc8fc0a5179960471 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a5179960478 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779825.805722:0:7453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1787779825.805725:0:7453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff9c0440030400/0xc8fc0a517996049b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xc8fc0a51799604a2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779825.805730:0:7453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0440030400 already unused, calling callback (ffffffffc139ac20) 10000000:00010000:1.0:1787779825.805733:0:7453:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff9c0440030400/0xc8fc0a517996049b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xc8fc0a51799604a2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779825.805740:0:7453:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff9c0440030400/0xc8fc0a517996049b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xc8fc0a51799604a2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787779825.805746:0:7453:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff9c0440030400/0xc8fc0a517996049b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xc8fc0a51799604a2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787779825.805756:0:7453:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787779825.805767:0:7453:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff9c0440030400/0xc8fc0a517996049b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a51799604a2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779825.805773:0:7453:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787779825.805785:0:7453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff9c0440030400/0xc8fc0a517996049b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a51799604a2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779825.805792:0:7453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff9c0440030400/0xc8fc0a517996049b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a51799604a2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779825.805800:0:7453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787779825.805803:0:7453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff9c044148ba00/0xc8fc0a5179960455 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc8fc0a517996045c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779825.805808:0:7453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c044148ba00 already unused, calling callback (ffffffffc139ac20) 10000000:00010000:1.0:1787779825.805811:0:7453:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff9c044148ba00/0xc8fc0a5179960455 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xc8fc0a517996045c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779825.805818:0:7453:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff9c044148ba00/0xc8fc0a5179960455 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xc8fc0a517996045c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787779825.805824:0:7453:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff9c044148ba00/0xc8fc0a5179960455 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xc8fc0a517996045c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787779825.805829:0:7453:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787779825.805874:0:7453:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff9c044148ba00/0xc8fc0a5179960455 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a517996045c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779825.805880:0:7453:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787779825.805889:0:7453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff9c044148ba00/0xc8fc0a5179960455 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a517996045c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779825.805895:0:7453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff9c044148ba00/0xc8fc0a5179960455 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a517996045c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779825.805904:0:7453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787779825.805906:0:7453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff9c0440031a00/0xc8fc0a51799603ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc8fc0a51799603f3 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779825.805912:0:7453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0440031a00 already unused, calling callback (ffffffffc139ac20) 10000000:00010000:1.0:1787779825.805915:0:7453:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff9c0440031a00/0xc8fc0a51799603ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xc8fc0a51799603f3 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779825.805933:0:7453:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff9c0440031a00/0xc8fc0a51799603ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xc8fc0a51799603f3 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787779825.805940:0:7453:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff9c0440031a00/0xc8fc0a51799603ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xc8fc0a51799603f3 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787779825.805945:0:7453:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787779825.805956:0:7453:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff9c0440031a00/0xc8fc0a51799603ec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a51799603f3 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779825.805962:0:7453:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787779825.805965:0:7453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff9c0440031a00/0xc8fc0a51799603ec lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a51799603f3 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779825.805972:0:7453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff9c0440031a00/0xc8fc0a51799603ec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a51799603f3 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779825.805980:0:7453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787779825.805987:0:7453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff9c0440031000/0xc8fc0a5179960416 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc8fc0a517996041d expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779825.805993:0:7453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0440031000 already unused, calling callback (ffffffffc139ac20) 10000000:00010000:1.0:1787779825.805996:0:7453:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff9c0440031000/0xc8fc0a5179960416 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc8fc0a517996041d expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779825.806002:0:7453:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff9c0440031000/0xc8fc0a5179960416 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc8fc0a517996041d expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787779825.806008:0:7453:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff9c0440031000/0xc8fc0a5179960416 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc8fc0a517996041d expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787779825.806013:0:7453:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787779825.806022:0:7453:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff9c0440031000/0xc8fc0a5179960416 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a517996041d expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779825.806027:0:7453:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787779825.806030:0:7453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff9c0440031000/0xc8fc0a5179960416 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a517996041d expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779825.806036:0:7453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff9c0440031000/0xc8fc0a5179960416 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a517996041d expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779825.806044:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787779825.806045:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787779825.806047:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787779825.806248:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787779825.806311:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04619552c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1f575176-36bc-4786-83ee-2fea064a12a9:3642:1874622881499264:0@lo:103: 10000000:00010000:2.0:1787779825.806328:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff9c04766dd800/0xc8fc0a51799604b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc8fc0a51799604be expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787779825.806334:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787779825.806356:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff9c04766dd800/0xc8fc0a51799604b7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a51799604be expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779825.806374:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787779825.806380:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff9c04766dd800/0xc8fc0a51799604b7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a51799604be expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779825.806388:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff9c04766dd800/0xc8fc0a51799604b7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a51799604be expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779825.806397:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779825.806427:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346de0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1f575176-36bc-4786-83ee-2fea064a12a9:3642:1874622881499776:0@lo:103: 00000100:00100000:1.0:1787779825.806456:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787779825.806469:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787779825.806472:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787779825.806474:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787779825.806516:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787779825.806522:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04779892c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1f575176-36bc-4786-83ee-2fea064a12a9:3642:1874622881499136:0@lo:103: 00000100:00100000:1.0:1787779825.806540:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779825.806558:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346de03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1f575176-36bc-4786-83ee-2fea064a12a9:3642:1874622881499648:0@lo:103: 00000100:00100000:1.0:1787779825.806577:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779825.806585:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881499264 00000100:00100000:2.0:1787779825.806591:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881499264 00000100:00100000:1.0:1787779825.806601:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0461954000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1f575176-36bc-4786-83ee-2fea064a12a9:3643:1874622881499392:0@lo:103: 00010000:00010000:2.0:1787779825.806615:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c04766dc200/0xc8fc0a5179960478 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc8fc0a5179960471 expref: 22 pid: 6507 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779825.806625:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779825.806639:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0461bec780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1f575176-36bc-4786-83ee-2fea064a12a9:3643:1874622881499904:0@lo:103: 00000100:00100000:2.0:1787779825.806640:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881499776 00000100:00100000:2.0:1787779825.806645:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881499776 00000100:00100000:1.0:1787779825.806661:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779825.806671:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787779825.806675:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346de1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1f575176-36bc-4786-83ee-2fea064a12a9:3643:1874622881499520:0@lo:103: 00000100:00100000:1.0:1787779825.806688:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779825.806709:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881499136 00000100:00100000:1.0:1787779825.806713:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881499136 00010000:00010000:2.0:1787779825.806726:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c04413c9e00/0xc8fc0a517996041d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc8fc0a5179960416 expref: 24 pid: 6507 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779825.806727:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c04766dd000/0xc8fc0a51799604e8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc8fc0a51799604e1 expref: 24 pid: 6506 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779825.806741:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881499648 00000100:00100000:1.0:1787779825.806743:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881499648 00010000:00010000:1.0:1787779825.806751:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c04413c8e00/0xc8fc0a51799603f3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc8fc0a51799603ec expref: 25 pid: 6505 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779825.806759:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881499392 00000100:00100000:1.0:1787779825.806761:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881499392 00010000:00010000:1.0:1787779825.806770:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c04766dd400/0xc8fc0a51799604a2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc8fc0a517996049b expref: 26 pid: 6505 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779825.806777:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881499904 00000100:00100000:1.0:1787779825.806784:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881499904 00010000:00010000:1.0:1787779825.806794:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c04766dce00/0xc8fc0a51799604be lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc8fc0a51799604b7 expref: 27 pid: 6506 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779825.806803:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881499520 00000100:00100000:1.0:1787779825.806805:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881499520 00010000:00010000:1.0:1787779825.806821:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c04413c8200/0xc8fc0a517996045c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc8fc0a5179960455 expref: 28 pid: 6507 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779825.806833:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787779825.806863:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346de0780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1f575176-36bc-4786-83ee-2fea064a12a9+28:3642:x1874622881499264:12345-0@lo:103: 00010000:00010000:1.0:1787779825.806877:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787779825.806882:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c04766dc200/0xc8fc0a5179960478 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc8fc0a5179960471 expref: 28 pid: 6507 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779825.806884:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787779825.806899:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346de1a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1f575176-36bc-4786-83ee-2fea064a12a9+28:3642:x1874622881499136:12345-0@lo:103: 00010000:00010000:1.0:1787779825.806900:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c04766dc200/0xc8fc0a5179960478 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc8fc0a5179960471 expref: 28 pid: 6507 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779825.806914:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787779825.806939:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787779825.806969:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346de0780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1f575176-36bc-4786-83ee-2fea064a12a9+28:3642:x1874622881499264:12345-0@lo:103: Request processed in 108us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779825.806976:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00010000:2.0:1787779825.806991:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c04766dd000/0xc8fc0a51799604e8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc8fc0a51799604e1 expref: 28 pid: 6506 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779825.806991:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787779825.807002:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046099d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1f575176-36bc-4786-83ee-2fea064a12a9+27:3642:x1874622881499648:12345-0@lo:103: 00010000:00010000:2.0:1787779825.807010:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c04766dd000/0xc8fc0a51799604e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc8fc0a51799604e1 expref: 27 pid: 6506 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779825.807011:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787779825.807019:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c04413c8e00/0xc8fc0a51799603f3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc8fc0a51799603ec expref: 27 pid: 6505 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779825.807027:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c04766dd000/0xc8fc0a51799604e8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc8fc0a51799604e1 expref: 27 pid: 6506 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779825.807031:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c04413c8e00/0xc8fc0a51799603f3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc8fc0a51799603ec expref: 27 pid: 6505 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779825.807176:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04779821c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6506:1874622881498496:0@lo:104: 00010000:00010000:3.0:1787779825.807188:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c04766dc200/0xc8fc0a5179960478 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc8fc0a5179960471 expref: 26 pid: 6507 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779825.807202:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477983480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6506:1874622881498624:0@lo:104: 00000100:00100000:3.0:1787779825.807215:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477982580 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6506:1874622881498752:0@lo:104: 00000100:00100000:3.0:1787779825.807222:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477980f00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6506:1874622881498880:0@lo:104: 00000100:00100000:3.0:1787779825.807236:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04779812c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6506:1874622881499008:0@lo:104: 00010000:00010000:2.0:1787779825.807470:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787779825.807501:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346de1a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1f575176-36bc-4786-83ee-2fea064a12a9+25:3642:x1874622881499136:12345-0@lo:103: Request processed in 607us (958us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779825.807509:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787779825.807525:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787779825.807532:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346de3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1f575176-36bc-4786-83ee-2fea064a12a9+24:3643:x1874622881499392:12345-0@lo:103: 00010000:00010000:2.0:1787779825.807540:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787779825.807545:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c04766dd400/0xc8fc0a51799604a2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc8fc0a517996049b expref: 24 pid: 6505 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779825.807554:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c04766dd400/0xc8fc0a51799604a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc8fc0a517996049b expref: 24 pid: 6505 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779825.807565:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c04766dd400/0xc8fc0a51799604a2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc8fc0a517996049b expref: 24 pid: 6505 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779825.807573:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787779825.807600:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346de3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1f575176-36bc-4786-83ee-2fea064a12a9+23:3643:x1874622881499392:12345-0@lo:103: Request processed in 69us (978us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779825.807606:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787779825.807619:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787779825.807625:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346de3c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1f575176-36bc-4786-83ee-2fea064a12a9+22:3643:x1874622881499904:12345-0@lo:103: 00010000:00010000:2.0:1787779825.807633:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787779825.807637:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c04766dce00/0xc8fc0a51799604be lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc8fc0a51799604b7 expref: 22 pid: 6506 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779825.807645:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c04766dce00/0xc8fc0a51799604be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc8fc0a51799604b7 expref: 22 pid: 6506 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779825.807729:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c04766dce00/0xc8fc0a51799604be lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc8fc0a51799604b7 expref: 22 pid: 6506 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779825.807878:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787779825.807905:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346de3c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1f575176-36bc-4786-83ee-2fea064a12a9+21:3643:x1874622881499904:12345-0@lo:103: Request processed in 280us (1243us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779825.807911:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787779825.808004:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787779825.808013:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346de1e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1f575176-36bc-4786-83ee-2fea064a12a9+20:3643:x1874622881499520:12345-0@lo:103: 00010000:00010000:2.0:1787779825.808021:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787779825.808026:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c04413c8200/0xc8fc0a517996045c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc8fc0a5179960455 expref: 20 pid: 6507 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779825.808036:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c04413c8200/0xc8fc0a517996045c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc8fc0a5179960455 expref: 20 pid: 6507 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779825.808047:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c04413c8200/0xc8fc0a517996045c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc8fc0a5179960455 expref: 20 pid: 6507 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779825.808120:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787779825.808144:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346de1e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1f575176-36bc-4786-83ee-2fea064a12a9+19:3643:x1874622881499520:12345-0@lo:103: Request processed in 133us (1454us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779825.808151:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787779825.808166:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787779825.808172:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346de2580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1f575176-36bc-4786-83ee-2fea064a12a9+18:3642:x1874622881499776:12345-0@lo:103: 00010000:00010000:2.0:1787779825.808181:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787779825.808185:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c04413c9e00/0xc8fc0a517996041d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc8fc0a5179960416 expref: 18 pid: 6507 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779825.808201:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c04413c9e00/0xc8fc0a517996041d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc8fc0a5179960416 expref: 18 pid: 6507 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779825.808211:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c04413c9e00/0xc8fc0a517996041d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc8fc0a5179960416 expref: 18 pid: 6507 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779825.808219:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787779825.808241:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346de2580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1f575176-36bc-4786-83ee-2fea064a12a9+17:3642:x1874622881499776:12345-0@lo:103: Request processed in 69us (1785us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779825.808247:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:3.0:1787779825.809157:0:6506:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c04766dde00/0xc8fc0a51799604fd lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779825.809404:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c04413c8e00/0xc8fc0a51799603f3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc8fc0a51799603ec expref: 16 pid: 6505 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779825.809419:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c04766dde00/0xc8fc0a51799604fd lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779825.809428:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c04766dde00/0xc8fc0a51799604fd lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779825.809444:0:6499:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c04766dde00/0xc8fc0a51799604fd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779825.809451:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c04766dde00/0xc8fc0a51799604fd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779825.809458:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c04766dde00/0xc8fc0a51799604fd lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779825.809465:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c04766dde00/0xc8fc0a51799604fd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779825.809470:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c04766dde00 already unused, calling callback (ffffffffc0d97420) 00010000:00010000:1.0:1787779825.809474:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c04766dde00/0xc8fc0a51799604fd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779825.809482:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c04766dde00/0xc8fc0a51799604fd lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779825.809568:0:6506:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c04766dde00/0xc8fc0a51799604fd lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779825.809576:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c04766dde00/0xc8fc0a51799604fd lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787779825.809584:0:6506:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1787779825.811193:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346de1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1f575176-36bc-4786-83ee-2fea064a12a9:3643:1874622881499520:0@lo:103: 00000100:00100000:3.0:1787779825.811207:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0461954000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1f575176-36bc-4786-83ee-2fea064a12a9:3643:1874622881499392:0@lo:103: 00000100:00100000:3.0:1787779825.811215:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0461bec780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1f575176-36bc-4786-83ee-2fea064a12a9:3643:1874622881499904:0@lo:103: 00000100:00100000:3.0:1787779825.811249:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04779892c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1f575176-36bc-4786-83ee-2fea064a12a9:3642:1874622881499136:0@lo:103: 00000100:00100000:3.0:1787779825.811258:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04619552c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1f575176-36bc-4786-83ee-2fea064a12a9:3642:1874622881499264:0@lo:103: 00000100:00100000:3.0:1787779825.811266:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346de0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1f575176-36bc-4786-83ee-2fea064a12a9:3642:1874622881499776:0@lo:103: 00000100:00100000:3.0:1787779825.811692:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0478611450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+15:9506:x1874622881498112:12345-0@lo:253: Request processed in 22052us (22386us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779825.811701:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1787779825.811779:0:9506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04618e8b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:9506:1874622881498112:0@lo:253: 10000000:01000000:2.0:1787779825.811791:0:9506:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1787779825.811794:0:9506:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787779825.811796:0:9506:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787779825.811797:0:9506:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787779825.811799:0:9506:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:2.0:1787779825.811800:0:9506:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787779825.811802:0:9506:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787779825.811803:0:9506:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787779825.811804:0:9506:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1787779825.811806:0:9506:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787779825.811807:0:9506:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787779825.811824:0:9506:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9c0346bcb000 from lustre-OST0001 10000000:01000000:2.0:1787779825.811879:0:9506:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1787779825.811882:0:9506:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1787779825.811890:0:9506:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9c04515699b8 local copy 10000000:01000000:2.0:1787779825.811894:0:9506:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787779825.811939:0:9506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c0477a71200/0xc8fc0a5179960504 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779825.811951:0:9506:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.131@tcp lock: ffff9c0477a71200/0xc8fc0a5179960504 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779825.811970:0:9506:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff9c0477a71200/0xc8fc0a5179960504 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779825.811988:0:9506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0461bec780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:9506:1874622881500032:0@lo:101: 00000100:00100000:2.0:1787779825.812023:0:9506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779825.812218:0:9506:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0346be2600 going to sleep for 11 seconds 00000100:00100000:0.0:1787779825.812397:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881500032 00000100:00100000:0.0:1787779825.812403:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881500032 00000100:00100000:0.0:1787779825.812448:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1787779825.812457:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0478610c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+15:9506:x1874622881500032:12345-0@lo:101: 00010000:00010000:0.0:1787779825.812469:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787779825.812482:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0440031e00/0xc8fc0a517996050b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc8fc0a5179960504 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779825.812504:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0440031e00/0xc8fc0a517996050b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc8fc0a5179960504 expref: 16 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779825.812515:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0440031e00/0xc8fc0a517996050b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a5179960504 expref: 16 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779825.812523:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0440031e00, rc 0) 00000100:00100000:0.0:1787779825.812635:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0478610c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+16:9506:x1874622881500032:12345-0@lo:101: Request processed in 179us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779825.812642:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00010000:00010000:1.0:1787779825.812725:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c04766dde00/0xc8fc0a51799604fd lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779825.812747:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c04766dde00/0xc8fc0a51799604fd lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779825.812760:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787779825.812804:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046099d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1f575176-36bc-4786-83ee-2fea064a12a9+15:3642:x1874622881499648:12345-0@lo:103: Request processed in 5803us (6226us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779825.812812:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787779825.813003:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346de03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1f575176-36bc-4786-83ee-2fea064a12a9:3642:1874622881499648:0@lo:103: 00000100:00100000:3.0:1787779825.813116:0:9506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0461bec780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:9506:1874622881500032:0@lo:101: 00010000:00010000:3.0:1787779825.813128:0:9506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff9c0477a71200/0xc8fc0a5179960504 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xc8fc0a517996050b expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779825.813136:0:9506:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff9c0477a71200/0xc8fc0a5179960504 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xc8fc0a517996050b expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779825.813402:0:9506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04779812c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:9506:1874622881500160:0@lo:501: 00000100:00100000:3.0:1787779825.813433:0:9506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779825.813498:0:9506:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0346c219c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787779825.813644:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881500160 00000100:00100000:2.0:1787779825.813649:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881500160 00000100:00100000:2.0:1787779825.813685:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1787779825.813693:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0478611c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+15:9506:x1874622881500160:12345-0@lo:501: 00000100:00100000:2.0:1787779825.813760:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0478611c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+15:9506:x1874622881500160:12345-0@lo:501: Request processed in 67us (325us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787779825.813766:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1787779825.813875:0:9506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04779812c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:9506:1874622881500160:0@lo:501: 10000000:01000000:3.0:1787779825.813887:0:9506:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.131@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1787779825.813904:0:9506:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.131@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1787779825.813910:0:9506:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c0477a71200/0xc8fc0a5179960504 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xc8fc0a517996050b expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779825.813917:0:9506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c0477a71200/0xc8fc0a5179960504 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xc8fc0a517996050b expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779825.813935:0:9506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.131@tcp lock: ffff9c0477a71200/0xc8fc0a5179960504 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xc8fc0a517996050b expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779825.813958:0:9506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787779825.813981:0:9506:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9c0346bcb000 10000000:01000000:3.0:1787779825.813986:0:9506:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787779825.813991:0:9506:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1787779825.813993:0:9506:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787779825.813997:0:9506:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1787779825.813999:0:9506:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1787779825.814015:0:9506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c04766dc400/0xc8fc0a5179960512 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779825.814022:0:9506:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff9c04766dc400/0xc8fc0a5179960512 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779825.814042:0:9506:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff9c04766dc400/0xc8fc0a5179960512 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779825.814134:0:7453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787779825.814140:0:7453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff9c0477a71200/0xc8fc0a5179960504 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xc8fc0a517996050b expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779825.814147:0:7453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0477a71200 already unused, calling callback (ffffffffc139ac20) 10000000:00010000:0.0:1787779825.814150:0:7453:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff9c0477a71200/0xc8fc0a5179960504 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xc8fc0a517996050b expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779825.814158:0:7453:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff9c0477a71200/0xc8fc0a5179960504 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xc8fc0a517996050b expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787779825.814174:0:7453:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff9c0477a71200/0xc8fc0a5179960504 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xc8fc0a517996050b expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787779825.814180:0:7453:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787779825.814198:0:7453:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff9c0477a71200/0xc8fc0a5179960504 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xc8fc0a517996050b expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779825.814205:0:7453:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787779825.814227:0:7453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff9c0477a71200/0xc8fc0a5179960504 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xc8fc0a517996050b expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779825.814233:0:7453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff9c0477a71200/0xc8fc0a5179960504 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xc8fc0a517996050b expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779825.814244:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787779825.814246:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787779825.814247:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787779825.814254:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787779825.814265:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04779421c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1f575176-36bc-4786-83ee-2fea064a12a9:3643:1874622881500416:0@lo:103: 00000100:00100000:0.0:1787779825.814305:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779825.814358:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881500416 00000100:00100000:0.0:1787779825.814363:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881500416 00000100:00100000:0.0:1787779825.814390:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787779825.814395:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477940f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1f575176-36bc-4786-83ee-2fea064a12a9+15:3643:x1874622881500416:12345-0@lo:103: 00010000:00010000:0.0:1787779825.814404:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787779825.814415:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c0440031e00/0xc8fc0a517996050b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc8fc0a5179960504 expref: 15 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779825.814428:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787779825.814453:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477940f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1f575176-36bc-4786-83ee-2fea064a12a9+14:3643:x1874622881500416:12345-0@lo:103: Request processed in 57us (148us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779825.814459:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787779825.814485:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04779421c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1f575176-36bc-4786-83ee-2fea064a12a9:3643:1874622881500416:0@lo:103: 00000100:00100000:3.0:1787779825.814666:0:9506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04779812c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:9506:1874622881500288:0@lo:101: 00000100:00100000:3.0:1787779825.814695:0:9506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779825.814715:0:9506:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0346c21900 going to sleep for 11 seconds 00000100:00100000:0.0:1787779825.814804:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881500288 00000100:00100000:0.0:1787779825.814808:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881500288 00000100:00100000:0.0:1787779825.814834:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1787779825.814859:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0478610050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+14:9506:x1874622881500288:12345-0@lo:101: 00010000:00010000:0.0:1787779825.814868:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787779825.814879:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0440031200/0xc8fc0a5179960519 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc8fc0a5179960512 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779825.814895:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0440031200/0xc8fc0a5179960519 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc8fc0a5179960512 expref: 15 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779825.814905:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0440031200/0xc8fc0a5179960519 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a5179960512 expref: 15 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779825.814912:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0440031200, rc 0) 00000100:00100000:0.0:1787779825.814952:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0478610050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+15:9506:x1874622881500288:12345-0@lo:101: Request processed in 93us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779825.814964:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1787779825.815028:0:9506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04779812c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:9506:1874622881500288:0@lo:101: 00010000:00010000:3.0:1787779825.815039:0:9506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff9c04766dc400/0xc8fc0a5179960512 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a5179960519 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779825.815047:0:9506:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff9c04766dc400/0xc8fc0a5179960512 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc8fc0a5179960519 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779825.815179:0:9506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04779812c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:9506:1874622881500544:0@lo:501: 00000100:00100000:3.0:1787779825.815201:0:9506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779825.815218:0:9506:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0346c21900 going to sleep for 11 seconds 00000100:00100000:2.0:1787779825.815408:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881500544 00000100:00100000:2.0:1787779825.815413:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881500544 00000100:00100000:2.0:1787779825.815447:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1787779825.815454:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0442d5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+15:9506:x1874622881500544:12345-0@lo:501: 00000100:00100000:2.0:1787779825.815548:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0442d5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+15:9506:x1874622881500544:12345-0@lo:501: Request processed in 94us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779825.815555:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1787779825.815585:0:9506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04779812c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:9506:1874622881500544:0@lo:501: 00000100:00100000:2.0:1787779825.815611:0:9506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0461bec780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:9506:1874622881500672:0@lo:503: 00000100:00100000:2.0:1787779825.815649:0:9506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779825.815667:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881500672 00000100:00100000:2.0:1787779825.815676:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881500672 00000100:00100000:2.0:1787779825.815693:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1787779825.815699:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0442d58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+15:9506:x1874622881500672:12345-0@lo:503: 00000100:00100000:2.0:1787779825.815759:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0442d58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+15:9506:x1874622881500672:12345-0@lo:503: Request processed in 59us (109us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779825.815765:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1787779825.815790:0:9506:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0346be26c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787779825.815799:0:9506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0461bec780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:9506:1874622881500672:0@lo:503: 00000040:00080000:2.0:1787779825.816026:0:9506:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787779825.816146:0:9506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0461bec780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:9506:1874622881500800:0@lo:502: 00000100:00100000:2.0:1787779825.816234:0:9506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779825.816256:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881500800 00000100:00100000:2.0:1787779825.816259:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881500800 00000100:00100000:2.0:1787779825.816403:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1787779825.816411:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0442d59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+15:9506:x1874622881500800:12345-0@lo:502: 00000100:00100000:2.0:1787779825.816477:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0442d59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+15:9506:x1874622881500800:12345-0@lo:502: Request processed in 67us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779825.816483:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1787779825.816512:0:9506:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0346be26c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787779825.816525:0:9506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0461bec780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:9506:1874622881500800:0@lo:502: 00000040:00080000:2.0:1787779825.816739:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1787779825.816762:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1787779825.816774:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1787779825.816785:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1787779825.816796:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1787779825.816807:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1787779825.816825:0:9506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0461bec780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:9506:1874622881500928:0@lo:502: 00000100:00100000:2.0:1787779825.816880:0:9506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779825.816901:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881500928 00000100:00100000:2.0:1787779825.816904:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881500928 00000100:00100000:2.0:1787779825.816933:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1787779825.816940:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0442d58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+15:9506:x1874622881500928:12345-0@lo:502: 00000100:00100000:2.0:1787779825.816997:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0442d58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+15:9506:x1874622881500928:12345-0@lo:502: Request processed in 57us (116us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779825.817004:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1787779825.817032:0:9506:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0346be26c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787779825.817043:0:9506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0461bec780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:9506:1874622881500928:0@lo:502: 00000040:00080000:2.0:1787779825.817432:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1787779825.817442:0:9506:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 8 00000020:01000000:3.0:1787779825.818127:0:9517:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787779825.818135:0:9517:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:3.0:1787779825.818534:0:9517:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787779825.818537:0:9517:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1787779825.818543:0:9517:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787779825.818558:0:9517:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9c0476620000) 00000020:00000080:3.0:1787779825.818580:0:9517:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type obdfilter with refcount 2 00000020:00000080:3.0:1787779825.818586:0:9517:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787779825.818665:0:9517:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c0346bcb000 from lustre-OST0001, refs=2 00080000:01000000:3.0:1787779825.818674:0:9517:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787779825.818681:0:9517:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xc8fc0a5179960527 00010000:00010000:3.0:1787779825.825798:0:9517:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:02000400:3.0:1787779825.826472:0:9517:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:3.0:1787779825.831888:0:9517:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1787779825.832675:0:9517:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:2.0:1787779825.838787:0:9517:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:2.0:1787779825.839117:0:9517:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:2.0:1787779825.847821:0:9517:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:0.0:1787779825.850621:0:9517:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1787779825.850634:0:9517:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787779825.850640:0:9517:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787779825.850643:0:9517:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1787779825.850646:0:9517:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787779825.850650:0:9517:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787779825.850652:0:9517:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787779825.850654:0:9517:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787779825.850656:0:9517:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787779825.850681:0:9517:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787779825.850684:0:9517:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787779825.850686:0:9517:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787779825.850689:0:9517:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1787779825.850827:0:9506:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:3.0:1787779825.850888:0:9506:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1787779825.850915:0:9506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c04766dc400/0xc8fc0a5179960512 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a5179960519 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779825.850935:0:9506:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff9c04766dc400/0xc8fc0a5179960512 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a5179960519 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787779825.850944:0:9506:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c0346bcb000 from 1 10000000:01000000:3.0:1787779825.850947:0:9506:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787779825.850983:0:9506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c04766dc200/0xc8fc0a517996052e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779825.850991:0:9506:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff9c04766dc200/0xc8fc0a517996052e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779825.851002:0:9506:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff9c04766dc200/0xc8fc0a517996052e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779825.851027:0:9506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477980f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:9506:1874622881501056:0@lo:101: 00000100:00100000:3.0:1787779825.851106:0:9506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779825.851166:0:9506:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0346c21780 going to sleep for 11 seconds 00000100:00100000:0.0:1787779825.851338:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881501056 00000100:00100000:0.0:1787779825.851345:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881501056 00000100:00100000:0.0:1787779825.851393:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1787779825.851403:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0442d59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+15:9506:x1874622881501056:12345-0@lo:101: 00010000:00010000:0.0:1787779825.851415:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787779825.851427:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0440031e00/0xc8fc0a5179960535 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc8fc0a517996052e expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779825.851454:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0440031e00/0xc8fc0a5179960535 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc8fc0a517996052e expref: 16 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779825.851465:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0440031e00/0xc8fc0a5179960535 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a517996052e expref: 16 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779825.851472:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0440031e00, rc 0) 00000100:00100000:0.0:1787779825.851514:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0442d59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+16:9506:x1874622881501056:12345-0@lo:101: Request processed in 113us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779825.851527:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1787779825.851573:0:9506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477980f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:9506:1874622881501056:0@lo:101: 00010000:00010000:0.0:1787779825.851587:0:9506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff9c04766dc200/0xc8fc0a517996052e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a5179960535 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779825.851595:0:9506:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff9c04766dc200/0xc8fc0a517996052e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc8fc0a5179960535 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779825.851797:0:9506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04779421c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:9506:1874622881501184:0@lo:501: 00000100:00100000:0.0:1787779825.851823:0:9506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779825.851856:0:9506:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0346bb6000 going to sleep for 11 seconds 00000100:00100000:3.0:1787779825.852037:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881501184 00000100:00100000:3.0:1787779825.852042:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881501184 00000100:00100000:3.0:1787779825.852130:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1787779825.852139:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471775850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+16:9506:x1874622881501184:12345-0@lo:501: 00000100:00100000:3.0:1787779825.852232:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471775850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+16:9506:x1874622881501184:12345-0@lo:501: Request processed in 95us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779825.852250:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1787779825.852433:0:9506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04779421c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:9506:1874622881501184:0@lo:501: 00000100:00100000:1.0:1787779825.852464:0:9506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346de0780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:9506:1874622881501312:0@lo:503: 00000100:00100000:1.0:1787779825.852503:0:9506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779825.852535:0:9506:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0346cc5f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787779825.852581:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881501312 00000100:00100000:3.0:1787779825.852586:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881501312 00000100:00100000:3.0:1787779825.852616:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1787779825.852622:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471775050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+16:9506:x1874622881501312:12345-0@lo:503: 00000100:00100000:3.0:1787779825.852752:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471775050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+16:9506:x1874622881501312:12345-0@lo:503: Request processed in 129us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779825.852758:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1787779825.855092:0:9506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346de0780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:9506:1874622881501312:0@lo:503: 00000040:00080000:1.0:1787779825.855345:0:9506:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787779825.855424:0:9506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346de0780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:9506:1874622881501440:0@lo:502: 00000100:00100000:1.0:1787779825.855505:0:9506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779825.855550:0:9506:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0346cc5f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787779825.855781:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881501440 00000100:00100000:2.0:1787779825.855787:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881501440 00000100:00100000:2.0:1787779825.855859:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1787779825.855868:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471777050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+16:9506:x1874622881501440:12345-0@lo:502: 00000100:00100000:2.0:1787779825.855989:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471777050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+16:9506:x1874622881501440:12345-0@lo:502: Request processed in 123us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779825.855996:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1787779825.856240:0:9506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346de0780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:9506:1874622881501440:0@lo:502: 00000040:00080000:1.0:1787779825.856419:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1787779825.856447:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1787779825.856471:0:9506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346de0780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:9506:1874622881501568:0@lo:502: 00000100:00100000:1.0:1787779825.856506:0:9506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779825.856537:0:9506:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0346cc5f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787779825.856590:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881501568 00000100:00100000:0.0:1787779825.856595:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881501568 00000100:00100000:0.0:1787779825.856629:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1787779825.856637:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471774850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+16:9506:x1874622881501568:12345-0@lo:502: 00000100:00100000:0.0:1787779825.856717:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471774850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+16:9506:x1874622881501568:12345-0@lo:502: Request processed in 80us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779825.856724:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1787779825.857138:0:9506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346de0780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:9506:1874622881501568:0@lo:502: 00000040:00080000:1.0:1787779825.857180:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1787779825.857188:0:9506:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1787779825.857562:0:9521:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787779825.857570:0:9521:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787779825.857573:0:9521:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787779825.857578:0:9521:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c0346bcb000 00000020:00000080:1.0:1787779825.857581:0:9521:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787779825.857591:0:9521:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787779825.857594:0:9521:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787779825.857595:0:9521:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1787779825.857598:0:9521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1787779825.857703:0:9506:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1787779825.857726:0:9506:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787779825.857744:0:9506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c04766dc200/0xc8fc0a517996052e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a5179960535 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779825.857755:0:9506:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff9c04766dc200/0xc8fc0a517996052e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a5179960535 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787779825.857802:0:9506:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787779825.857811:0:9506:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9c0346bcb000 10000000:01000000:0.0:1787779825.857813:0:9506:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9c0346bcb000 10000000:01000000:0.0:1787779825.857817:0:9506:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787779825.857822:0:9506:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c0346bcb000 from 1 10000000:01000000:0.0:1787779825.857825:0:9506:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787779825.857877:0:9506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c0440030200/0xc8fc0a517996053c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779825.857885:0:9506:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff9c0440030200/0xc8fc0a517996053c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779825.857894:0:9506:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff9c0440030200/0xc8fc0a517996053c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779825.858015:0:9506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04779403c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:9506:1874622881501696:0@lo:101: 00000100:00100000:0.0:1787779825.858122:0:9506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779825.858157:0:9506:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0346bb6840 going to sleep for 11 seconds 00000100:00100000:2.0:1787779825.858235:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881501696 00000100:00100000:2.0:1787779825.858241:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881501696 00000100:00100000:2.0:1787779825.858285:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1787779825.858292:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471777450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+16:9506:x1874622881501696:12345-0@lo:101: 00010000:00010000:2.0:1787779825.858311:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787779825.858323:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0477a70800/0xc8fc0a5179960543 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc8fc0a517996053c expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779825.858344:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0477a70800/0xc8fc0a5179960543 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc8fc0a517996053c expref: 17 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779825.858354:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0477a70800/0xc8fc0a5179960543 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a517996053c expref: 17 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779825.858361:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0477a70800, rc 0) 00000100:00100000:2.0:1787779825.858393:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471777450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+17:9506:x1874622881501696:12345-0@lo:101: Request processed in 102us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779825.858399:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1787779825.859448:0:9506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04779403c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:9506:1874622881501696:0@lo:101: 00010000:00010000:0.0:1787779825.859465:0:9506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff9c0440030200/0xc8fc0a517996053c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a5179960543 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779825.859475:0:9506:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff9c0440030200/0xc8fc0a517996053c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc8fc0a5179960543 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779825.859559:0:9506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04779403c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:9506:1874622881501824:0@lo:501: 00000100:00100000:0.0:1787779825.859596:0:9506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779825.859693:0:9506:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0346bb6840 going to sleep for 11 seconds 00000100:00100000:2.0:1787779825.862605:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881501824 00000100:00100000:2.0:1787779825.862619:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881501824 00000100:00100000:2.0:1787779825.862672:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1787779825.862682:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471776850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+17:9506:x1874622881501824:12345-0@lo:501: 00000100:00100000:2.0:1787779825.862863:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471776850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+17:9506:x1874622881501824:12345-0@lo:501: Request processed in 182us (3265us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779825.862871:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1787779825.863087:0:9506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04779403c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:9506:1874622881501824:0@lo:501: 00000100:00100000:3.0:1787779825.863133:0:9506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477982580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:9506:1874622881501952:0@lo:503: 00000100:00100000:3.0:1787779825.863179:0:9506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779825.863209:0:9506:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0346c21480 going to sleep for 11 seconds 00000100:00100000:0.0:1787779825.863638:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881501952 00000100:00100000:0.0:1787779825.863644:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881501952 00000100:00100000:0.0:1787779825.863682:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1787779825.863697:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471777c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+17:9506:x1874622881501952:12345-0@lo:503: 00000100:00100000:0.0:1787779825.863790:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471777c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+17:9506:x1874622881501952:12345-0@lo:503: Request processed in 94us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779825.863798:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1787779825.863914:0:9506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477982580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:9506:1874622881501952:0@lo:503: 00000040:00080000:1.0:1787779825.864142:0:9506:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787779825.864205:0:9506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346de0780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:9506:1874622881502080:0@lo:502: 00000100:00100000:1.0:1787779825.864243:0:9506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779825.864269:0:9506:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0346cc5600 going to sleep for 11 seconds 00000100:00100000:2.0:1787779825.864430:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881502080 00000100:00100000:2.0:1787779825.864441:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881502080 00000100:00100000:2.0:1787779825.864475:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1787779825.864482:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471776c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+17:9506:x1874622881502080:12345-0@lo:502: 00000100:00100000:2.0:1787779825.864564:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471776c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+17:9506:x1874622881502080:12345-0@lo:502: Request processed in 82us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779825.864570:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1787779825.864833:0:9506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346de0780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:9506:1874622881502080:0@lo:502: 00000040:00080000:1.0:1787779825.865171:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1787779825.865200:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1787779825.865215:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1787779825.865232:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1787779825.865246:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1787779825.865287:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1787779825.865302:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1787779825.865315:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1787779825.865328:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1787779825.865342:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1787779825.865355:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1787779825.865366:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1787779825.865378:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1787779825.865392:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1787779825.865405:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1787779825.865418:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1787779825.865441:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1787779825.865455:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1787779825.865469:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1787779825.865482:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1787779825.865494:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1787779825.865518:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1787779825.865534:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1787779825.865547:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1787779825.865560:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:1.0:1787779825.865572:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:1.0:1787779825.865586:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:1.0:1787779825.865598:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:1.0:1787779825.865611:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:1.0:1787779825.865623:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:1.0:1787779825.865635:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:1.0:1787779825.865647:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:1.0:1787779825.865660:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:1.0:1787779825.865672:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:1.0:1787779825.865685:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:1.0:1787779825.865699:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:1.0:1787779825.865711:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000040:00080000:1.0:1787779825.865736:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:1.0:1787779825.865751:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14912 00000040:00080000:1.0:1787779825.865764:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 88 off15000 00000040:00080000:1.0:1787779825.865778:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 128 off15128 00000040:00080000:1.0:1787779825.865790:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 144 off15272 00000040:00080000:1.0:1787779825.865802:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 128 off15400 00000040:00080000:1.0:1787779825.865816:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 224 off15624 00000040:00080000:1.0:1787779825.865829:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15848 00000040:00080000:1.0:1787779825.865880:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 80 off15928 00000100:00100000:1.0:1787779825.866144:0:9506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346de0780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:9506:1874622881502208:0@lo:502: 00000100:00100000:1.0:1787779825.866202:0:9506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779825.866278:0:9506:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0346cc5600 going to sleep for 11 seconds 00000100:00100000:2.0:1787779825.867014:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881502208 00000100:00100000:2.0:1787779825.867022:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881502208 00000100:00100000:2.0:1787779825.867194:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1787779825.867206:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471777850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+17:9506:x1874622881502208:12345-0@lo:502: 00000100:00100000:2.0:1787779825.867325:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471777850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+17:9506:x1874622881502208:12345-0@lo:502: Request processed in 122us (1122us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779825.867333:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1787779825.869192:0:9506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346de0780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:9506:1874622881502208:0@lo:502: 00000040:00080000:1.0:1787779825.869268:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 224 off16152 00000040:00080000:1.0:1787779825.869280:0:9506:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 47 count 48 00000020:01000004:2.0:1787779825.869715:0:9522:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1787779825.869728:0:9522:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9c0443138000) 00000020:00000080:2.0:1787779825.869751:0:9522:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type lwp with refcount 2 00000020:01000004:2.0:1787779825.869833:0:9522:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c0346bcb000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1787779825.870184:0:9522:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c0346bcb000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1787779825.870187:0:9522:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c0346bcb000 3 00010000:00080000:2.0:1787779825.870215:0:9522:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c0346f69000@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.131@tcp at head 00010000:00010000:2.0:1787779825.873303:0:9522:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-9 is initialized 00000020:00000080:2.0:1787779825.873508:0:9522:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1787779825.873550:0:9522:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787779825.873564:0:9522:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xc8fc0a5179960551 00000100:00080000:2.0:1787779825.873574:0:9522:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787779825.873580:0:9522:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9c0346f69000 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:2.0:1787779825.873614:0:9522:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c0461bec780 x1874622881502336/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787779825.873985:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0461bec780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1874622881502336:0@lo:38: 00000100:00100000:1.0:1787779825.874386:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787779825.874456:0:9522:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787779825.876054:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881502336 00000100:00100000:3.0:1787779825.876065:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881502336 00000100:00100000:3.0:1787779825.876100:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787779825.876108:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346de0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3640:x1874622881502336:12345-0@lo:38: 00010000:00080000:3.0:1787779825.876132:0:6512:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 233 last 0 00000100:00100000:0.0:1787779825.876202:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04779421c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874622881502592:0@lo:400: 00000020:00000080:3.0:1787779825.876227:0:6512:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xc8fc0a5179960558 00000004:00100000:3.0:1787779825.876241:0:6512:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:0.0:1787779825.876249:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779825.876271:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347a85e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1874622881503104:0@lo:400: 00000100:00100000:0.0:1787779825.876294:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779825.876312:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1787779825.876317:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04779403c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1874622881502464:0@lo:400: 00000100:00100000:0.0:1787779825.876337:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779825.876353:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347a87c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1874622881502976:0@lo:400: 00000100:00100000:0.0:1787779825.876374:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779825.876392:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477af0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874622881502720:0@lo:400: 00000100:00080000:3.0:1787779825.876395:0:6512:0:(import.c:65:import_set_state_nolock()) ffff9c0481217800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787779825.876413:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779825.876422:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347a84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881503232:0@lo:400: 00000100:00100000:0.0:1787779825.876445:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779825.876463:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787779825.876468:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347a87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881502848:0@lo:400: 00000100:00100000:0.0:1787779825.876488:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779825.876557:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347a86d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881503360:0@lo:400: 00000100:00100000:0.0:1787779825.876586:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779825.876611:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881502592 00000100:00100000:0.0:1787779825.876614:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881502592 00000100:00100000:0.0:1787779825.876632:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881502848 00000100:00100000:0.0:1787779825.876634:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881502848 00000100:00100000:0.0:1787779825.876656:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787779825.876661:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347a861c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1874622881502592:12345-0@lo:400: 00000100:00100000:0.0:1787779825.876701:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347a861c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1874622881502592:12345-0@lo:400: Request processed in 39us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779825.876708:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787779825.876724:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787779825.876731:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347a85680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881502848:12345-0@lo:400: 00000100:00100000:0.0:1787779825.876761:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347a85680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881502848:12345-0@lo:400: Request processed in 30us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779825.876766:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787779825.876782:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881503104 00000100:00100000:0.0:1787779825.876785:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881503104 00000100:00100000:0.0:1787779825.876809:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881502464 00000100:00100000:0.0:1787779825.876812:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881502464 00000100:00100000:0.0:1787779825.876821:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881502976 00000100:00100000:0.0:1787779825.876823:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881502976 00000100:00100000:0.0:1787779825.876834:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881502720 00000100:00100000:0.0:1787779825.876855:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881502720 00000100:00100000:0.0:1787779825.876869:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787779825.876875:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347a870c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1874622881503104:12345-0@lo:400: 00000100:00100000:0.0:1787779825.876918:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347a870c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1874622881503104:12345-0@lo:400: Request processed in 43us (623us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779825.876932:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787779825.876944:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787779825.876950:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347a852c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1874622881502464:12345-0@lo:400: 00000100:00100000:0.0:1787779825.876976:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347a852c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1874622881502464:12345-0@lo:400: Request processed in 26us (637us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779825.876981:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787779825.876999:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787779825.877005:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347a84b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1874622881502976:12345-0@lo:400: 00000100:00100000:0.0:1787779825.877031:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347a84b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1874622881502976:12345-0@lo:400: Request processed in 26us (657us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779825.877036:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787779825.877048:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787779825.877119:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347a86940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1874622881502720:12345-0@lo:400: 00000100:00100000:0.0:1787779825.877148:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347a86940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1874622881502720:12345-0@lo:400: Request processed in 30us (733us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779825.877153:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787779825.877174:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881503232 00000100:00100000:0.0:1787779825.877178:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881503232 00000100:00100000:0.0:1787779825.877200:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881503360 00000100:00100000:0.0:1787779825.877203:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881503360 00000100:00100000:0.0:1787779825.877217:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787779825.877223:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347a87840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881503232:12345-0@lo:400: 00000100:00100000:0.0:1787779825.877256:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347a87840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881503232:12345-0@lo:400: Request processed in 33us (810us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779825.877262:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787779825.877273:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787779825.877279:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347a843c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881503360:12345-0@lo:400: 00000100:00100000:0.0:1787779825.877305:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347a843c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881503360:12345-0@lo:400: Request processed in 26us (718us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779825.877310:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1787779825.877332:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787779825.877336:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787779825.877338:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787779825.877374:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347a87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881502848:0@lo:400: 00010000:00080000:0.0:1787779825.877388:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0347a86d00 x1874622881503360/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779841 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787779825.877397:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347a86d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881503360:0@lo:400: 00010000:00080000:0.0:1787779825.877406:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0477af0f00 x1874622881502720/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779841 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787779825.877415:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477af0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874622881502720:0@lo:400: 00010000:00080000:0.0:1787779825.877423:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0347a84000 x1874622881503232/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779841 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787779825.877431:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347a84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881503232:0@lo:400: 00010000:00080000:0.0:1787779825.877463:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c04779403c0 x1874622881502464/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779841 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787779825.877472:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04779403c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1874622881502464:0@lo:400: 00010000:00080000:0.0:1787779825.877480:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0347a87c00 x1874622881502976/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779841 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787779825.877487:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347a87c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1874622881502976:0@lo:400: 00000100:00100000:0.0:1787779825.877496:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04779421c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874622881502592:0@lo:400: 00010000:00080000:0.0:1787779825.877504:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0347a85e00 x1874622881503104/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779841 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787779825.877512:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347a85e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1874622881503104:0@lo:400: 00000100:00100000:3.0:1787779825.879564:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346de0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1874622881502336:12345-0@lo:38: Request processed in 3449us (5172us total) trans 0 rc 0/0 00010000:00080000:1.0:1787779825.879564:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0461bec780 x1874622881502336/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787779835 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779825.879575:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787779825.879576:0:3640:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787779825.879584:0:3640:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:1.0:1787779825.879591:0:3640:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1787779825.879595:0:3640:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787779825.879598:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9c0346f69000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787779825.879604:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0461bec780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1874622881502336:0@lo:38: 00000020:01000004:0.0:1787779825.880137:0:9522:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1787779825.880153:0:9522:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff9c0477a1b370) 00000020:00000080:0.0:1787779825.880181:0:9522:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type lwp with refcount 2 00000020:01000004:0.0:1787779825.880257:0:9522:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c0346bcb000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787779825.880261:0:9522:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c0346bcb000 from lustre-OST0001, refs=3 00000100:00100000:3.0:1787779825.880262:0:9524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477983480 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9524:1874622881503488:0@lo:901: 00000020:01000004:0.0:1787779825.880264:0:9522:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c0346bcb000 3 00010000:00080000:0.0:1787779825.880290:0:9522:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c048124a000@lustre-MDT0001-lwp-OST0001: add connection 192.168.203.131@tcp at head 00000100:00100000:3.0:1787779825.880787:0:9524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779825.880834:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881503488 00000100:00100000:3.0:1787779825.880860:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881503488 00000100:00080000:0.0:1787779825.880892:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787779825.880910:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787779825.880918:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04779821c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9524:x1874622881503488:12345-0@lo:901: 00000100:00100000:3.0:1787779825.881008:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04779821c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9524:x1874622881503488:12345-0@lo:901: Request processed in 91us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779825.881015:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787779825.881037:0:9524:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0346c21900 going to sleep for 11 seconds 00010000:00010000:0.0:1787779825.881900:0:9522:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-10 is initialized 00010000:00080000:3.0:1787779825.881963:0:9524:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0477983480 x1874622881503488/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1787779841 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779825.881977:0:9524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477983480 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9524:1874622881503488:0@lo:901: 00000020:00000080:2.0:1787779825.890495:0:9522:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:2.0:1787779825.890547:0:9522:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787779825.890560:0:9522:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xc8fc0a5179960566 00000100:00080000:2.0:1787779825.890571:0:9522:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787779825.890576:0:9522:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9c048124a000 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:2.0:1787779825.890617:0:9522:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c0461bec780 x1874622881503616/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787779825.890642:0:9522:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:1.0:1787779825.891023:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0461bec780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3640:1874622881503616:0@lo:38: 00000100:00100000:1.0:1787779825.891093:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779825.891429:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881503616 00000100:00100000:2.0:1787779825.891437:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881503616 00000100:00100000:2.0:1787779825.891469:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787779825.891476:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346de1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3640:x1874622881503616:12345-0@lo:38: 00010000:00080000:2.0:1787779825.891500:0:7821:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 233 last 0 00000020:00000080:2.0:1787779825.894240:0:7821:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xc8fc0a517996056d 00000004:00100000:2.0:1787779825.894314:0:7821:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787779825.894357:0:7821:0:(import.c:65:import_set_state_nolock()) ffff9c0346bca000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787779825.894451:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346de1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1874622881503616:12345-0@lo:38: Request processed in 2972us (3355us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779825.894461:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000040:00080000:2.0:1787779825.894584:0:9522:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00010000:00080000:0.0:1787779825.894782:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0461bec780 x1874622881503616/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787779835 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787779825.894794:0:3640:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787779825.894801:0:3640:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 1 00000100:00080000:0.0:1787779825.894809:0:3640:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787779825.894813:0:3640:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1787779825.894816:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9c048124a000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787779825.894822:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0461bec780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3640:1874622881503616:0@lo:38: 00000020:01000000:1.0:1787779825.895579:0:9506:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-47 (rc=0) 10000000:01000000:1.0:1787779825.895618:0:9506:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787779825.895640:0:9506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c0440030200/0xc8fc0a517996053c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a5179960543 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779825.895651:0:9506:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff9c0440030200/0xc8fc0a517996053c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a5179960543 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787779825.895697:0:9506:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787779825.895699:0:9506:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787779825.895700:0:9506:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787779825.895705:0:9506:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787779825.895707:0:9506:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787779825.895708:0:9506:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787779825.895709:0:9506:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787779825.895710:0:9506:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787779825.895712:0:9506:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787779825.895713:0:9506:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787779825.895714:0:9506:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787779825.895718:0:9506:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:1.0:1787779825.895720:0:9506:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787779825.895722:0:9506:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787779825.895723:0:9506:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787779825.895723:0:9506:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787779825.895724:0:9506:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787779825.895725:0:9506:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787779825.895727:0:9506:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787779825.895727:0:9506:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787779825.895728:0:9506:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787779825.895729:0:9506:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787779825.895730:0:9506:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787779825.895750:0:9506:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1787779825.895764:0:9506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346de2580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:9506:1874622881503744:0@lo:253: 00000100:00100000:1.0:1787779825.895815:0:9506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779825.895867:0:9506:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0346cc5f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787779825.895886:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881503744 00000100:00100000:1.0:1787779825.895892:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881503744 00000100:00100000:1.0:1787779825.896170:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1787779825.896179:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471776050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+17:9506:x1874622881503744:12345-0@lo:253: 20000000:01000000:1.0:1787779825.896202:0:6507:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1787779825.896214:0:6507:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1787779825.902061:0:6507:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787779825.902079:0:6507:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1787779825.902194:0:6528:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787779825.902199:0:6528:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787779825.902222:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c0477a70c00/0xc8fc0a5179960574 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779825.902240:0:6528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c04766dcc00/0xc8fc0a517996046a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a5179960463 expref: 17 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779825.902249:0:6528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c04766dca00/0xc8fc0a51799604b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a51799604a9 expref: 17 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779825.902267:0:6528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c0477a70c00/0xc8fc0a5179960574 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779825.902321:0:6528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c04766dca00/0xc8fc0a51799604b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc8fc0a51799604a9 expref: 17 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779825.902335:0:6528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c04766dca00/0xc8fc0a51799604b0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc8fc0a51799604a9 expref: 17 pid: 6507 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779825.902349:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0461bec780 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6528:1874622881503872:0@lo:104: 00000100:00100000:2.0:1787779825.902413:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787779825.902467:0:6528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c04766dcc00/0xc8fc0a517996046a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc8fc0a5179960463 expref: 17 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779825.902475:0:6528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c04766dcc00/0xc8fc0a517996046a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc8fc0a5179960463 expref: 17 pid: 6505 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779825.902483:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0345e76940 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6528:1874622881504000:0@lo:104: 00000100:00100000:2.0:1787779825.902501:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779825.902523:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0346cc9900 going to sleep for 11 seconds 00000100:00100000:0.0:1787779825.902660:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881503872 00000100:00100000:0.0:1787779825.902668:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881503872 00000100:00100000:0.0:1787779825.902713:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881504000 00000100:00100000:0.0:1787779825.902716:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881504000 00000100:00100000:0.0:1787779825.902731:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787779825.902739:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04618e8b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:1f575176-36bc-4786-83ee-2fea064a12a9+4:6528:x1874622881503872:12345-0@lo:104: 00010000:00010000:0.0:1787779825.902751:0:8454:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff9c04766dc600/0xc8fc0a51799604a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc8fc0a51799604b0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779825.902803:0:8454:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787779825.902809:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04618e8b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:1f575176-36bc-4786-83ee-2fea064a12a9+4:6528:x1874622881503872:12345-0@lo:104: Request processed in 71us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779825.902817:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787779825.902863:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787779825.902869:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0345e77c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:1f575176-36bc-4786-83ee-2fea064a12a9+3:6528:x1874622881504000:12345-0@lo:104: 00010000:00010000:0.0:1787779825.902877:0:8454:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff9c04413c9600/0xc8fc0a5179960463 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc8fc0a517996046a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779825.902990:0:8454:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787779825.902995:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0345e77c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:1f575176-36bc-4786-83ee-2fea064a12a9+3:6528:x1874622881504000:12345-0@lo:104: Request processed in 127us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779825.903001:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787779825.903031:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0461bec780 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6528:1874622881503872:0@lo:104: 00000100:00100000:0.0:1787779825.903040:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0345e76940 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6528:1874622881504000:0@lo:104: 00010000:00010000:0.0:1787779825.903059:0:6528:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c0477a70c00/0xc8fc0a5179960574 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779825.903075:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787779825.903081:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff9c04766dc600/0xc8fc0a51799604a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc8fc0a51799604b0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779825.903088:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c04766dc600 already unused, calling callback (ffffffffc139ac20) 10000000:00010000:0.0:1787779825.903093:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff9c04766dc600/0xc8fc0a51799604a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc8fc0a51799604b0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779825.903100:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff9c04766dc600/0xc8fc0a51799604a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc8fc0a51799604b0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787779825.903108:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff9c04766dc600/0xc8fc0a51799604a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc8fc0a51799604b0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787779825.903114:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787779825.903147:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff9c04766dc600/0xc8fc0a51799604a9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a51799604b0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779825.903153:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787779825.903230:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff9c04766dc600/0xc8fc0a51799604a9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a51799604b0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779825.903238:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff9c04766dc600/0xc8fc0a51799604a9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a51799604b0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779825.903249:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787779825.903253:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff9c04413c9600/0xc8fc0a5179960463 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc8fc0a517996046a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779825.903258:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c04413c9600 already unused, calling callback (ffffffffc139ac20) 10000000:00010000:0.0:1787779825.903261:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff9c04413c9600/0xc8fc0a5179960463 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc8fc0a517996046a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779825.903268:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff9c04413c9600/0xc8fc0a5179960463 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc8fc0a517996046a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787779825.903275:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff9c04413c9600/0xc8fc0a5179960463 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc8fc0a517996046a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787779825.903280:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787779825.903293:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff9c04413c9600/0xc8fc0a5179960463 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a517996046a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779825.903299:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787779825.903303:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff9c04413c9600/0xc8fc0a5179960463 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a517996046a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779825.903319:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff9c04413c9600/0xc8fc0a5179960463 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a517996046a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779825.903333:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787779825.903335:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787779825.903337:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787779825.903344:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787779825.903354:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347a85e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1f575176-36bc-4786-83ee-2fea064a12a9:3641:1874622881504128:0@lo:103: 00000100:00100000:0.0:1787779825.903385:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779825.903408:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787779825.903414:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347a87c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1f575176-36bc-4786-83ee-2fea064a12a9:3641:1874622881504256:0@lo:103: 00000100:00100000:0.0:1787779825.903433:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779825.903462:0:7921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881504128 00000100:00100000:0.0:1787779825.903466:0:7921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881504128 00010000:00010000:0.0:1787779825.903483:0:7921:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c04766dca00/0xc8fc0a51799604b0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc8fc0a51799604a9 expref: 18 pid: 6507 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779825.903500:0:7921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881504256 00000100:00100000:0.0:1787779825.903503:0:7921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881504256 00010000:00010000:0.0:1787779825.903512:0:7921:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c04766dcc00/0xc8fc0a517996046a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc8fc0a5179960463 expref: 19 pid: 6505 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779825.903527:0:7921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787779825.903533:0:7921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347a84000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1f575176-36bc-4786-83ee-2fea064a12a9+19:3641:x1874622881504128:12345-0@lo:103: 00010000:00010000:0.0:1787779825.903542:0:7921:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787779825.903547:0:7921:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c04766dca00/0xc8fc0a51799604b0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc8fc0a51799604a9 expref: 19 pid: 6507 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779825.903566:0:7921:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c04766dca00/0xc8fc0a51799604b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc8fc0a51799604a9 expref: 19 pid: 6507 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779825.903579:0:7921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c04766dca00/0xc8fc0a51799604b0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc8fc0a51799604a9 expref: 19 pid: 6507 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779825.903589:0:7921:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787779825.903615:0:7921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347a84000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1f575176-36bc-4786-83ee-2fea064a12a9+18:3641:x1874622881504128:12345-0@lo:103: Request processed in 82us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779825.903621:0:7921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787779825.903634:0:7921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787779825.903639:0:7921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347a86d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1f575176-36bc-4786-83ee-2fea064a12a9+17:3641:x1874622881504256:12345-0@lo:103: 00010000:00010000:0.0:1787779825.903647:0:7921:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787779825.903651:0:7921:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c04766dcc00/0xc8fc0a517996046a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc8fc0a5179960463 expref: 17 pid: 6505 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779825.903659:0:7921:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c04766dcc00/0xc8fc0a517996046a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc8fc0a5179960463 expref: 17 pid: 6505 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779825.903668:0:7921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c04766dcc00/0xc8fc0a517996046a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc8fc0a5179960463 expref: 17 pid: 6505 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779825.903678:0:7921:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c0477a70c00/0xc8fc0a5179960574 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779825.903686:0:7921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0477a70c00/0xc8fc0a5179960574 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787779825.903699:0:7921:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002587631s 00010000:00010000:0.0:1787779825.903708:0:7921:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c0477a70c00/0xc8fc0a5179960574 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779825.903715:0:7921:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c0477a70c00/0xc8fc0a5179960574 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779825.903722:0:7921:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c0477a70c00/0xc8fc0a5179960574 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779825.903728:0:7921:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c0477a70c00/0xc8fc0a5179960574 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779825.903733:0:7921:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0477a70c00 already unused, calling callback (ffffffffc0d97420) 00010000:00010000:0.0:1787779825.903737:0:7921:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c0477a70c00/0xc8fc0a5179960574 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779825.903744:0:7921:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c0477a70c00/0xc8fc0a5179960574 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779825.903757:0:7921:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c0477a70c00/0xc8fc0a5179960574 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779825.903766:0:7921:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787779825.903790:0:7921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347a86d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1f575176-36bc-4786-83ee-2fea064a12a9+16:3641:x1874622881504256:12345-0@lo:103: Request processed in 151us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779825.903796:0:7921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:0.0:1787779825.903821:0:6528:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c0477a70c00/0xc8fc0a5179960574 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779825.903828:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c0477a70c00/0xc8fc0a5179960574 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779825.903860:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c0477a70c00/0xc8fc0a5179960574 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779825.904017:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471776050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+15:9506:x1874622881503744:12345-0@lo:253: Request processed in 7838us (8201us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779825.904025:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1787779825.904067:0:9506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346de2580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f575176-36bc-4786-83ee-2fea064a12a9:9506:1874622881503744:0@lo:253: 10000000:01000000:1.0:1787779825.904083:0:9506:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1787779825.904086:0:9506:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787779825.904088:0:9506:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787779825.904090:0:9506:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787779825.904091:0:9506:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787779825.904092:0:9506:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787779825.904094:0:9506:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787779825.904095:0:9506:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787779825.904097:0:9506:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787779825.904098:0:9506:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787779825.904100:0:9506:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787779825.904101:0:9506:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787779825.904114:0:9506:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1787779825.906475:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347a87c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1f575176-36bc-4786-83ee-2fea064a12a9:3641:1874622881504256:0@lo:103: 00000100:00100000:0.0:1787779825.906489:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347a85e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1f575176-36bc-4786-83ee-2fea064a12a9:3641:1874622881504128:0@lo:103: 00080000:10000000:0.0:1787779825.913143:0:9506:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:0.0:1787779825.913466:0:9506:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:0.0:1787779825.913662:0:9506:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:0.0:1787779825.913817:0:9506:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:0.0:1787779825.914379:0:9506:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:0.0:1787779825.914568:0:9506:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:0.0:1787779825.916445:0:9506:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1787779825.939898:0:9506:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1787779825.939908:0:9506:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1787779825.939994:0:9506:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787779825.940045:0:9506:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.131@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787779825.940067:0:9506:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=50 00000080:00000004:0.0:1787779825.940089:0:9506:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:0.0:1787779825.940871:0:9506:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787779825.941197:0:9506:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:0.0:1787779826.790372:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1787779826.899744:0:9578:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787779826.900568:0:9578:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1787779827.484978:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787779827.485002:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346de2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881504384:0@lo:13: 00000100:00100000:1.0:1787779827.485068:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779827.485150:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881504384 00000100:00100000:1.0:1787779827.485157:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881504384 00000100:00100000:1.0:1787779827.485221:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787779827.485231:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346de21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881504384:12345-0@lo:13: 00002000:00000024:1.0:1787779827.485505:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787779827.485555:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346de21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881504384:12345-0@lo:13: Request processed in 325us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779827.485562:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:1.0:1787779827.485584:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787779827.485614:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0346de2d00 x1874622881504384/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779843 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787779827.485700:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346de2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881504384:0@lo:13: 00010000:00010000:0.0:1787779827.804069:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787779828.000322:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787779828.000349:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477980000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881504512:0@lo:13: 00000100:00100000:3.0:1787779828.000415:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779828.000494:0:8529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881504512 00000100:00100000:3.0:1787779828.000501:0:8529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881504512 00000100:00100000:3.0:1787779828.000551:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787779828.000559:0:8529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477983c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881504512:12345-0@lo:13: 00002000:00000024:3.0:1787779828.000582:0:8529:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787779828.000625:0:8529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477983c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881504512:12345-0@lo:13: Request processed in 67us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779828.000632:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1787779828.000667:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0477980000 x1874622881504512/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779844 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779828.000685:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477980000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881504512:0@lo:13: 00000100:00080000:1.0:1787779828.000767:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787779828.828537:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787779829.536167:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347a87c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881504640:0@lo:41: 00000100:00100000:2.0:1787779829.536240:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779829.536364:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881504640 00000100:00100000:3.0:1787779829.536372:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881504640 00000100:00100000:3.0:1787779829.536430:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787779829.536438:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0345e75a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881504640:12345-0@lo:41: 00000004:00000024:3.0:1787779829.536470:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:3.0:1787779829.540451:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0345e75a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881504640:12345-0@lo:41: Request processed in 4001us (4199us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779829.540466:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787779829.541022:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347a87c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881504640:0@lo:41: 00010000:00010000:0.0:1787779829.863258:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787779830.044202:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787779830.044228:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347a87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881504768:0@lo:41: 00000100:00100000:3.0:1787779830.044296:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779830.044417:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881504768 00000100:00100000:0.0:1787779830.044425:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881504768 00000100:00100000:0.0:1787779830.044476:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787779830.044486:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477980000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874622881504768:12345-0@lo:41: 00000004:00000024:0.0:1787779830.044518:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1787779830.044571:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477980000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874622881504768:12345-0@lo:41: Request processed in 86us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779830.044586:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787779830.044901:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347a87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881504768:0@lo:41: 00010000:00010000:1.0:1787779830.877084:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787779831.073238:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0345e76940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1f575176-36bc-4786-83ee-2fea064a12a9:3643:1874622881504896:0@lo:400: 00000100:00100000:3.0:1787779831.073307:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779831.073453:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881504896 00000100:00100000:1.0:1787779831.073460:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881504896 00000100:00100000:1.0:1787779831.073512:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1787779831.073520:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471774450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+15:3643:x1874622881504896:12345-0@lo:400: 00000100:00100000:2.0:1787779831.073962:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c046215e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874622881505024:0@lo:400: 00000100:00100000:2.0:1787779831.073995:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779831.074027:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346efed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1874622881505536:0@lo:400: 00000100:00100000:2.0:1787779831.074050:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779831.074066:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346efcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1874622881506048:0@lo:400: 00000100:00100000:2.0:1787779831.074089:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779831.074108:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787779831.074113:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346efc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881505408:0@lo:400: 00000100:00100000:2.0:1787779831.074133:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779831.074151:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346efd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881505920:0@lo:400: 00000100:00100000:2.0:1787779831.074171:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779831.074198:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c046215de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881505152:0@lo:400: 00000100:00100000:2.0:1787779831.074221:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779831.074235:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346efe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1874622881505664:0@lo:400: 00000100:00100000:2.0:1787779831.074269:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779831.074284:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346efe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1874622881506176:0@lo:400: 00000100:00100000:2.0:1787779831.074307:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779831.074317:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787779831.074323:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346efde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874622881505280:0@lo:400: 00000100:00100000:2.0:1787779831.074342:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779831.074580:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346eff0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881505792:0@lo:400: 00000100:00100000:2.0:1787779831.074617:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779831.074653:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881505024 00000100:00100000:2.0:1787779831.074658:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881505024 00000100:00100000:2.0:1787779831.074685:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881505536 00000100:00100000:2.0:1787779831.074688:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881505536 00000100:00100000:2.0:1787779831.074709:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881506048 00000100:00100000:2.0:1787779831.074712:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881506048 00000100:00100000:2.0:1787779831.074723:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881505664 00000100:00100000:2.0:1787779831.074730:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881505664 00000100:00100000:2.0:1787779831.074759:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881506176 00000100:00100000:2.0:1787779831.074762:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881506176 00000100:00100000:2.0:1787779831.074773:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881505280 00000100:00100000:2.0:1787779831.074775:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881505280 00000100:00100000:2.0:1787779831.074799:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787779831.074806:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346eff840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874622881505024:12345-0@lo:400: 00000100:00100000:2.0:1787779831.074870:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346eff840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874622881505024:12345-0@lo:400: Request processed in 64us (874us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779831.074877:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787779831.074905:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787779831.074912:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346efd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1874622881505536:12345-0@lo:400: 00000100:00100000:2.0:1787779831.075089:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346efd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1874622881505536:12345-0@lo:400: Request processed in 178us (1037us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779831.075094:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787779831.075106:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787779831.075111:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346efc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1874622881506048:12345-0@lo:400: 00000100:00100000:2.0:1787779831.075134:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346efc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1874622881506048:12345-0@lo:400: Request processed in 24us (1044us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779831.075139:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787779831.075148:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787779831.075153:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346efda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1874622881505664:12345-0@lo:400: 00000100:00100000:2.0:1787779831.075179:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346efda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1874622881505664:12345-0@lo:400: Request processed in 26us (909us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779831.075184:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787779831.075192:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787779831.075197:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346eff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1874622881506176:12345-0@lo:400: 00000100:00100000:2.0:1787779831.075227:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346eff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1874622881506176:12345-0@lo:400: Request processed in 30us (919us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779831.075233:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787779831.075242:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787779831.075247:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346effc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874622881505280:12345-0@lo:400: 00000100:00100000:2.0:1787779831.075281:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346effc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874622881505280:12345-0@lo:400: Request processed in 34us (939us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779831.075287:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787779831.075306:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881505408 00000100:00100000:2.0:1787779831.075309:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881505408 00000100:00100000:2.0:1787779831.075324:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881505152 00000100:00100000:2.0:1787779831.075326:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881505152 00000100:00100000:2.0:1787779831.075336:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787779831.075340:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346efcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881505408:12345-0@lo:400: 00000100:00100000:2.0:1787779831.075443:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346efcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881505408:12345-0@lo:400: Request processed in 102us (1308us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779831.075449:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787779831.075459:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787779831.075464:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346efe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881505152:12345-0@lo:400: 00000100:00100000:2.0:1787779831.075486:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346efe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881505152:12345-0@lo:400: Request processed in 23us (1265us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779831.075492:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787779831.075507:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881505920 00000100:00100000:2.0:1787779831.075510:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881505920 00000100:00100000:2.0:1787779831.075538:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881505792 00000100:00100000:2.0:1787779831.075540:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881505792 00000100:00100000:2.0:1787779831.075552:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787779831.075558:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346efc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881505920:12345-0@lo:400: 00000100:00100000:2.0:1787779831.075591:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346efc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881505920:12345-0@lo:400: Request processed in 34us (1420us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779831.075596:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787779831.075606:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787779831.075611:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347bce1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881505792:12345-0@lo:400: 00000100:00100000:2.0:1787779831.075631:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347bce1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881505792:12345-0@lo:400: Request processed in 20us (1013us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779831.075635:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787779831.075671:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346efc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881505408:0@lo:400: 00010000:00080000:2.0:1787779831.075683:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0346efd2c0 x1874622881505920/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779847 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787779831.075693:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346efd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881505920:0@lo:400: 00010000:00080000:2.0:1787779831.075702:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c046215e940 x1874622881505024/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779847 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787779831.075710:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c046215e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874622881505024:0@lo:400: 00010000:00080000:2.0:1787779831.075717:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0346efed00 x1874622881505536/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779847 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787779831.075724:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346efed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1874622881505536:0@lo:400: 00010000:00080000:2.0:1787779831.075732:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0346efcb40 x1874622881506048/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779847 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787779831.076163:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346efcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1874622881506048:0@lo:400: 00010000:00080000:2.0:1787779831.076208:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0346efde00 x1874622881505280/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779847 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787779831.076231:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346efde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874622881505280:0@lo:400: 00010000:00080000:2.0:1787779831.076244:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0346eff0c0 x1874622881505792/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779847 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787779831.076253:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346eff0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881505792:0@lo:400: 00000100:00100000:2.0:1787779831.076263:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c046215de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881505152:0@lo:400: 00010000:00080000:2.0:1787779831.076273:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0346efe1c0 x1874622881505664/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779847 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787779831.076281:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346efe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1874622881505664:0@lo:400: 00010000:00080000:2.0:1787779831.076291:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0346efe940 x1874622881506176/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779847 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787779831.076299:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346efe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1874622881506176:0@lo:400: 00000100:00100000:1.0:1787779831.076396:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471774450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+15:3643:x1874622881504896:12345-0@lo:400: Request processed in 2875us (3087us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779831.076407:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00080000:1.0:1787779831.076444:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787779831.076449:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787779831.076451:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787779831.076580:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0345e76940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1f575176-36bc-4786-83ee-2fea064a12a9:3643:1874622881504896:0@lo:400: 00000001:02000400:0.0:1787779831.796704:0:9868:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg331-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1787779831.905556:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787779832.098181:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787779832.098189:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c046ecd6000 from 39 10000000:01000000:2.0:1787779832.098194:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787779832.098235:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c0477a70600/0xc8fc0a517996057b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779832.098247:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff9c0477a70600/0xc8fc0a517996057b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779832.098258:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff9c0477a70600/0xc8fc0a517996057b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779832.098281:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347bcd2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881506304:0@lo:101: 00000100:00100000:2.0:1787779832.098354:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779832.098398:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0477b8d180 going to sleep for 11 seconds 00000100:00100000:2.0:1787779832.100340:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881506304 00000100:00100000:2.0:1787779832.100352:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881506304 00000100:00100000:2.0:1787779832.100415:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1787779832.100425:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471775450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+15:6509:x1874622881506304:12345-0@lo:101: 00010000:00010000:2.0:1787779832.100442:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787779832.100458:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0477a71c00/0xc8fc0a5179960582 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc8fc0a517996057b expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779832.100486:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0477a71c00/0xc8fc0a5179960582 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc8fc0a517996057b expref: 16 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779832.100497:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0477a71c00/0xc8fc0a5179960582 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a517996057b expref: 16 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779832.100506:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0477a71c00, rc 0) 00000100:00100000:2.0:1787779832.100575:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471775450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+16:6509:x1874622881506304:12345-0@lo:101: Request processed in 151us (2220us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779832.100582:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1787779832.109692:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347bcd2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881506304:0@lo:101: 00010000:00010000:2.0:1787779832.109723:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff9c0477a70600/0xc8fc0a517996057b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a5179960582 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779832.109735:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff9c0477a70600/0xc8fc0a517996057b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc8fc0a5179960582 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779832.111141:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347bcd2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881506432:0@lo:501: 00000100:00100000:2.0:1787779832.111211:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779832.111792:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0477b8d180 going to sleep for 11 seconds 00000100:00100000:1.0:1787779832.114386:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881506432 00000100:00100000:1.0:1787779832.114397:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881506432 00000100:00100000:1.0:1787779832.114449:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1787779832.114460:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471774c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+16:6509:x1874622881506432:12345-0@lo:501: 00000100:00100000:1.0:1787779832.114636:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471774c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+16:6509:x1874622881506432:12345-0@lo:501: Request processed in 178us (3424us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779832.114643:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1787779832.114703:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347bcd2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881506432:0@lo:501: 00000100:00100000:1.0:1787779832.114764:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346de2d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881506560:0@lo:503: 00000100:00100000:1.0:1787779832.114819:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779832.115075:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0341ce8240 going to sleep for 11 seconds 00000100:00100000:1.0:1787779832.115091:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881506560 00000100:00100000:1.0:1787779832.115096:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881506560 00000100:00100000:1.0:1787779832.115120:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1787779832.115126:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471775c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+16:6509:x1874622881506560:12345-0@lo:503: 00000100:00100000:1.0:1787779832.115202:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471775c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+16:6509:x1874622881506560:12345-0@lo:503: Request processed in 75us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779832.115215:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1787779832.115257:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346de2d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881506560:0@lo:503: 00000100:00100000:1.0:1787779832.116581:0:9884:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346de2d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f575176-36bc-4786-83ee-2fea064a12a9:9884:1874622881506688:0@lo:502: 00000100:00100000:1.0:1787779832.116633:0:9884:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779832.117304:0:9884:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0341ce83c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787779832.117452:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881506688 00000100:00100000:2.0:1787779832.117459:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881506688 00000100:00100000:2.0:1787779832.117504:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1787779832.117513:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471774050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+16:9884:x1874622881506688:12345-0@lo:502: 00000100:00100000:2.0:1787779832.117634:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471774050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+16:9884:x1874622881506688:12345-0@lo:502: Request processed in 122us (1000us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779832.117642:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1787779832.117833:0:9884:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346de2d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f575176-36bc-4786-83ee-2fea064a12a9:9884:1874622881506688:0@lo:502: 00000100:00100000:1.0:1787779832.117907:0:9884:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346de2d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f575176-36bc-4786-83ee-2fea064a12a9:9884:1874622881506816:0@lo:502: 00000100:00100000:1.0:1787779832.117942:0:9884:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779832.117963:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881506816 00000100:00100000:1.0:1787779832.117967:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881506816 00000100:00100000:1.0:1787779832.117990:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1787779832.117996:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471776450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+16:9884:x1874622881506816:12345-0@lo:502: 00000100:00100000:1.0:1787779832.118062:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471776450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+16:9884:x1874622881506816:12345-0@lo:502: Request processed in 65us (119us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779832.118069:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1787779832.118097:0:9884:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0341ce83c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787779832.118110:0:9884:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346de2d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f575176-36bc-4786-83ee-2fea064a12a9:9884:1874622881506816:0@lo:502: 00000040:00080000:1.0:1787779832.118128:0:9884:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:2.0:1787779832.118608:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:2.0:1787779832.118632:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787779832.118641:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c0477a70600/0xc8fc0a517996057b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a5179960582 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779832.118653:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff9c0477a70600/0xc8fc0a517996057b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a5179960582 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787779832.118664:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1787779832.118666:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:2.0:1787779832.118668:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1787779832.118693:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c0477a70000/0xc8fc0a5179960589 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779832.118699:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff9c0477a70000/0xc8fc0a5179960589 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779832.118708:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff9c0477a70000/0xc8fc0a5179960589 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779832.118722:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347bccb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881506944:0@lo:101: 00000100:00100000:2.0:1787779832.118858:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779832.118887:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0477b8dcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787779832.118904:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881506944 00000100:00100000:2.0:1787779832.118908:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881506944 00000100:00100000:2.0:1787779832.118935:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1787779832.118942:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471772050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+16:6509:x1874622881506944:12345-0@lo:101: 00010000:00010000:2.0:1787779832.118951:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787779832.118963:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0477a71600/0xc8fc0a5179960590 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc8fc0a5179960589 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779832.118984:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0477a71600/0xc8fc0a5179960590 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc8fc0a5179960589 expref: 17 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779832.118995:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0477a71600/0xc8fc0a5179960590 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a5179960589 expref: 17 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779832.119003:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0477a71600, rc 0) 00000100:00100000:2.0:1787779832.119034:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471772050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+17:6509:x1874622881506944:12345-0@lo:101: Request processed in 92us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779832.119040:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1787779832.119073:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347bccb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881506944:0@lo:101: 00010000:00010000:2.0:1787779832.119085:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff9c0477a70000/0xc8fc0a5179960589 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a5179960590 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779832.119094:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff9c0477a70000/0xc8fc0a5179960589 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc8fc0a5179960590 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779832.119137:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347bccb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881507072:0@lo:501: 00000100:00100000:2.0:1787779832.119172:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779832.119185:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0477b8dcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787779832.119197:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881507072 00000100:00100000:2.0:1787779832.119200:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881507072 00000100:00100000:2.0:1787779832.119222:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1787779832.119229:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471770450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+17:6509:x1874622881507072:12345-0@lo:501: 00000100:00100000:2.0:1787779832.119323:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471770450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+17:6509:x1874622881507072:12345-0@lo:501: Request processed in 94us (149us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779832.119330:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1787779832.119357:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347bccb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881507072:0@lo:501: 00000100:00100000:2.0:1787779832.119378:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347bccb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881507200:0@lo:503: 00000100:00100000:2.0:1787779832.119409:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779832.119422:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0477b8dcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787779832.119433:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881507200 00000100:00100000:2.0:1787779832.119437:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881507200 00000100:00100000:2.0:1787779832.119457:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1787779832.119462:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471771450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+17:6509:x1874622881507200:12345-0@lo:503: 00000100:00100000:2.0:1787779832.119538:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471771450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+17:6509:x1874622881507200:12345-0@lo:503: Request processed in 75us (127us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779832.119545:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1787779832.119579:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347bccb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881507200:0@lo:503: 00000100:00100000:3.0:1787779832.122324:0:9885:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477983480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f575176-36bc-4786-83ee-2fea064a12a9:9885:1874622881507328:0@lo:502: 00000100:00100000:3.0:1787779832.122394:0:9885:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779832.122466:0:9885:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0346c21900 going to sleep for 11 seconds 00000100:00100000:2.0:1787779832.122499:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881507328 00000100:00100000:2.0:1787779832.122506:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881507328 00000100:00100000:2.0:1787779832.122580:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1787779832.122590:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471770c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+17:9885:x1874622881507328:12345-0@lo:502: 00000100:00100000:2.0:1787779832.122716:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471770c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+17:9885:x1874622881507328:12345-0@lo:502: Request processed in 127us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779832.122730:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1787779832.122853:0:9885:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477983480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f575176-36bc-4786-83ee-2fea064a12a9:9885:1874622881507328:0@lo:502: 00000020:01000000:1.0:1787779832.122889:0:9885:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787779832.122897:0:9885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787779832.122899:0:9885:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787779832.122903:0:9885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787779832.122905:0:9885:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1787779832.122922:0:9885:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346de2d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f575176-36bc-4786-83ee-2fea064a12a9:9885:1874622881507456:0@lo:502: 00000100:00100000:1.0:1787779832.122959:0:9885:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779832.123213:0:9885:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0341ce83c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787779832.123255:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881507456 00000100:00100000:2.0:1787779832.123259:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881507456 00000100:00100000:2.0:1787779832.123279:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1787779832.123284:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471771c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+17:9885:x1874622881507456:12345-0@lo:502: 00000100:00100000:2.0:1787779832.123346:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471771c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+17:9885:x1874622881507456:12345-0@lo:502: Request processed in 61us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779832.123352:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1787779832.123440:0:9885:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346de2d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f575176-36bc-4786-83ee-2fea064a12a9:9885:1874622881507456:0@lo:502: 00000020:01000000:1.0:1787779832.123458:0:9885:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787779832.123462:0:9885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787779832.123464:0:9885:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787779832.123467:0:9885:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:2.0:1787779832.123626:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:2.0:1787779832.123646:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1787779832.123655:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c0477a70000/0xc8fc0a5179960589 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a5179960590 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779832.123665:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff9c0477a70000/0xc8fc0a5179960589 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a5179960590 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787779832.123674:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787779832.123676:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c04764fa000 from 39 10000000:01000000:2.0:1787779832.123679:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787779832.123701:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c0477a70400/0xc8fc0a5179960597 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779832.123709:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff9c0477a70400/0xc8fc0a5179960597 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779832.123717:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff9c0477a70400/0xc8fc0a5179960597 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779832.123730:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347bccb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881507584:0@lo:101: 00000100:00100000:2.0:1787779832.123834:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779832.124130:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881507584 00000100:00100000:3.0:1787779832.124135:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881507584 00000100:00100000:2.0:1787779832.124205:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1787779832.124214:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471770050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+17:6509:x1874622881507584:12345-0@lo:101: 00010000:00010000:2.0:1787779832.124224:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787779832.124237:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0477a71e00/0xc8fc0a517996059e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc8fc0a5179960597 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779832.124257:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0477a71e00/0xc8fc0a517996059e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc8fc0a5179960597 expref: 18 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779832.124268:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0477a71e00/0xc8fc0a517996059e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a5179960597 expref: 18 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779832.124276:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0477a71e00, rc 0) 00000100:00100000:3.0:1787779832.124288:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0477b8d600 going to sleep for 11 seconds 00000100:00100000:2.0:1787779832.124320:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471770050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+18:6509:x1874622881507584:12345-0@lo:101: Request processed in 107us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779832.124325:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1787779832.124390:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347bccb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881507584:0@lo:101: 00010000:00010000:0.0:1787779832.124402:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff9c0477a70400/0xc8fc0a5179960597 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a517996059e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779832.124410:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff9c0477a70400/0xc8fc0a5179960597 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xc8fc0a517996059e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779832.124458:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347a84f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881507712:0@lo:501: 00000100:00100000:0.0:1787779832.124482:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779832.124534:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0346b50480 going to sleep for 11 seconds 00000100:00100000:2.0:1787779832.124563:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881507712 00000100:00100000:2.0:1787779832.124567:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881507712 00000100:00100000:2.0:1787779832.124621:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1787779832.124628:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471772450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+18:6509:x1874622881507712:12345-0@lo:501: 00000100:00100000:2.0:1787779832.124732:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471772450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+18:6509:x1874622881507712:12345-0@lo:501: Request processed in 103us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779832.124802:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1787779832.125630:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347a84f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881507712:0@lo:501: 00000100:00100000:0.0:1787779832.125666:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347a84f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881507840:0@lo:503: 00000100:00100000:0.0:1787779832.125723:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779832.125771:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0346b50480 going to sleep for 11 seconds 00000100:00100000:2.0:1787779832.125831:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881507840 00000100:00100000:2.0:1787779832.126540:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881507840 00000100:00100000:2.0:1787779832.126630:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1787779832.126641:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471771850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+18:6509:x1874622881507840:12345-0@lo:503: 00000100:00100000:2.0:1787779832.126766:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471771850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+18:6509:x1874622881507840:12345-0@lo:503: Request processed in 126us (1041us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779832.126774:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1787779832.127300:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347a84f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881507840:0@lo:503: 00000100:00100000:0.0:1787779832.134009:0:9886:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347a84780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f575176-36bc-4786-83ee-2fea064a12a9:9886:1874622881507968:0@lo:502: 00000100:00100000:0.0:1787779832.134094:0:9886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779832.134144:0:9886:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0346b50300 going to sleep for 11 seconds 00000100:00100000:3.0:1787779832.136506:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881507968 00000100:00100000:3.0:1787779832.136529:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881507968 00000100:00100000:3.0:1787779832.136606:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1787779832.136615:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471771050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+18:9886:x1874622881507968:12345-0@lo:502: 00000100:00100000:3.0:1787779832.137311:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471771050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+18:9886:x1874622881507968:12345-0@lo:502: Request processed in 695us (3215us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779832.137320:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1787779832.139037:0:9886:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347a84780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f575176-36bc-4786-83ee-2fea064a12a9:9886:1874622881507968:0@lo:502: 00000100:00100000:0.0:1787779832.139127:0:9886:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347a84780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f575176-36bc-4786-83ee-2fea064a12a9:9886:1874622881508096:0@lo:502: 00000100:00100000:0.0:1787779832.139193:0:9886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779832.139233:0:9886:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0346b50300 going to sleep for 11 seconds 00000100:00100000:2.0:1787779832.139964:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881508096 00000100:00100000:2.0:1787779832.139972:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881508096 00000100:00100000:2.0:1787779832.140056:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1787779832.140066:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471773050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+18:9886:x1874622881508096:12345-0@lo:502: 00000100:00100000:2.0:1787779832.140195:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471773050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+18:9886:x1874622881508096:12345-0@lo:502: Request processed in 130us (1002us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779832.140203:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1787779832.140277:0:9886:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347a84780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f575176-36bc-4786-83ee-2fea064a12a9:9886:1874622881508096:0@lo:502: 00000040:00080000:3.0:1787779832.140301:0:9886:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:1.0:1787779832.144003:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:1.0:1787779832.144040:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787779832.144053:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c0477a70400/0xc8fc0a5179960597 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a517996059e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779832.144065:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff9c0477a70400/0xc8fc0a5179960597 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a517996059e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787779832.144074:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787779832.144078:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c04764fa000 from 6 10000000:01000000:1.0:1787779832.144081:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787779832.144119:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c044148a000/0xc8fc0a51799605a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779832.144127:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff9c044148a000/0xc8fc0a51799605a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779832.144137:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff9c044148a000/0xc8fc0a51799605a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779832.144160:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346de2d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881508224:0@lo:101: 00000100:00100000:1.0:1787779832.144229:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779832.144271:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0341ce8240 going to sleep for 11 seconds 00000100:00100000:1.0:1787779832.144302:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881508224 00000100:00100000:1.0:1787779832.144309:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881508224 00000100:00100000:1.0:1787779832.144350:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1787779832.144358:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471770850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+18:6509:x1874622881508224:12345-0@lo:101: 00010000:00010000:1.0:1787779832.144371:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787779832.144385:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c044148a400/0xc8fc0a51799605ac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc8fc0a51799605a5 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779832.144408:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c044148a400/0xc8fc0a51799605ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc8fc0a51799605a5 expref: 19 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779832.144419:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c044148a400/0xc8fc0a51799605ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a51799605a5 expref: 19 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779832.144427:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c044148a400, rc 0) 00000100:00100000:1.0:1787779832.144461:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471770850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+19:6509:x1874622881508224:12345-0@lo:101: Request processed in 103us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779832.144468:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1787779832.144513:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346de2d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881508224:0@lo:101: 00010000:00010000:1.0:1787779832.144526:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff9c044148a000/0xc8fc0a51799605a5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a51799605ac expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779832.144535:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff9c044148a000/0xc8fc0a51799605a5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc8fc0a51799605ac expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779832.144580:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346de2d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881508352:0@lo:256: 00000100:00100000:1.0:1787779832.144608:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779832.144620:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0341ce8240 going to sleep for 11 seconds 00000100:00100000:1.0:1787779832.144631:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881508352 00000100:00100000:1.0:1787779832.144639:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881508352 00000100:00100000:1.0:1787779832.144657:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1787779832.144662:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471773450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+19:6509:x1874622881508352:12345-0@lo:256: 20000000:01000000:1.0:1787779832.144673:0:6505:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787779832.144687:0:6505:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787779832.144690:0:6505:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:1.0:1787779832.146276:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471773450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+19:6509:x1874622881508352:12345-0@lo:256: Request processed in 1605us (1660us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779832.146291:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1787779832.146349:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346de2d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881508352:0@lo:256: 10000000:01000000:1.0:1787779832.146405:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787779832.146414:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c044148a000/0xc8fc0a51799605a5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a51799605ac expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779832.146423:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff9c044148a000/0xc8fc0a51799605a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a51799605ac expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787779832.146432:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1787779832.146435:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 34 10000000:01000000:1.0:1787779832.146437:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1787779832.146464:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c044148a200/0xc8fc0a51799605b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779832.146472:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff9c044148a200/0xc8fc0a51799605b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779832.146480:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff9c044148a200/0xc8fc0a51799605b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779832.146494:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346de2d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881508480:0@lo:101: 00000100:00100000:1.0:1787779832.146525:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779832.146565:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0341ce8240 going to sleep for 11 seconds 00000100:00100000:2.0:1787779832.146609:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881508480 00000100:00100000:2.0:1787779832.146616:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881508480 00000100:00100000:2.0:1787779832.146654:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1787779832.146662:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471772850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+19:6509:x1874622881508480:12345-0@lo:101: 00010000:00010000:2.0:1787779832.146673:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787779832.146684:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0477a71a00/0xc8fc0a51799605ba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xc8fc0a51799605b3 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779832.146715:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0477a71a00/0xc8fc0a51799605ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc8fc0a51799605b3 expref: 20 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779832.146724:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0477a71a00/0xc8fc0a51799605ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a51799605b3 expref: 20 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779832.146730:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0477a71a00, rc 0) 00000100:00100000:2.0:1787779832.146800:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471772850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+20:6509:x1874622881508480:12345-0@lo:101: Request processed in 139us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779832.146806:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1787779832.146862:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346de2d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881508480:0@lo:101: 00010000:00010000:3.0:1787779832.146885:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff9c044148a200/0xc8fc0a51799605b3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a51799605ba expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779832.146895:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff9c044148a200/0xc8fc0a51799605b3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xc8fc0a51799605ba expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779832.146950:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477982580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881508608:0@lo:501: 00000100:00100000:3.0:1787779832.146977:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779832.146998:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0346c21900 going to sleep for 11 seconds 00000100:00100000:2.0:1787779832.147348:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881508608 00000100:00100000:2.0:1787779832.147353:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881508608 00000100:00100000:2.0:1787779832.147388:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1787779832.147395:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471773c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+20:6509:x1874622881508608:12345-0@lo:501: 00000100:00100000:2.0:1787779832.147529:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471773c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+20:6509:x1874622881508608:12345-0@lo:501: Request processed in 133us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779832.147535:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1787779832.147565:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477982580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881508608:0@lo:501: 00000100:00100000:2.0:1787779832.147594:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347bce940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881508736:0@lo:503: 00000100:00100000:2.0:1787779832.147632:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779832.147646:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0477b8da80 going to sleep for 11 seconds 00000100:00100000:2.0:1787779832.147657:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881508736 00000100:00100000:2.0:1787779832.147660:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881508736 00000100:00100000:2.0:1787779832.147677:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1787779832.147682:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471772c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+20:6509:x1874622881508736:12345-0@lo:503: 00000100:00100000:2.0:1787779832.147797:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471772c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+20:6509:x1874622881508736:12345-0@lo:503: Request processed in 114us (164us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779832.147804:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1787779832.148374:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347bce940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881508736:0@lo:503: 00000100:00100000:2.0:1787779832.148816:0:9889:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347bce940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f575176-36bc-4786-83ee-2fea064a12a9:9889:1874622881508864:0@lo:502: 00000100:00100000:2.0:1787779832.148912:0:9889:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779832.148941:0:9889:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0341cb90c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787779832.149090:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881508864 00000100:00100000:3.0:1787779832.149096:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881508864 00000100:00100000:3.0:1787779832.149129:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1787779832.149137:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471773850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+20:9889:x1874622881508864:12345-0@lo:502: 00000100:00100000:3.0:1787779832.149242:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471773850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+20:9889:x1874622881508864:12345-0@lo:502: Request processed in 105us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779832.149250:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1787779832.149350:0:9889:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347bce940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f575176-36bc-4786-83ee-2fea064a12a9:9889:1874622881508864:0@lo:502: 00000020:01000000:1.0:1787779832.149371:0:9889:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787779832.149379:0:9889:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1787779832.149387:0:9889:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787779832.149389:0:9889:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1787779832.149393:0:9889:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787779832.149397:0:9889:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.131@tcp to nid 0x20000c0a8cb83 (192.168.203.131@tcp) 00000020:01000000:1.0:1787779832.149422:0:9889:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1787779832.149425:0:9889:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787779832.149439:0:9889:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9c0445fc4d28) 00000020:00000080:1.0:1787779832.149460:0:9889:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:1.0:1787779832.149464:0:9889:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787779832.149536:0:9889:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:1.0:1787779832.149542:0:9889:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:1.0:1787779832.149550:0:9889:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xc8fc0a51799605c8 00010000:00080000:1.0:1787779832.149589:0:9889:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c0347cee800@lustre-OST0001-osc-MDT0001: add connection 192.168.203.131@tcp at head 00010000:00010000:1.0:1787779832.149817:0:9889:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-11 is initialized 00000040:01000000:1.0:1787779832.149975:0:9889:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:1.0:1787779832.149985:0:9889:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:1.0:1787779832.150136:0:9889:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787779832.150253:0:9889:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787779832.150380:0:9889:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:1.0:1787779832.150462:0:9889:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:1.0:1787779832.155994:0:9890:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787779832.156004:0:9890:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1787779832.156834:0:9889:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1787779832.156884:0:9889:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787779832.156921:0:9889:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1787779832.156952:0:9889:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xc8fc0a51799605cf 00000100:00080000:1.0:1787779832.156963:0:9889:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787779832.156970:0:9889:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9c0347cee800 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:1.0:1787779832.157007:0:9889:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c0346de30c0 x1874622881508992/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787779832.157042:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346de30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1874622881508992:0@lo:8: 00000100:00100000:1.0:1787779832.157112:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787779832.157159:0:9889:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1787779832.157209:0:9889:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787779832.157213:0:9889:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787779832.157215:0:9889:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1787779832.157218:0:9889:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787779832.157222:0:9889:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787779832.157224:0:9889:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787779832.157227:0:9889:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787779832.157228:0:9889:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1787779832.157251:0:9889:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346de0b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f575176-36bc-4786-83ee-2fea064a12a9:9889:1874622881509120:0@lo:502: 00000100:00100000:1.0:1787779832.157296:0:9889:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779832.157320:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881509120 00000100:00100000:1.0:1787779832.157326:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881509120 00000100:00100000:1.0:1787779832.157363:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1787779832.157370:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046098c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+20:9889:x1874622881509120:12345-0@lo:502: 00000100:00100000:1.0:1787779832.157473:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046098c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+20:9889:x1874622881509120:12345-0@lo:502: Request processed in 103us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779832.157481:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1787779832.157517:0:9889:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0341ce8a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787779832.157536:0:9889:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346de0b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f575176-36bc-4786-83ee-2fea064a12a9:9889:1874622881509120:0@lo:502: 00000020:01000000:1.0:1787779832.157558:0:9889:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787779832.157567:0:9889:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787779832.157569:0:9889:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787779832.157572:0:9889:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000100:00100000:2.0:1787779832.157828:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881508992 00000100:00100000:2.0:1787779832.157833:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881508992 00000100:00100000:2.0:1787779832.157891:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787779832.157897:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346de12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3640:x1874622881508992:12345-0@lo:8: 00010000:00080000:2.0:1787779832.157929:0:8428:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 240 last 0 00000020:00000080:2.0:1787779832.157952:0:8428:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xc8fc0a51799605d6 00002000:00100000:2.0:1787779832.157967:0:8428:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff9c0346f6b000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113939 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:2.0:1787779832.157971:0:8428:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00000001:00000004:2.0:1787779832.157975:0:8428:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1787779832.158031:0:8428:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1787779832.158243:0:8428:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:2.0:1787779832.158266:0:8428:0:(import.c:65:import_set_state_nolock()) ffff9c0346f6c800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787779832.158319:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346de12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3640:x1874622881508992:12345-0@lo:8: Request processed in 421us (1207us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779832.158327:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1787779832.158447:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0346de30c0 x1874622881508992/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787779842 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787779832.158458:0:3640:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787779832.158465:0:3640:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 1 00000100:00080000:1.0:1787779832.158473:0:3640:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1787779832.158479:0:3640:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1787779832.158481:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9c0347cee800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1787779832.158492:0:3640:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1787779832.158497:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346de30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1874622881508992:0@lo:8: 00000004:00080000:1.0:1787779832.158520:0:9890:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1787779832.158570:0:9890:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 240162730827ns, next at 0ns, rc = 0 00080000:00080000:1.0:1787779832.158576:0:9890:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:2.0:1787779832.158893:0:9892:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347bcf840 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9892:1874622881509248:0@lo:700: 00000100:00100000:2.0:1787779832.158932:0:9892:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779832.158952:0:9892:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0341cb9600 going to sleep for 11 seconds 00000100:00100000:2.0:1787779832.159122:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347bcc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1874622881509376:0@lo:400: 00000100:00100000:2.0:1787779832.159151:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779832.159168:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347bcda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1874622881509888:0@lo:400: 00000100:00100000:2.0:1787779832.159189:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779832.159206:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347bcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1874622881510400:0@lo:400: 00000100:00100000:2.0:1787779832.159223:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779832.159242:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787779832.159247:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347bce580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881509760:0@lo:400: 00000100:00100000:2.0:1787779832.159270:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779832.159286:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347bcde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881510272:0@lo:400: 00000100:00100000:2.0:1787779832.159306:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779832.159343:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347bcc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874622881509632:0@lo:400: 00000100:00100000:2.0:1787779832.159366:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779832.159381:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347bcfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881510144:0@lo:400: 00000100:00100000:2.0:1787779832.159400:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779832.159414:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1787779832.159419:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347bccf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881509504:0@lo:400: 00000100:00100000:2.0:1787779832.159439:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779832.159454:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347bcf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1874622881510016:0@lo:400: 00000100:00100000:2.0:1787779832.159471:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779832.159480:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347bced00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1874622881510528:0@lo:400: 00000100:00100000:2.0:1787779832.159495:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779832.159515:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881509376 00000100:00100000:2.0:1787779832.159520:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881509376 00000100:00100000:2.0:1787779832.159549:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881509888 00000100:00100000:2.0:1787779832.159552:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881509888 00000100:00100000:2.0:1787779832.159562:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881510400 00000100:00100000:2.0:1787779832.159564:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881510400 00000100:00100000:2.0:1787779832.159576:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881509632 00000100:00100000:2.0:1787779832.159578:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881509632 00000100:00100000:2.0:1787779832.159589:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881510016 00000100:00100000:2.0:1787779832.159591:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881510016 00000100:00100000:2.0:1787779832.159600:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881510528 00000100:00100000:2.0:1787779832.159602:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881510528 00000100:00100000:2.0:1787779832.159614:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787779832.159621:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347bce940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1874622881509376:12345-0@lo:400: 00000100:00100000:2.0:1787779832.159660:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347bce940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1874622881509376:12345-0@lo:400: Request processed in 39us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779832.159666:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787779832.159680:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787779832.159692:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347bccb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1874622881509888:12345-0@lo:400: 00000100:00100000:2.0:1787779832.159719:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347bccb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1874622881509888:12345-0@lo:400: Request processed in 28us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779832.159725:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787779832.159736:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000020:01000000:3.0:1787779832.160161:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 34-42 (rc=0) 10000000:01000000:3.0:1787779832.160191:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1787779832.160202:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c044148a200/0xc8fc0a51799605b3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a51799605ba expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779832.160212:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff9c044148a200/0xc8fc0a51799605b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a51799605ba expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787779832.160222:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787779832.160233:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c044407a000 from 39 10000000:01000000:3.0:1787779832.160235:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787779832.160262:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c04766dd200/0xc8fc0a51799605dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779832.160270:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff9c04766dd200/0xc8fc0a51799605dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779832.160280:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff9c04766dd200/0xc8fc0a51799605dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779832.160294:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477980f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881510656:0@lo:101: 00000100:00100000:3.0:1787779832.160327:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779832.160353:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0346c21600 going to sleep for 11 seconds 00000100:00100000:2.0:1787779832.160462:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347bcd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1874622881510400:12345-0@lo:400: 00000100:00100000:2.0:1787779832.160495:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347bcd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1874622881510400:12345-0@lo:400: Request processed in 37us (1271us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779832.160518:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787779832.160526:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346efe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1874622881509632:12345-0@lo:400: 00000100:00100000:3.0:1787779832.160561:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346efe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1874622881509632:12345-0@lo:400: Request processed in 36us (1193us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779832.160567:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787779832.160582:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787779832.160588:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346efde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874622881510016:12345-0@lo:400: 00000100:00100000:3.0:1787779832.160614:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346efde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874622881510016:12345-0@lo:400: Request processed in 27us (1142us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779832.160620:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787779832.160634:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787779832.160640:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346efcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1874622881510528:12345-0@lo:400: 00000100:00100000:3.0:1787779832.160664:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346efcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1874622881510528:12345-0@lo:400: Request processed in 24us (1168us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779832.160685:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787779832.160709:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881509760 00000100:00100000:3.0:1787779832.160714:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881509760 00000100:00100000:3.0:1787779832.160736:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881509504 00000100:00100000:2.0:1787779832.160818:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787779832.160860:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787779832.160868:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046215de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1874622881509760:12345-0@lo:400: 00000100:00100000:2.0:1787779832.160912:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046215de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1874622881509760:12345-0@lo:400: Request processed in 45us (1641us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779832.160918:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787779832.160936:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881510272 00000100:00100000:2.0:1787779832.160940:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881510272 00000100:00100000:2.0:1787779832.160959:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881510144 00000100:00100000:2.0:1787779832.160962:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881510144 00000100:00100000:2.0:1787779832.160973:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787779832.160978:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046215e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1874622881510272:12345-0@lo:400: 00000100:00100000:2.0:1787779832.161024:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046215e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1874622881510272:12345-0@lo:400: Request processed in 45us (1716us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779832.161031:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787779832.161042:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787779832.161048:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346efe1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881510144:12345-0@lo:400: 00000100:00100000:2.0:1787779832.161071:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346efe1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881510144:12345-0@lo:400: Request processed in 24us (1671us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779832.161084:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787779832.161229:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881509248 00000100:00100000:1.0:1787779832.161234:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881509248 00000100:00100000:1.0:1787779832.161271:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787779832.161277:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347bcd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:9892:x1874622881509248:12345-0@lo:700: 00000100:00100000:1.0:1787779832.161310:0:8437:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346de30c0 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8437:1874622881510784:0@lo:700: 00000100:00100000:1.0:1787779832.161342:0:8437:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779832.161359:0:8437:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0341ce8a80 going to sleep for 11 seconds 00000100:00080000:1.0:1787779832.161386:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787779832.161400:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881510784 00000100:00100000:1.0:1787779832.161403:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881510784 00000100:00100000:1.0:1787779832.161426:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787779832.161433:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346de0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8437:x1874622881510784:12345-0@lo:700: 00000100:00100000:3.0:1787779832.161621:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881509504 00000100:00100000:3.0:1787779832.161647:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787779832.161653:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346eff0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881509504:12345-0@lo:400: 00000100:00100000:3.0:1787779832.161685:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346eff0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881509504:12345-0@lo:400: Request processed in 32us (2244us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779832.161691:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787779832.161708:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881510656 00000100:00100000:3.0:1787779832.161711:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881510656 00000100:00100000:2.0:1787779832.162192:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347bce580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881509760:0@lo:400: 00010000:00080000:2.0:1787779832.162217:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0347bcde00 x1874622881510272/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779848 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787779832.162227:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347bcde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881510272:0@lo:400: 00010000:00080000:2.0:1787779832.162242:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0347bcc3c0 x1874622881509376/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779848 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787779832.162251:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347bcc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1874622881509376:0@lo:400: 00010000:00080000:2.0:1787779832.162260:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0347bcda40 x1874622881509888/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779848 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787779832.162267:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347bcda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1874622881509888:0@lo:400: 00010000:00080000:2.0:1787779832.162276:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0347bcc000 x1874622881510400/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779848 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787779832.162283:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347bcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1874622881510400:0@lo:400: 00000100:00100000:3.0:1787779832.162383:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1787779832.162393:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046098e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+20:6509:x1874622881510656:12345-0@lo:101: 00010000:00010000:3.0:1787779832.162403:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787779832.162420:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c04766dc800/0xc8fc0a51799605e4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xc8fc0a51799605dd expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779832.162444:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c04766dc800/0xc8fc0a51799605e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc8fc0a51799605dd expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779832.162455:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c04766dc800/0xc8fc0a51799605e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a51799605dd expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779832.162464:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c04766dc800, rc 0) 00000100:00100000:3.0:1787779832.162501:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046098e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+21:6509:x1874622881510656:12345-0@lo:101: Request processed in 111us (2173us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779832.162506:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1787779832.162561:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347bccf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881509504:0@lo:400: 00010000:00080000:3.0:1787779832.162574:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0347bcf480 x1874622881510016/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779848 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779832.162582:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347bcf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1874622881510016:0@lo:400: 00010000:00080000:3.0:1787779832.162596:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0347bced00 x1874622881510528/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779848 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779832.162604:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347bced00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1874622881510528:0@lo:400: 00010000:00080000:3.0:1787779832.162614:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0347bcc780 x1874622881509632/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779848 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779832.162622:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347bcc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874622881509632:0@lo:400: 00010000:00080000:3.0:1787779832.162633:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0347bcfc00 x1874622881510144/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779848 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779832.162641:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347bcfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881510144:0@lo:400: 00000100:00100000:3.0:1787779832.162690:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477980f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881510656:0@lo:101: 00010000:00010000:3.0:1787779832.162707:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff9c04766dd200/0xc8fc0a51799605dd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a51799605e4 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779832.162718:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff9c04766dd200/0xc8fc0a51799605dd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xc8fc0a51799605e4 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779832.165507:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477980f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881510912:0@lo:501: 00000100:00100000:3.0:1787779832.165576:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779832.165615:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0346c21600 going to sleep for 11 seconds 00000100:00100000:3.0:1787779832.165634:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881510912 00000100:00100000:3.0:1787779832.165648:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881510912 00000100:00100000:3.0:1787779832.165688:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1787779832.165696:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046098d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+21:6509:x1874622881510912:12345-0@lo:501: 00000004:00080000:2.0:1787779832.167257:0:7442:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:3.0:1787779832.167447:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046098d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+21:6509:x1874622881510912:12345-0@lo:501: Request processed in 1749us (1868us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779832.167457:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1787779832.167562:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477980f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881510912:0@lo:501: 00000100:00100000:2.0:1787779832.167623:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346efed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881511040:0@lo:503: 00000100:00100000:2.0:1787779832.167665:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779832.167699:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0341cb99c0 going to sleep for 11 seconds 40000000:02000000:1.0:1787779832.167757:0:6519:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost 00000100:00100000:3.0:1787779832.171076:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881511040 00000100:00100000:3.0:1787779832.171091:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881511040 00000100:00100000:3.0:1787779832.171150:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1787779832.171161:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046098d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+21:6509:x1874622881511040:12345-0@lo:503: 00000100:00100000:3.0:1787779832.171318:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046098d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+21:6509:x1874622881511040:12345-0@lo:503: Request processed in 158us (3651us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779832.171324:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1787779832.171383:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346efed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881511040:0@lo:503: 00000100:00100000:3.0:1787779832.174310:0:9893:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04779812c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f575176-36bc-4786-83ee-2fea064a12a9:9893:1874622881511168:0@lo:502: 00000100:00100000:3.0:1787779832.174386:0:9893:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779832.174432:0:9893:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0346c21cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787779832.174482:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881511168 00000100:00100000:0.0:1787779832.174495:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881511168 00000100:00100000:0.0:1787779832.174540:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1787779832.174548:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046098f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+21:9893:x1874622881511168:12345-0@lo:502: 00000100:00100000:0.0:1787779832.174661:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046098f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+21:9893:x1874622881511168:12345-0@lo:502: Request processed in 114us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779832.174668:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1787779832.174761:0:9893:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04779812c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f575176-36bc-4786-83ee-2fea064a12a9:9893:1874622881511168:0@lo:502: 00000100:00100000:3.0:1787779832.174804:0:9893:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04779812c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f575176-36bc-4786-83ee-2fea064a12a9:9893:1874622881511296:0@lo:502: 00000100:00100000:3.0:1787779832.174863:0:9893:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779832.174895:0:9893:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0346c21cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787779832.174909:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881511296 00000100:00100000:3.0:1787779832.174912:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881511296 00000100:00100000:3.0:1787779832.174935:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1787779832.174941:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046098c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+21:9893:x1874622881511296:12345-0@lo:502: 00000100:00100000:3.0:1787779832.175005:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046098c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+21:9893:x1874622881511296:12345-0@lo:502: Request processed in 64us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779832.175018:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1787779832.175056:0:9893:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04779812c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f575176-36bc-4786-83ee-2fea064a12a9:9893:1874622881511296:0@lo:502: 00000040:00080000:3.0:1787779832.175074:0:9893:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:0.0:1787779832.177063:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:0.0:1787779832.177098:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787779832.177108:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c04766dd200/0xc8fc0a51799605dd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a51799605e4 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779832.177189:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff9c04766dd200/0xc8fc0a51799605dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a51799605e4 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787779832.177200:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787779832.177203:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c044407a000 from 6 10000000:01000000:0.0:1787779832.177206:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787779832.177242:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c0440031a00/0xc8fc0a51799605eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779832.177251:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff9c0440031a00/0xc8fc0a51799605eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779832.177262:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff9c0440031a00/0xc8fc0a51799605eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779832.177284:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347a86580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881511424:0@lo:101: 00000100:00100000:0.0:1787779832.177344:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779832.177384:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0346b50000 going to sleep for 11 seconds 00000100:00100000:3.0:1787779832.177435:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881511424 00000100:00100000:3.0:1787779832.177442:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881511424 00000100:00100000:3.0:1787779832.177494:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1787779832.177504:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046098f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+21:6509:x1874622881511424:12345-0@lo:101: 00010000:00010000:3.0:1787779832.177515:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787779832.177527:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c04766dcc00/0xc8fc0a51799605f2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc8fc0a51799605eb expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779832.177548:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c04766dcc00/0xc8fc0a51799605f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc8fc0a51799605eb expref: 22 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779832.177558:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c04766dcc00/0xc8fc0a51799605f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a51799605eb expref: 22 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779832.177566:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c04766dcc00, rc 0) 00000100:00100000:3.0:1787779832.177608:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046098f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+22:6509:x1874622881511424:12345-0@lo:101: Request processed in 106us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779832.177615:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1787779832.177655:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347a86580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881511424:0@lo:101: 00010000:00010000:3.0:1787779832.177668:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff9c0440031a00/0xc8fc0a51799605eb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a51799605f2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779832.177677:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff9c0440031a00/0xc8fc0a51799605eb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc8fc0a51799605f2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779832.177736:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04779812c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881511552:0@lo:256: 00000100:00100000:3.0:1787779832.177866:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779832.177895:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0346c21e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787779832.177908:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881511552 00000100:00100000:3.0:1787779832.177912:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881511552 00000100:00100000:3.0:1787779832.177934:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1787779832.177941:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046098e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+22:6509:x1874622881511552:12345-0@lo:256: 20000000:01000000:3.0:1787779832.177952:0:6505:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787779832.177967:0:6505:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787779832.177970:0:6505:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:3.0:1787779832.178044:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046098e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+22:6509:x1874622881511552:12345-0@lo:256: Request processed in 104us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779832.178051:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1787779832.178080:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04779812c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881511552:0@lo:256: 10000000:01000000:3.0:1787779832.178905:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787779832.178915:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c0440031a00/0xc8fc0a51799605eb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a51799605f2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779832.178923:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff9c0440031a00/0xc8fc0a51799605eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a51799605f2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787779832.178931:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1787779832.178933:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:3.0:1787779832.178936:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1787779832.178957:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c04766dca00/0xc8fc0a51799605f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779832.178975:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff9c04766dca00/0xc8fc0a51799605f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779832.178984:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff9c04766dca00/0xc8fc0a51799605f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779832.179002:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04779812c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881511680:0@lo:101: 00000100:00100000:3.0:1787779832.179036:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779832.179868:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0346c21e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787779832.181046:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346de0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8437:x1874622881510784:12345-0@lo:700: Request processed in 19609us (19698us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779832.181058:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1787779832.181445:0:8437:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0346de30c0 x1874622881510784/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787779848 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779832.181460:0:8437:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346de30c0 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8437:1874622881510784:0@lo:700: 40000000:02000000:3.0:1787779832.181473:0:8437:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] 00000100:00100000:0.0:1787779832.188426:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881511680 00000100:00100000:0.0:1787779832.188452:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881511680 00000100:00100000:1.0:1787779832.190950:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1787779832.190963:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046098fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+22:6509:x1874622881511680:12345-0@lo:101: 00010000:00010000:1.0:1787779832.190980:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787779832.190997:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c044148ba00/0xc8fc0a5179960600 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xc8fc0a51799605f9 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779832.191025:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c044148ba00/0xc8fc0a5179960600 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc8fc0a51799605f9 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779832.191037:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c044148ba00/0xc8fc0a5179960600 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a51799605f9 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779832.191045:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c044148ba00, rc 0) 00000100:00100000:1.0:1787779832.191123:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046098fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+23:6509:x1874622881511680:12345-0@lo:101: Request processed in 152us (12075us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779832.191130:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1787779832.191279:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04779812c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881511680:0@lo:101: 00010000:00010000:3.0:1787779832.191296:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff9c04766dca00/0xc8fc0a51799605f9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a5179960600 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779832.191306:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff9c04766dca00/0xc8fc0a51799605f9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xc8fc0a5179960600 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779832.191373:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04779812c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881511808:0@lo:501: 00000100:00100000:3.0:1787779832.191408:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779832.191636:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0346c21e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787779832.191820:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881511808 00000100:00100000:1.0:1787779832.191826:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881511808 00000100:00100000:1.0:1787779832.191888:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1787779832.191896:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046098ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+23:6509:x1874622881511808:12345-0@lo:501: 00000100:00100000:1.0:1787779832.192013:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046098ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+23:6509:x1874622881511808:12345-0@lo:501: Request processed in 118us (604us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779832.192020:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1787779832.192177:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04779812c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881511808:0@lo:501: 00000100:00100000:2.0:1787779832.192209:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346efd2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881511936:0@lo:503: 00000100:00100000:2.0:1787779832.192253:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779832.192287:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0341cb9840 going to sleep for 11 seconds 00000100:00100000:3.0:1787779832.192374:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881511936 00000100:00100000:3.0:1787779832.192379:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881511936 00000100:00100000:3.0:1787779832.192410:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1787779832.192423:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046098f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+23:6509:x1874622881511936:12345-0@lo:503: 00000100:00100000:3.0:1787779832.192501:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046098f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+23:6509:x1874622881511936:12345-0@lo:503: Request processed in 79us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779832.192507:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1787779832.192577:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346efd2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881511936:0@lo:503: 00000100:00100000:2.0:1787779832.193066:0:9895:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346efd2c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f575176-36bc-4786-83ee-2fea064a12a9:9895:1874622881512064:0@lo:502: 00000100:00100000:2.0:1787779832.193103:0:9895:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779832.193219:0:9895:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0341cb90c0 going to sleep for 11 seconds 00000001:00100000:2.0:1787779832.193517:0:9508:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:1.0:1787779832.193623:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347bcd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:9892:x1874622881509248:12345-0@lo:700: Request processed in 32345us (34689us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779832.193642:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1787779832.193707:0:9892:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0347bcf840 x1874622881509248/t0(0) o700->lustre-OST0001-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787779848 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787779832.193720:0:9892:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347bcf840 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9892:1874622881509248:0@lo:700: 00000100:00100000:3.0:1787779832.194867:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881512064 00000100:00100000:3.0:1787779832.194887:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881512064 00000100:00100000:3.0:1787779832.194930:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1787779832.194939:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046098e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+23:9895:x1874622881512064:12345-0@lo:502: 00000100:00100000:3.0:1787779832.195136:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046098e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+23:9895:x1874622881512064:12345-0@lo:502: Request processed in 198us (2031us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779832.195144:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1787779832.195197:0:9895:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346efd2c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f575176-36bc-4786-83ee-2fea064a12a9:9895:1874622881512064:0@lo:502: 00000020:01000000:3.0:1787779832.195228:0:9895:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787779832.195235:0:9895:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1787779832.195242:0:9895:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787779832.195245:0:9895:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1787779832.195251:0:9895:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787779832.195255:0:9895:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.131@tcp to nid 0x20000c0a8cb83 (192.168.203.131@tcp) 00000020:01000000:3.0:1787779832.195276:0:9895:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1787779832.195278:0:9895:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787779832.195294:0:9895:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9c0476623370) 00000020:00000080:3.0:1787779832.195318:0:9895:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type osp with refcount 2 00000020:00000080:3.0:1787779832.195323:0:9895:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787779832.195420:0:9895:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1787779832.195425:0:9895:0:(osd_handler.c:8925:osd_obd_connect()) connect #7 00000020:00000080:3.0:1787779832.195432:0:9895:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc8fc0a517996060e 00010000:00080000:3.0:1787779832.195459:0:9895:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c0347c9c800@lustre-OST0001-osc-MDT0000: add connection 192.168.203.131@tcp at head 00010000:00010000:3.0:1787779832.195685:0:9895:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-12 is initialized 00000040:01000000:3.0:1787779832.195819:0:9895:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:3.0:1787779832.195829:0:9895:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1787779832.196051:0:9895:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787779832.196159:0:9895:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787779832.196279:0:9895:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:3.0:1787779832.196376:0:9895:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000004:00080000:2.0:1787779832.200131:0:9892:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1787779832.200167:0:9892:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346efd2c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9892:1874622881512320:0@lo:7: 00000100:00100000:2.0:1787779832.200233:0:9892:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779832.200262:0:9892:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0341cb9600 going to sleep for 11 seconds 00000100:00100000:2.0:1787779832.200284:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881512320 00000100:00100000:2.0:1787779832.200290:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881512320 00000100:00100000:2.0:1787779832.200343:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787779832.200352:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346efed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:9892:x1874622881512320:12345-0@lo:7: 00000100:00100000:3.0:1787779832.200919:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346efc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881512192:0@lo:13: 00000100:00100000:3.0:1787779832.200960:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779832.201014:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881512192 00000100:00100000:3.0:1787779832.201019:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881512192 00000100:00100000:3.0:1787779832.201050:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787779832.201058:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477981e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3644:x1874622881512192:12345-0@lo:13: 00002000:00000024:3.0:1787779832.201076:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923939328 avail 3692417024 00000100:00100000:3.0:1787779832.201129:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477981e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3644:x1874622881512192:12345-0@lo:13: Request processed in 72us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779832.201136:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:3.0:1787779832.201177:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0346efc000 x1874622881512192/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779848 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779832.201196:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346efc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881512192:0@lo:13: 00000040:00080000:1.0:1787779832.202277:0:9896:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787779832.202282:0:9896:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1787779832.205533:0:9895:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787779832.205548:0:9895:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1787779832.205589:0:9895:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1787779832.205615:0:9895:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc8fc0a5179960615 00000100:00080000:0.0:1787779832.205626:0:9895:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787779832.205632:0:9895:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9c0347c9c800 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:0.0:1787779832.205666:0:9895:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c0347a85a40 x1874622881512448/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787779832.205719:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347a85a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1874622881512448:0@lo:8: 00000100:00100000:1.0:1787779832.205793:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787779832.208066:0:9895:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1787779832.208174:0:9895:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787779832.208181:0:9895:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787779832.208183:0:9895:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1787779832.208187:0:9895:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787779832.208190:0:9895:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787779832.208191:0:9895:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787779832.208194:0:9895:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787779832.208196:0:9895:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1787779832.208230:0:9895:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347a86580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f575176-36bc-4786-83ee-2fea064a12a9:9895:1874622881512576:0@lo:502: 00000100:00100000:0.0:1787779832.208303:0:9895:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779832.208338:0:9895:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0346b50540 going to sleep for 11 seconds 00000100:00100000:0.0:1787779832.208381:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881512576 00000100:00100000:0.0:1787779832.208387:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881512576 00000100:00100000:0.0:1787779832.208429:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1787779832.208438:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046098c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+23:9895:x1874622881512576:12345-0@lo:502: 00000100:00100000:0.0:1787779832.208549:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046098c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+23:9895:x1874622881512576:12345-0@lo:502: Request processed in 112us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779832.208557:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1787779832.208609:0:9895:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347a86580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f575176-36bc-4786-83ee-2fea064a12a9:9895:1874622881512576:0@lo:502: 00000020:01000000:0.0:1787779832.208643:0:9895:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787779832.208647:0:9895:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787779832.208649:0:9895:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787779832.208652:0:9895:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000100:00100000:0.0:1787779832.208951:0:8430:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1787779832.208960:0:8430:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1787779832.209045:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881512448 00000100:00100000:0.0:1787779832.209050:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881512448 00000100:00100000:0.0:1787779832.209169:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787779832.209174:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346de2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3640:x1874622881512448:12345-0@lo:8: 00010000:00080000:0.0:1787779832.209199:0:9899:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 240 last 0 00000020:00000080:0.0:1787779832.209223:0:9899:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc8fc0a517996061c 00002000:00100000:0.0:1787779832.209236:0:9899:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9c048124a800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113939 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1787779832.209241:0:9899:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1787779832.209243:0:9899:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000020:01000000:3.0:1787779832.209459:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-42 (rc=0) 10000000:01000000:3.0:1787779832.209483:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1787779832.209493:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c04766dca00/0xc8fc0a51799605f9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a5179960600 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779832.209502:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff9c04766dca00/0xc8fc0a51799605f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a5179960600 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787779832.209512:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1787779832.209521:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9c04515699b8 from 1 10000000:01000000:3.0:1787779832.209524:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787779832.209548:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c04766dc600/0xc8fc0a5179960623 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779832.209556:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff9c04766dc600/0xc8fc0a5179960623 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779832.209565:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff9c04766dc600/0xc8fc0a5179960623 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779832.209580:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477982d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881512704:0@lo:101: 00000100:00100000:3.0:1787779832.209617:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779832.209649:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0346c21e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787779832.211106:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881512704 00000100:00100000:1.0:1787779832.211170:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881512704 00000100:00100000:1.0:1787779832.211218:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1787779832.211228:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046098d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+23:6509:x1874622881512704:12345-0@lo:101: 00010000:00010000:1.0:1787779832.211242:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787779832.211258:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c044148be00/0xc8fc0a517996062a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xc8fc0a5179960623 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779832.211283:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c044148be00/0xc8fc0a517996062a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc8fc0a5179960623 expref: 24 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779832.211294:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c044148be00/0xc8fc0a517996062a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a5179960623 expref: 24 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779832.211303:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c044148be00, rc 0) 00000100:00100000:1.0:1787779832.211371:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046098d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+24:6509:x1874622881512704:12345-0@lo:101: Request processed in 144us (1752us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779832.211378:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00002000:00080000:0.0:1787779832.211594:0:9899:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787779832.211622:0:9899:0:(import.c:65:import_set_state_nolock()) ffff9c048124c000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787779832.211678:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346de2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3640:x1874622881512448:12345-0@lo:8: Request processed in 2502us (5884us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779832.211687:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787779832.211769:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477982d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881512704:0@lo:101: 00010000:00010000:3.0:1787779832.211787:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff9c04766dc600/0xc8fc0a5179960623 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a517996062a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779832.211797:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff9c04766dc600/0xc8fc0a5179960623 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xc8fc0a517996062a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779832.211947:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477982d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881512832:0@lo:501: 00000100:00100000:3.0:1787779832.211978:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779832.212006:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0346c21e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787779832.212915:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881512832 00000100:00100000:0.0:1787779832.212924:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881512832 00000100:00100000:0.0:1787779832.212964:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1787779832.212973:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046098cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+24:6509:x1874622881512832:12345-0@lo:501: 00000100:00100000:0.0:1787779832.213060:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046098cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+24:6509:x1874622881512832:12345-0@lo:501: Request processed in 87us (1080us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787779832.213067:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1787779832.213107:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477982d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881512832:0@lo:501: 10000000:01000000:0.0:1787779832.213261:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1787779832.213269:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c04766dc600/0xc8fc0a5179960623 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a517996062a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779832.213279:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff9c04766dc600/0xc8fc0a5179960623 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a517996062a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:1.0:1787779832.214648:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0347a85a40 x1874622881512448/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787779842 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787779832.214661:0:3640:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787779832.214670:0:3640:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1787779832.214685:0:3640:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1787779832.214691:0:3640:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1787779832.214694:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9c0347c9c800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1787779832.214720:0:3640:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1787779832.214729:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347a85a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1874622881512448:0@lo:8: 00000004:00080000:1.0:1787779832.214770:0:9896:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1787779832.215132:0:9896:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 240219291733ns, next at 0ns, rc = 0 00080000:00080000:1.0:1787779832.215139:0:9896:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00002000:00080000:2.0:1787779832.224221:0:8428:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:2.0:1787779832.224231:0:8428:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1787779832.224322:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346efed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:9892:x1874622881512320:12345-0@lo:7: Request processed in 23966us (24084us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779832.224333:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:2.0:1787779832.224383:0:9892:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0346efd2c0 x1874622881512320/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787779848 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787779832.224399:0:9892:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346efd2c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9892:1874622881512320:0@lo:7: 00000004:00080000:2.0:1787779832.224413:0:9892:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1787779832.224458:0:9892:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346efd2c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9892:1874622881512960:0@lo:5: 00000100:00100000:2.0:1787779832.224492:0:9892:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779832.224634:0:9892:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0341cb9600 going to sleep for 11 seconds 00000100:00100000:2.0:1787779832.224653:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881512960 00000100:00100000:2.0:1787779832.224660:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881512960 00000100:00100000:2.0:1787779832.224700:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787779832.224709:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346efc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:9892:x1874622881512960:12345-0@lo:5: 00002000:00080000:2.0:1787779832.224731:0:8430:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:2.0:1787779832.228601:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346efc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:9892:x1874622881512960:12345-0@lo:5: Request processed in 3884us (4098us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779832.228615:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:2.0:1787779832.228675:0:9892:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0346efd2c0 x1874622881512960/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787779848 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787779832.228689:0:9892:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346efd2c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9892:1874622881512960:0@lo:5: 00000004:00080000:2.0:1787779832.228703:0:9892:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x1:0x0] from OST, last_created [0x2c0000400:0x1:0x0]last_used is [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1787779832.228754:0:9892:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346efd2c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9892:1874622881513088:0@lo:5: 00000100:00100000:2.0:1787779832.229492:0:9892:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779832.229543:0:9892:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0341cb9600 going to sleep for 11 seconds 00000100:00100000:2.0:1787779832.229563:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881513088 00000100:00100000:2.0:1787779832.229569:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881513088 00000100:00100000:2.0:1787779832.229615:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787779832.229623:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347bcf840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:9892:x1874622881513088:12345-0@lo:5: 00002000:00080000:2.0:1787779832.229663:0:8430:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 2 00000100:00100000:2.0:1787779832.233328:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347bcf840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:9892:x1874622881513088:12345-0@lo:5: Request processed in 3698us (3829us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1787779832.233340:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1787779832.233450:0:9892:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0346efd2c0 x1874622881513088/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787779848 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787779832.233466:0:9892:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346efd2c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9892:1874622881513088:0@lo:5: 00000004:00080000:2.0:1787779832.233481:0:9892:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x1:0x0]-[0x2c0000400:0x21:0x0] 00000100:00100000:2.0:1787779832.235621:0:9892:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347bcfc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9892:1874622881513216:0@lo:900: 00000100:00100000:2.0:1787779832.235686:0:9892:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779832.235766:0:9892:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0341cb9600 going to sleep for 11 seconds 00000004:00080000:1.0:1787779832.241944:0:6491:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:1.0:1787779832.242273:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787779832.242294:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346de3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881513344:0@lo:13: 00000100:00100000:1.0:1787779832.242362:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779832.242415:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881513344 00000100:00100000:1.0:1787779832.242423:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881513344 00000100:00100000:1.0:1787779832.242480:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787779832.242489:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346de30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3642:x1874622881513344:12345-0@lo:13: 00002000:00000024:1.0:1787779832.242521:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923808256 avail 3692285952 00000100:00100000:1.0:1787779832.242566:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346de30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3642:x1874622881513344:12345-0@lo:13: Request processed in 78us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779832.242574:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:1.0:1787779832.242594:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1787779832.242620:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0346de3840 x1874622881513344/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779848 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787779832.242637:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346de3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881513344:0@lo:13: 00000004:00080000:1.0:1787779832.242654:0:9898:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:1.0:1787779832.242672:0:9898:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346de3840 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9898:1874622881513472:0@lo:7: 00000100:00100000:1.0:1787779832.242694:0:9898:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779832.242727:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881513472 00000100:00100000:1.0:1787779832.242730:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881513472 00000100:00100000:1.0:1787779832.242768:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787779832.242774:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346de2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:9898:x1874622881513472:12345-0@lo:7: 00000100:00100000:0.0:1787779832.247241:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881513216 00000100:00100000:0.0:1787779832.247256:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881513216 00000100:00100000:0.0:1787779832.247315:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787779832.247326:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347bcc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:9892:x1874622881513216:12345-0@lo:900: 00000100:00100000:0.0:1787779832.247418:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347bcc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:9892:x1874622881513216:12345-0@lo:900: Request processed in 95us (11732us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779832.247425:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1787779832.247478:0:9892:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0347bcfc00 x1874622881513216/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787779848 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787779832.247493:0:9892:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347bcfc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9892:1874622881513216:0@lo:900: 00000100:00100000:0.0:1787779832.248226:0:9898:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c04779ae300 going to sleep for 11 seconds 00002000:00080000:0.0:1787779832.260045:0:8427:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:0.0:1787779832.260054:0:8427:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:0.0:1787779832.260321:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346de2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:9898:x1874622881513472:12345-0@lo:7: Request processed in 17542us (17621us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779832.260332:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1787779832.260422:0:9898:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0346de3840 x1874622881513472/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787779848 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787779832.260436:0:9898:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346de3840 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9898:1874622881513472:0@lo:7: 00000004:00080000:1.0:1787779832.260450:0:9898:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:1.0:1787779832.260486:0:9898:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346de3840 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9898:1874622881513600:0@lo:5: 00000100:00100000:1.0:1787779832.260590:0:9898:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779832.260671:0:9898:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c04779ae300 going to sleep for 11 seconds 00000100:00100000:2.0:1787779832.261033:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881513600 00000100:00100000:2.0:1787779832.261040:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881513600 00000100:00100000:3.0:1787779832.261249:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787779832.261259:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346de0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:9898:x1874622881513600:12345-0@lo:5: 00002000:00080000:3.0:1787779832.261285:0:8430:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1787779832.261289:0:8430:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000001:00080000:3.0:1787779832.265827:0:9508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000001:00080000:3.0:1787779832.266032:0:9508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:3.0:1787779832.266040:0:9508:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1787779832.266338:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346de0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:9898:x1874622881513600:12345-0@lo:5: Request processed in 5076us (5743us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1787779832.266348:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:1.0:1787779832.267761:0:9898:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0346de3840 x1874622881513600/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787779848 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787779832.267775:0:9898:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1787779832.267782:0:9898:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346de3840 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9898:1874622881513600:0@lo:5: 00000004:00080000:1.0:1787779832.267797:0:9898:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:0.0:1787779832.268283:0:9898:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347a86580 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9898:1874622881513728:0@lo:700: 00000100:00100000:0.0:1787779832.268337:0:9898:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779832.268416:0:9898:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0346b50480 going to sleep for 11 seconds 00000100:00100000:1.0:1787779832.268450:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881513728 00000100:00100000:1.0:1787779832.268455:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881513728 00000100:00100000:1.0:1787779832.268606:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787779832.268616:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347a84780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9898:x1874622881513728:12345-0@lo:700: 00000100:00100000:1.0:1787779832.289200:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347a84780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9898:x1874622881513728:12345-0@lo:700: Request processed in 20578us (20855us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779832.289217:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1787779832.289355:0:9898:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0347a86580 x1874622881513728/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787779848 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787779832.289383:0:9898:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347a86580 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9898:1874622881513728:0@lo:700: 00000004:02000040:1.0:1787779832.296435:0:9898:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 00000100:00100000:0.0:1787779832.308017:0:9898:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347a86580 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9898:1874622881513856:0@lo:5: 00000100:00100000:0.0:1787779832.308087:0:9898:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779832.308204:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881513856 00000100:00100000:1.0:1787779832.308222:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881513856 00000100:00100000:1.0:1787779832.308274:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787779832.308284:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347a84f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:9898:x1874622881513856:12345-0@lo:5: 00000100:00100000:0.0:1787779832.308936:0:9898:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0346b50480 going to sleep for 11 seconds 00002000:00080000:1.0:1787779832.316504:0:9899:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:1.0:1787779832.316537:0:9899:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2 00000100:00100000:0.0:1787779832.321627:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347a84f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:9898:x1874622881513856:12345-0@lo:5: Request processed in 13336us (13532us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1787779832.321640:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1787779832.321728:0:9898:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0347a86580 x1874622881513856/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787779848 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787779832.321819:0:9898:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347a86580 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9898:1874622881513856:0@lo:5: 00000004:00080000:2.0:1787779832.321835:0:9898:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1:0x0]-[0x2c0000401:0x21:0x0] 00000100:00100000:2.0:1787779832.604041:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346de3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874622881513984:0@lo:13: 00000100:00100000:2.0:1787779832.604289:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779832.604327:0:8529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881513984 00000100:00100000:3.0:1787779832.604334:0:8529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881513984 00000100:00100000:3.0:1787779832.604384:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787779832.604393:0:8529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347bced00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1874622881513984:12345-0@lo:13: 00002000:00000024:3.0:1787779832.604419:0:8529:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787779832.604466:0:8529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347bced00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1874622881513984:12345-0@lo:13: Request processed in 74us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779832.604472:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1787779832.604531:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0346de3840 x1874622881513984/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779848 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787779832.604549:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346de3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874622881513984:0@lo:13: 00000020:00000004:2.0:1787779832.848227:0:9931:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787779832.848551:0:9931:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787779832.928540:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787779833.118555:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347a87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881514112:0@lo:13: 00000100:00100000:3.0:1787779833.118624:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779833.118888:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881514112 00000100:00100000:0.0:1787779833.118896:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881514112 00000100:00100000:0.0:1787779833.118951:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787779833.118960:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04779830c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881514112:12345-0@lo:13: 00002000:00000024:0.0:1787779833.118982:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787779833.119032:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04779830c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881514112:12345-0@lo:13: Request processed in 73us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779833.119039:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1787779833.119078:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0347a87480 x1874622881514112/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779849 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787779833.119094:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347a87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881514112:0@lo:13: 00000100:00080000:3.0:1787779833.119249:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1787779833.749769:0:9508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00010000:00010000:1.0:1787779833.948220:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787779834.653239:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346de2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881514240:0@lo:41: 00000100:00100000:3.0:1787779834.653307:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779834.653496:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881514240 00000100:00100000:1.0:1787779834.653504:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881514240 00000100:00100000:1.0:1787779834.653557:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787779834.653568:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477980780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881514240:12345-0@lo:41: 00000004:00000024:1.0:1787779834.653601:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1787779834.653647:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477980780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881514240:12345-0@lo:41: Request processed in 82us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779834.653654:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787779834.657046:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346de2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881514240:0@lo:41: 00010000:00010000:2.0:1787779834.972555:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787779835.165142:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787779835.165166:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347a87c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881514368:0@lo:41: 00000100:00100000:0.0:1787779835.165230:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779835.167735:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881514368 00000100:00100000:1.0:1787779835.167749:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881514368 00000100:00100000:1.0:1787779835.167808:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787779835.167817:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347a85e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1874622881514368:12345-0@lo:41: 00000004:00000024:1.0:1787779835.168101:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787779835.168185:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347a85e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1874622881514368:12345-0@lo:41: Request processed in 368us (2954us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779835.168193:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787779835.168292:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347a87c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881514368:0@lo:41: 00000020:00000004:0.0:1787779835.581474:0:10032:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787779835.581711:0:10032:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787779835.996350:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1787779836.573578:0:10080:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787779836.573590:0:10080:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:1.0:1787779837.020052:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787779837.165741:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787779837.166028:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863638656 00000100:00100000:2.0:1787779837.166038:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863638656 00000100:00100000:2.0:1787779837.166098:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 180 00000100:00100000:2.0:1787779837.166106:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046098dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2407:x1874622863638656:12345-192.168.203.31@tcp:250: 00010000:00080000:2.0:1787779837.166156:0:6507:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from d07925b3-67b5-4bfe-9c63-01bf2f1cd011@192.168.203.31@tcp t0 exp 0000000000000000 cur 245 last 0 00000020:00000080:2.0:1787779837.166186:0:6507:0:(genops.c:1385:class_connect()) connect: client d07925b3-67b5-4bfe-9c63-01bf2f1cd011, cookie 0xc8fc0a5179960631 00000100:00080000:2.0:1787779837.166328:0:6507:0:(import.c:65:import_set_state_nolock()) ffff9c0347d2c000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787779837.166397:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046098dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+5:2407:x1874622863638656:12345-192.168.203.31@tcp:250: Request processed in 290us (665us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779837.166405:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 180 00000100:00100000:3.0:1787779837.183309:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787779837.184350:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863638784 00000100:00100000:0.0:1787779837.184361:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863638784 00000100:00100000:0.0:1787779837.184483:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 181 00000100:00100000:0.0:1787779837.184493:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046082b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+5:6165:x1874622863638784:12345-192.168.203.31@tcp:101: 00010000:00010000:0.0:1787779837.184516:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787779837.184533:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0440030400/0xc8fc0a5179960638 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xf757128131ea1c56 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779837.184562:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0440030400/0xc8fc0a5179960638 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1c56 expref: 6 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779837.184573:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0440030400/0xc8fc0a5179960638 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1c56 expref: 6 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779837.184583:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0440030400, rc 0) 00000100:00100000:0.0:1787779837.184721:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046082b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+6:6165:x1874622863638784:12345-192.168.203.31@tcp:101: Request processed in 229us (1420us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779837.184728:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 181 00000100:00100000:3.0:1787779837.188059:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787779837.191879:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863638912 00000100:00100000:0.0:1787779837.191893:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863638912 00000100:00100000:0.0:1787779837.192024:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 182 00000100:00100000:0.0:1787779837.192035:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0460828850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+6:6165:x1874622863638912:12345-192.168.203.31@tcp:501: 00000100:00100000:0.0:1787779837.192187:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0460828850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+6:6165:x1874622863638912:12345-192.168.203.31@tcp:501: Request processed in 153us (4137us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787779837.192208:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 182 00000100:00100000:1.0:1787779837.195927:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787779837.196019:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863639040 00000100:00100000:2.0:1787779837.196028:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863639040 00000100:00100000:2.0:1787779837.196081:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 183 00000100:00100000:2.0:1787779837.196100:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0448bf3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+6:6165:x1874622863639040:12345-192.168.203.31@tcp:101: 00010000:00010000:2.0:1787779837.196116:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787779837.196132:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0477a70e00/0xc8fc0a517996063f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xf757128131ea1c5d expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779837.196168:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0477a70e00/0xc8fc0a517996063f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1c5d expref: 7 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779837.196178:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0477a70e00/0xc8fc0a517996063f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1c5d expref: 7 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779837.196186:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0477a70e00, rc 0) 00000100:00100000:2.0:1787779837.196467:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0448bf3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+7:6165:x1874622863639040:12345-192.168.203.31@tcp:101: Request processed in 375us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779837.196474:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 183 00000100:00100000:3.0:1787779837.200576:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787779837.200830:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863639168 00000100:00100000:0.0:1787779837.200878:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863639168 00000100:00100000:0.0:1787779837.200936:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 184 00000100:00100000:0.0:1787779837.200946:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c045ab81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+7:6165:x1874622863639168:12345-192.168.203.31@tcp:501: 00000100:00100000:0.0:1787779837.201111:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c045ab81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+8:6165:x1874622863639168:12345-192.168.203.31@tcp:501: Request processed in 165us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779837.201118:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 184 00000100:00100000:2.0:1787779837.212443:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347a87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1f575176-36bc-4786-83ee-2fea064a12a9:3642:1874622881514496:0@lo:400: 00000100:00100000:2.0:1787779837.212521:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779837.212583:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477940780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881515008:0@lo:400: 00000100:00100000:2.0:1787779837.212620:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779837.212642:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0476494f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881515520:0@lo:400: 00000100:00100000:2.0:1787779837.212667:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779837.212682:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0476497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881516032:0@lo:400: 00000100:00100000:2.0:1787779837.212701:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779837.212738:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1787779837.212744:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0461bec780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1874622881514880:0@lo:400: 00000100:00100000:2.0:1787779837.212767:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779837.212783:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477af0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874622881515392:0@lo:400: 00000100:00100000:2.0:1787779837.212800:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779837.212814:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0476495a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874622881515904:0@lo:400: 00000100:00100000:2.0:1787779837.212831:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779837.212888:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881515008 00000100:00100000:2.0:1787779837.212895:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881515008 00000100:00100000:2.0:1787779837.212938:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787779837.212946:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347bcf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1874622881515008:12345-0@lo:400: 00000100:00100000:2.0:1787779837.212997:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347bcf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1874622881515008:12345-0@lo:400: Request processed in 51us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779837.213004:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787779837.213024:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881515520 00000100:00100000:2.0:1787779837.213028:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881515520 00000100:00100000:2.0:1787779837.213058:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881516032 00000100:00100000:2.0:1787779837.213061:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881516032 00000100:00100000:3.0:1787779837.213270:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347a85a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1874622881514624:0@lo:400: 00000100:00100000:3.0:1787779837.213304:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779837.213323:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04779421c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1874622881515136:0@lo:400: 00000100:00100000:3.0:1787779837.213343:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779837.213362:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0476494780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1874622881515648:0@lo:400: 00000100:00100000:3.0:1787779837.213380:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779837.213409:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1787779837.213416:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347a87c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881514752:0@lo:400: 00000100:00100000:3.0:1787779837.213438:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779837.213453:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04779403c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1874622881515264:0@lo:400: 00000100:00100000:3.0:1787779837.213471:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779837.213481:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0476496580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1874622881515776:0@lo:400: 00000100:00100000:3.0:1787779837.213499:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779837.213522:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881514880 00000100:00100000:3.0:1787779837.213525:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881514880 00000100:00100000:3.0:1787779837.213548:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881514624 00000100:00100000:3.0:1787779837.213550:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881514624 00000100:00100000:3.0:1787779837.213561:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881515136 00000100:00100000:3.0:1787779837.213563:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881515136 00000100:00100000:3.0:1787779837.213574:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881515648 00000100:00100000:3.0:1787779837.213577:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881515648 00000100:00100000:3.0:1787779837.213587:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881515264 00000100:00100000:3.0:1787779837.213590:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881515264 00000100:00100000:3.0:1787779837.213601:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881515776 00000100:00100000:3.0:1787779837.213603:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881515776 00000100:00100000:3.0:1787779837.213614:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787779837.213619:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347bcda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1874622881514880:12345-0@lo:400: 00000100:00100000:3.0:1787779837.213652:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347bcda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1874622881514880:12345-0@lo:400: Request processed in 34us (885us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779837.213658:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787779837.213670:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787779837.213675:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477980f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1874622881514624:12345-0@lo:400: 00000100:00100000:3.0:1787779837.213716:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477980f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1874622881514624:12345-0@lo:400: Request processed in 41us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779837.213721:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787779837.213740:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787779837.213746:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477982580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1874622881515136:12345-0@lo:400: 00000100:00100000:3.0:1787779837.213773:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477982580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1874622881515136:12345-0@lo:400: Request processed in 27us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779837.213778:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787779837.213789:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787779837.213794:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477983480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1874622881515648:12345-0@lo:400: 00000100:00100000:3.0:1787779837.213819:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477983480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1874622881515648:12345-0@lo:400: Request processed in 25us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779837.213824:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787779837.213834:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787779837.213866:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477981a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1874622881515264:12345-0@lo:400: 00000100:00100000:3.0:1787779837.213893:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477981a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1874622881515264:12345-0@lo:400: Request processed in 29us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779837.213898:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787779837.213909:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787779837.213915:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477982d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1874622881515776:12345-0@lo:400: 00000100:00100000:3.0:1787779837.213940:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477982d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1874622881515776:12345-0@lo:400: Request processed in 25us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779837.213945:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:3.0:1787779837.213980:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c04779403c0 x1874622881515264/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779853 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779837.213992:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04779403c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1874622881515264:0@lo:400: 00010000:00080000:3.0:1787779837.214001:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0476496580 x1874622881515776/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779853 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779837.214022:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0476496580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1874622881515776:0@lo:400: 00010000:00080000:3.0:1787779837.214033:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0347a85a40 x1874622881514624/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779853 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779837.214041:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347a85a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1874622881514624:0@lo:400: 00010000:00080000:3.0:1787779837.214049:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c04779421c0 x1874622881515136/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779853 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779837.214057:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04779421c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1874622881515136:0@lo:400: 00010000:00080000:3.0:1787779837.214065:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0476494780 x1874622881515648/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779853 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779837.214072:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0476494780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1874622881515648:0@lo:400: 00000100:00080000:1.0:1787779837.214682:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787779837.214688:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787779837.214691:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787779837.214692:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787779837.214716:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881514752 00000100:00100000:1.0:1787779837.214729:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881514752 00000100:00100000:1.0:1787779837.214761:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787779837.214768:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04779812c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881514752:12345-0@lo:400: 00000100:00100000:1.0:1787779837.214813:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04779812c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881514752:12345-0@lo:400: Request processed in 45us (1374us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779837.214819:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787779837.214866:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881515392 00000100:00100000:1.0:1787779837.214870:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881515392 00000100:00100000:1.0:1787779837.214894:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881515904 00000100:00100000:1.0:1787779837.214898:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881515904 00000100:00100000:1.0:1787779837.214910:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787779837.214916:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347bccf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1874622881515520:12345-0@lo:400: 00000100:00100000:1.0:1787779837.214947:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347bccf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1874622881515520:12345-0@lo:400: Request processed in 31us (2278us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779837.214953:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787779837.214965:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787779837.214970:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347bcc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1874622881515392:12345-0@lo:400: 00000100:00100000:1.0:1787779837.214996:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347bcc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1874622881515392:12345-0@lo:400: Request processed in 26us (2195us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779837.215002:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787779837.215012:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787779837.215018:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347bcde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1874622881515904:12345-0@lo:400: 00000100:00100000:1.0:1787779837.215041:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347bcde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1874622881515904:12345-0@lo:400: Request processed in 24us (2209us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779837.215046:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:1.0:1787779837.215060:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787779837.215062:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787779837.215295:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0461bec780 x1874622881514880/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779853 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787779837.215315:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0461bec780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1874622881514880:0@lo:400: 00010000:00080000:1.0:1787779837.215330:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0477af0f00 x1874622881515392/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779853 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787779837.215337:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477af0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874622881515392:0@lo:400: 00010000:00080000:1.0:1787779837.215346:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0476495a40 x1874622881515904/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779853 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787779837.215352:0:3642:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1787779837.215363:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0476495a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874622881515904:0@lo:400: 00000100:00100000:1.0:1787779837.215373:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477940780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881515008:0@lo:400: 00010000:00080000:1.0:1787779837.215382:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0476494f00 x1874622881515520/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779853 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787779837.215389:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0476494f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881515520:0@lo:400: 00000100:00100000:1.0:1787779837.215415:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787779837.215421:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347bcc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1874622881516032:12345-0@lo:400: 00000100:00100000:1.0:1787779837.215456:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347bcc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1874622881516032:12345-0@lo:400: Request processed in 35us (2753us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779837.215461:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:1.0:1787779837.215483:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0476497480 x1874622881516032/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779853 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787779837.215491:0:3642:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:1.0:1787779837.215501:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0476497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881516032:0@lo:400: 00000100:00100000:0.0:1787779837.215683:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881514496 00000100:00100000:0.0:1787779837.215688:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881514496 00000100:00100000:0.0:1787779837.215738:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1787779837.215745:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c045ab83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+24:3642:x1874622881514496:12345-0@lo:400: 00000100:00100000:0.0:1787779837.215784:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c045ab83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+24:3642:x1874622881514496:12345-0@lo:400: Request processed in 40us (3263us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779837.215790:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1787779837.215942:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347a87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1f575176-36bc-4786-83ee-2fea064a12a9:3642:1874622881514496:0@lo:400: 00000100:00100000:2.0:1787779837.216151:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787779837.216168:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0476497c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881516160:0@lo:13: 00000100:00100000:2.0:1787779837.216896:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779837.217328:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881516160 00000100:00100000:0.0:1787779837.217335:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881516160 00000100:00100000:0.0:1787779837.217380:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787779837.217388:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347bce580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881516160:12345-0@lo:13: 00002000:00000024:0.0:1787779837.217415:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787779837.217462:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347bce580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881516160:12345-0@lo:13: Request processed in 74us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779837.217468:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:2.0:1787779837.218800:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0476497c00 x1874622881516160/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779853 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787779837.218867:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0476497c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881516160:0@lo:13: 00000100:00100000:3.0:1787779837.219045:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347a87c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881514752:0@lo:400: 00000100:00100000:2.0:1787779837.219869:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787779837.220295:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863639296 00000100:00100000:0.0:1787779837.220312:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863639296 00000100:00100000:0.0:1787779837.220363:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 186 00000100:00100000:0.0:1787779837.220373:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0478612050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+8:6165:x1874622863639296:12345-192.168.203.31@tcp:503: 00000100:00100000:0.0:1787779837.220516:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0478612050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+8:6165:x1874622863639296:12345-192.168.203.31@tcp:503: Request processed in 143us (677us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779837.220524:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 186 00000100:00100000:1.0:1787779837.226077:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787779837.227202:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863639424 00000100:00100000:0.0:1787779837.227213:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863639424 00000100:00100000:0.0:1787779837.227348:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 187 00000100:00100000:0.0:1787779837.227360:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0478610450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+8:6183:x1874622863639424:12345-192.168.203.31@tcp:502: 00000100:00100000:0.0:1787779837.227521:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0478610450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+8:6183:x1874622863639424:12345-192.168.203.31@tcp:502: Request processed in 163us (1454us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779837.227530:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 187 00000100:00100000:3.0:1787779837.273424:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787779837.273581:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863639552 00000100:00100000:1.0:1787779837.273591:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863639552 00000100:00100000:1.0:1787779837.273701:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 188 00000100:00100000:1.0:1787779837.273713:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0478611450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+8:6183:x1874622863639552:12345-192.168.203.31@tcp:502: 00000100:00100000:1.0:1787779837.273905:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0478611450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+8:6183:x1874622863639552:12345-192.168.203.31@tcp:502: Request processed in 194us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779837.273913:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 188 00000100:00100000:3.0:1787779837.282084:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787779837.282194:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863639680 00000100:00100000:0.0:1787779837.282211:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863639680 00000100:00100000:0.0:1787779837.282288:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 189 00000100:00100000:0.0:1787779837.282299:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0478610c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+8:6165:x1874622863639680:12345-192.168.203.31@tcp:101: 00010000:00010000:0.0:1787779837.282315:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787779837.282334:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0440031000/0xc8fc0a5179960646 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf757128131ea1c8e expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779837.282361:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0440031000/0xc8fc0a5179960646 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1c8e expref: 9 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779837.282371:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0440031000/0xc8fc0a5179960646 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1c8e expref: 9 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779837.282380:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0440031000, rc 0) 00000100:00100000:0.0:1787779837.282462:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0478610c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+9:6165:x1874622863639680:12345-192.168.203.31@tcp:101: Request processed in 165us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779837.282470:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 189 00000100:00100000:0.0:1787779837.289588:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787779837.289896:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863639808 00000100:00100000:1.0:1787779837.289906:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863639808 00000100:00100000:1.0:1787779837.289962:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 190 00000100:00100000:1.0:1787779837.289971:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0478611c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+9:6165:x1874622863639808:12345-192.168.203.31@tcp:256: 20000000:01000000:1.0:1787779837.289996:0:6506:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1787779837.290018:0:6506:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1787779837.290022:0:6506:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1787779837.290025:0:6506:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1787779837.290028:0:6506:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1787779837.290030:0:6506:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:1.0:1787779837.294985:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0478611c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+9:6165:x1874622863639808:12345-192.168.203.31@tcp:256: Request processed in 4999us (5391us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779837.295005:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 190 00000100:00100000:3.0:1787779837.298602:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787779837.298995:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863639936 00000100:00100000:2.0:1787779837.299008:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863639936 00000100:00100000:2.0:1787779837.299212:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 191 00000100:00100000:2.0:1787779837.299226:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0478610050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+9:6165:x1874622863639936:12345-192.168.203.31@tcp:101: 00010000:00010000:2.0:1787779837.299249:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787779837.299272:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0477a70200/0xc8fc0a517996064d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf757128131ea1c95 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779837.299308:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0477a70200/0xc8fc0a517996064d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1c95 expref: 10 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779837.299320:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0477a70200/0xc8fc0a517996064d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1c95 expref: 10 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779837.299330:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0477a70200, rc 0) 00000100:00100000:2.0:1787779837.299409:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0478610050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+10:6165:x1874622863639936:12345-192.168.203.31@tcp:101: Request processed in 184us (822us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779837.301261:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 191 00000100:00100000:0.0:1787779837.302165:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787779837.302365:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863640064 00000100:00100000:1.0:1787779837.302378:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863640064 00000100:00100000:1.0:1787779837.302448:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 192 00000100:00100000:1.0:1787779837.302459:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0442d5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+10:6165:x1874622863640064:12345-192.168.203.31@tcp:501: 00000100:00100000:1.0:1787779837.302671:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0442d5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+10:6165:x1874622863640064:12345-192.168.203.31@tcp:501: Request processed in 213us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779837.302681:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 192 00000100:00100000:3.0:1787779837.304952:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787779837.305066:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863640192 00000100:00100000:2.0:1787779837.305077:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863640192 00000100:00100000:2.0:1787779837.305156:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 193 00000100:00100000:2.0:1787779837.305167:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0442d58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+10:6165:x1874622863640192:12345-192.168.203.31@tcp:503: 00000100:00100000:2.0:1787779837.305368:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0442d58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+10:6165:x1874622863640192:12345-192.168.203.31@tcp:503: Request processed in 202us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779837.305388:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 193 00000100:00100000:3.0:1787779837.308556:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787779837.308789:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863640320 00000100:00100000:0.0:1787779837.308804:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863640320 00000100:00100000:0.0:1787779837.308930:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 194 00000100:00100000:0.0:1787779837.308942:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0442d59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+10:6188:x1874622863640320:12345-192.168.203.31@tcp:502: 00000100:00100000:0.0:1787779837.309157:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0442d59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+10:6188:x1874622863640320:12345-192.168.203.31@tcp:502: Request processed in 217us (618us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779837.309166:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 194 00000100:00100000:0.0:1787779837.312060:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787779837.312462:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863640448 00000100:00100000:1.0:1787779837.312475:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863640448 00000100:00100000:1.0:1787779837.312543:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 195 00000100:00100000:1.0:1787779837.312553:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0442d58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+10:6188:x1874622863640448:12345-192.168.203.31@tcp:502: 00000100:00100000:1.0:1787779837.312754:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0442d58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+10:6188:x1874622863640448:12345-192.168.203.31@tcp:502: Request processed in 200us (705us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779837.312762:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 195 00000100:00100000:3.0:1787779837.316752:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787779837.316825:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787779837.317280:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863640576 00000100:00100000:1.0:1787779837.317293:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863640576 00000100:00100000:1.0:1787779837.317344:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863640832 00000100:00100000:1.0:1787779837.317348:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863640832 00000100:00100000:1.0:1787779837.317375:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 7 00000100:00100000:1.0:1787779837.317385:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0345e752c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2407:x1874622863640576:12345-192.168.203.31@tcp:38: 00010000:00080000:1.0:1787779837.317426:0:6513:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 781d29bb-23d2-48e3-b16d-c29e52cd5375@192.168.203.31@tcp t0 exp 0000000000000000 cur 245 last 0 00000020:00000080:1.0:1787779837.317493:0:6513:0:(genops.c:1385:class_connect()) connect: client 781d29bb-23d2-48e3-b16d-c29e52cd5375, cookie 0xc8fc0a5179960654 00000004:00100000:1.0:1787779837.317528:0:6513:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1787779837.317799:0:6513:0:(import.c:65:import_set_state_nolock()) ffff9c0347cef000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787779837.317948:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0345e752c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+6:2407:x1874622863640576:12345-192.168.203.31@tcp:38: Request processed in 562us (1212us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779837.317958:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 7 00000100:00100000:1.0:1787779837.317984:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 8 00000100:00100000:1.0:1787779837.317989:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0345e76940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2407:x1874622863640832:12345-192.168.203.31@tcp:38: 00010000:00080000:1.0:1787779837.318009:0:6513:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 781d29bb-23d2-48e3-b16d-c29e52cd5375@192.168.203.31@tcp t0 exp 0000000000000000 cur 245 last 0 00000020:00000080:1.0:1787779837.318046:0:6513:0:(genops.c:1385:class_connect()) connect: client 781d29bb-23d2-48e3-b16d-c29e52cd5375, cookie 0xc8fc0a517996065b 00000004:00100000:1.0:1787779837.318062:0:6513:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:1.0:1787779837.319257:0:6513:0:(import.c:65:import_set_state_nolock()) ffff9c0347ced800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787779837.319349:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0345e76940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+6:2407:x1874622863640832:12345-192.168.203.31@tcp:38: Request processed in 1356us (2521us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779837.319360:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 8 00000100:00100000:3.0:1787779837.725012:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346de03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881516288:0@lo:13: 00000100:00100000:3.0:1787779837.726197:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779837.728665:0:8529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881516288 00000100:00100000:0.0:1787779837.728686:0:8529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881516288 00000100:00100000:0.0:1787779837.728789:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787779837.728803:0:8529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c047798a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881516288:12345-0@lo:13: 00002000:00000024:0.0:1787779837.728910:0:8529:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787779837.729010:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347bcf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881516416:0@lo:13: 00000100:00100000:0.0:1787779837.729049:0:8529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c047798a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881516288:12345-0@lo:13: Request processed in 248us (2856us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779837.729060:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787779837.729075:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1787779837.729113:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0346de03c0 x1874622881516288/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779853 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779837.729139:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346de03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881516288:0@lo:13: 00000100:00100000:0.0:1787779837.730282:0:8529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881516416 00000100:00100000:0.0:1787779837.730295:0:8529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881516416 00000100:00100000:0.0:1787779837.730420:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787779837.730431:0:8529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346de0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874622881516416:12345-0@lo:13: 00002000:00000024:0.0:1787779837.730458:0:8529:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787779837.731886:0:8529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346de0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874622881516416:12345-0@lo:13: Request processed in 1446us (2802us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779837.731920:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:1.0:1787779837.735952:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0347bcf0c0 x1874622881516416/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779853 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787779837.735990:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347bcf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881516416:0@lo:13: 00010000:00010000:2.0:1787779838.046711:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787779838.236805:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477989a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881516544:0@lo:13: 00000100:00100000:2.0:1787779838.236933:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779838.237569:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881516544 00000100:00100000:3.0:1787779838.237584:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881516544 00000100:00100000:3.0:1787779838.237655:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787779838.237668:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347bcfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1874622881516544:12345-0@lo:13: 00002000:00000024:3.0:1787779838.237702:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787779838.237777:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347bcfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1874622881516544:12345-0@lo:13: Request processed in 111us (844us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779838.237784:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:0.0:1787779838.237887:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0477989a40 x1874622881516544/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779854 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787779838.237912:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477989a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881516544:0@lo:13: 00000100:00100000:3.0:1787779838.326709:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787779838.326768:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787779838.326926:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787779838.337572:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863641088 00000100:00100000:0.0:1787779838.337595:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863641088 00000100:00080000:3.0:1787779838.337710:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787779838.337735:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863640704 00000100:00100000:0.0:1787779838.337741:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863640704 00000100:00100000:3.0:1787779838.337759:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863640960 00000100:00100000:3.0:1787779838.337765:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863640960 00000100:00100000:0.0:1787779838.337772:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 9 00000100:00100000:0.0:1787779838.337787:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c047798b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+7:6165:x1874622863641088:12345-192.168.203.31@tcp:41: 00000100:00100000:3.0:1787779838.337807:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 10 00000100:00100000:3.0:1787779838.337818:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c047798b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+7:0:x1874622863640704:12345-192.168.203.31@tcp:41: 00000004:00000024:3.0:1787779838.337870:0:6514:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000004:00000024:0.0:1787779838.337870:0:6512:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1787779838.339252:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c047798b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+7:0:x1874622863640704:12345-192.168.203.31@tcp:41: Request processed in 1427us (12474us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779838.339267:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 10 00000100:00100000:3.0:1787779838.339313:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 11 00000100:00100000:3.0:1787779838.339326:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04779892c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+6:0:x1874622863640960:12345-192.168.203.31@tcp:41: 00000004:00000024:3.0:1787779838.339361:0:6514:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787779838.339389:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04779892c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+6:0:x1874622863640960:12345-192.168.203.31@tcp:41: Request processed in 68us (12463us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779838.339396:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 11 00000100:00080000:3.0:1787779838.339443:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787779838.339673:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c047798b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+6:6165:x1874622863641088:12345-192.168.203.31@tcp:41: Request processed in 1889us (12978us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779838.339683:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 9 00000100:00100000:2.0:1787779838.347144:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787779838.347497:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863641216 00000100:00100000:3.0:1787779838.347511:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863641216 00000100:00100000:3.0:1787779838.347810:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 12 00000100:00100000:3.0:1787779838.347824:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347bcf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+6:6165:x1874622863641216:12345-192.168.203.31@tcp:40: 00000100:00100000:3.0:1787779838.348012:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347bcf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+6:6165:x1874622863641216:12345-192.168.203.31@tcp:40: Request processed in 191us (886us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779838.348021:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 12 00000100:00100000:3.0:1787779838.353990:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787779838.354631:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863641600 00000100:00100000:0.0:1787779838.354647:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863641600 00000100:00100000:0.0:1787779838.356716:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 4 00000100:00100000:0.0:1787779838.356750:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477989a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:781d29bb-23d2-48e3-b16d-c29e52cd5375+6:6165:x1874622863641600:12345-192.168.203.31@tcp:900: 00000100:00100000:0.0:1787779838.357266:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477989a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:781d29bb-23d2-48e3-b16d-c29e52cd5375+6:6165:x1874622863641600:12345-192.168.203.31@tcp:900: Request processed in 531us (3290us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779838.357278:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 4 00000100:00100000:0.0:1787779838.362757:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787779838.362966:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787779838.362995:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787779838.363049:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863641344 00000100:00100000:0.0:1787779838.363061:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863641344 00000100:00100000:0.0:1787779838.363142:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863641472 00000100:00100000:0.0:1787779838.363146:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863641472 00000100:00100000:0.0:1787779838.363165:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 16 00000100:00100000:0.0:1787779838.363175:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0476495e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2407:x1874622863641344:12345-192.168.203.31@tcp:8: 00010000:00080000:0.0:1787779838.363557:0:8430:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 781d29bb-23d2-48e3-b16d-c29e52cd5375@192.168.203.31@tcp t0 exp 0000000000000000 cur 246 last 0 00000020:00000080:0.0:1787779838.363605:0:8430:0:(genops.c:1385:class_connect()) connect: client 781d29bb-23d2-48e3-b16d-c29e52cd5375, cookie 0xc8fc0a5179960662 00002000:00100000:0.0:1787779838.363618:0:8430:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 781d29bb-23d2-48e3-b16d-c29e52cd5375/ffff9c0346f6f800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113939 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787779838.363630:0:8430:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787779838.363955:0:8430:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00100000:1.0:1787779838.364090:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 17 00000100:00100000:1.0:1787779838.364101:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0476494000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2407:x1874622863641472:12345-192.168.203.31@tcp:8: 00010000:00080000:1.0:1787779838.364132:0:8427:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 781d29bb-23d2-48e3-b16d-c29e52cd5375@192.168.203.31@tcp t0 exp 0000000000000000 cur 246 last 0 00000020:00000080:1.0:1787779838.364168:0:8427:0:(genops.c:1385:class_connect()) connect: client 781d29bb-23d2-48e3-b16d-c29e52cd5375, cookie 0xc8fc0a5179960669 00002000:00100000:1.0:1787779838.364180:0:8427:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 781d29bb-23d2-48e3-b16d-c29e52cd5375/ffff9c0347ced000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113939 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787779838.364191:0:8427:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787779838.364407:0:8427:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787779838.364449:0:8427:0:(import.c:65:import_set_state_nolock()) ffff9c0347cea000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787779838.364558:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0476494000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+6:2407:x1874622863641472:12345-192.168.203.31@tcp:8: Request processed in 456us (1560us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779838.364567:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 17 00000100:00100000:1.0:1787779838.364606:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863641728 00000100:00100000:1.0:1787779838.364612:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863641728 00000100:00100000:1.0:1787779838.364650:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 196 00000100:00100000:1.0:1787779838.364657:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0442d59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+10:2411:x1874622863641728:12345-192.168.203.31@tcp:400: 00000100:00100000:1.0:1787779838.364686:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0442d59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+10:2411:x1874622863641728:12345-192.168.203.31@tcp:400: Request processed in 29us (1945us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779838.364700:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 196 00000100:00080000:0.0:1787779838.369744:0:8430:0:(import.c:65:import_set_state_nolock()) ffff9c0346f6d000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787779838.372216:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0476495e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+6:2407:x1874622863641344:12345-192.168.203.31@tcp:8: Request processed in 9030us (9238us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779838.372230:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 16 00000100:00100000:0.0:1787779838.376743:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787779838.377386:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863641856 00000100:00100000:1.0:1787779838.377403:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863641856 00000100:00100000:1.0:1787779838.377488:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 0 00000100:00100000:1.0:1787779838.377499:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0476496d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+6:6165:x1874622863641856:12345-192.168.203.31@tcp:33: 00000004:00080000:1.0:1787779838.407615:0:6515:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 30030us 00000004:00200000:0.0:1787779838.432010:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1787779838.432227:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0476496d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+6:6165:x1874622863641856:12345-192.168.203.31@tcp:33: Request processed in 54724us (55494us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779838.432242:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 0 00000100:00100000:2.0:1787779838.657621:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787779838.657712:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863641984 00000100:00100000:1.0:1787779838.657722:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863641984 00000100:00100000:1.0:1787779838.657773:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 13 00000100:00100000:1.0:1787779838.657783:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046efce940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+6:6206:x1874622863641984:12345-192.168.203.31@tcp:101: 00010000:00010000:1.0:1787779838.657803:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787779838.657915:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd7600/0xc8fc0a5179960670 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea1cc6 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779838.657990:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6400/0xc8fc0a5179960677 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779838.658003:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6400/0xc8fc0a5179960677 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779838.658016:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6400/0xc8fc0a5179960677 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787779838.658055:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787779838.658058:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787779838.658083:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6400/0xc8fc0a5179960677 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779838.658121:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd7600/0xc8fc0a5179960670 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1cc6 expref: 8 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779838.658139:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6400/0xc8fc0a5179960677 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1cc6 expref: 7 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779838.658147:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c0341cd4500) 00010000:00010000:1.0:1787779838.658150:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787779838.658153:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0346dd6400, rc 0) 00000100:00100000:1.0:1787779838.658213:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046efce940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+7:6206:x1874622863641984:12345-192.168.203.31@tcp:101: Request processed in 431us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779838.658220:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 13 00010000:00010000:0.0:1787779839.068513:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787779839.772375:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346de1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881516672:0@lo:41: 00000100:00100000:0.0:1787779839.772448:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779839.772627:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881516672 00000100:00100000:1.0:1787779839.772635:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881516672 00000100:00100000:1.0:1787779839.772690:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787779839.772700:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04764961c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881516672:12345-0@lo:41: 00000004:00000024:1.0:1787779839.772739:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1787779839.772792:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04764961c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881516672:12345-0@lo:41: Request processed in 93us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779839.772807:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787779839.772950:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346de1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881516672:0@lo:41: 00010000:00010000:1.0:1787779840.094316:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787779840.284234:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787779840.290798:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04764970c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881516800:0@lo:41: 00000100:00100000:1.0:1787779840.290916:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779840.298690:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881516800 00000100:00100000:2.0:1787779840.299380:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881516800 00000100:00100000:2.0:1787779840.299451:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787779840.299463:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346de1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881516800:12345-0@lo:41: 00000004:00000024:2.0:1787779840.299503:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787779840.299783:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346de1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881516800:12345-0@lo:41: Request processed in 322us (8866us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779840.299791:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787779840.308231:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04764970c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881516800:0@lo:41: 00000100:00100000:3.0:1787779840.753936:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787779840.755475:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863642112 00000100:00100000:0.0:1787779840.755496:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863642112 00000100:00100000:0.0:1787779840.755620:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 14 00000100:00100000:0.0:1787779840.755632:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04619552c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+7:6258:x1874622863642112:12345-192.168.203.31@tcp:41: 00000004:00000024:0.0:1787779840.755702:0:6514:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1787779840.756320:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04619552c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+7:6258:x1874622863642112:12345-192.168.203.31@tcp:41: Request processed in 687us (2396us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779840.756331:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 14 00000100:00080000:3.0:1787779840.756449:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787779840.761363:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787779840.761492:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863642240 00000100:00100000:1.0:1787779840.761586:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863642240 00000100:00100000:1.0:1787779840.761721:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 15 00000100:00100000:1.0:1787779840.761734:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04764952c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+6:6258:x1874622863642240:12345-192.168.203.31@tcp:41: 00000004:00000024:1.0:1787779840.761777:0:6513:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787779840.761905:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04764952c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+6:6258:x1874622863642240:12345-192.168.203.31@tcp:41: Request processed in 174us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779840.761915:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 15 00000100:00080000:3.0:1787779840.769067:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787779840.769320:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787779840.769417:0:8529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863642368 00000100:00100000:3.0:1787779840.769430:0:8529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863642368 00000100:00080000:1.0:1787779840.769508:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787779840.769525:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 18 00000100:00100000:3.0:1787779840.769538:0:8529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046efcf840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:781d29bb-23d2-48e3-b16d-c29e52cd5375+6:6258:x1874622863642368:12345-192.168.203.31@tcp:13: 00002000:00000024:3.0:1787779840.769581:0:8529:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787779840.769671:0:8529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046efcf840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:781d29bb-23d2-48e3-b16d-c29e52cd5375+6:6258:x1874622863642368:12345-192.168.203.31@tcp:13: Request processed in 136us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779840.769680:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 18 00000100:00100000:0.0:1787779840.771748:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787779840.771885:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863642496 00000100:00100000:2.0:1787779840.771896:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863642496 00000100:00100000:2.0:1787779840.772110:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 19 00000100:00100000:2.0:1787779840.772137:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0476494b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:781d29bb-23d2-48e3-b16d-c29e52cd5375+6:6258:x1874622863642496:12345-192.168.203.31@tcp:13: 00002000:00000024:2.0:1787779840.772176:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787779840.772435:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0476494b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:781d29bb-23d2-48e3-b16d-c29e52cd5375+6:6258:x1874622863642496:12345-192.168.203.31@tcp:13: Request processed in 307us (697us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779840.772445:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 19 00000100:00080000:1.0:1787779840.772644:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1787779841.116387:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787779841.823312:0:9508:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 781d29bb-23d2-48e3-b16d-c29e52cd5375 00010000:00010000:1.0:1787779842.143558:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787779842.334755:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0461954000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881516928:0@lo:13: 00000100:00100000:3.0:1787779842.334924:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779842.335025:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881516928 00000100:00100000:3.0:1787779842.335034:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881516928 00000100:00100000:3.0:1787779842.335114:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787779842.335125:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04778403c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881516928:12345-0@lo:13: 00002000:00000024:3.0:1787779842.335170:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787779842.335224:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04778403c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881516928:12345-0@lo:13: Request processed in 101us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779842.335232:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:3.0:1787779842.335260:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1787779842.335294:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0461954000 x1874622881516928/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779858 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779842.335316:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0461954000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881516928:0@lo:13: 00000100:00100000:3.0:1787779842.339315:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477842580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881517312:0@lo:400: 00000100:00100000:3.0:1787779842.339413:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779842.339451:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477841e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1874622881517824:0@lo:400: 00000100:00100000:3.0:1787779842.339475:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779842.339492:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04778430c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1874622881518336:0@lo:400: 00000100:00100000:3.0:1787779842.339521:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779842.339549:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1787779842.339554:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477840780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874622881517184:0@lo:400: 00000100:00100000:3.0:1787779842.339574:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779842.339589:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477843c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1874622881517696:0@lo:400: 00000100:00100000:3.0:1787779842.339608:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779842.339624:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04778421c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1874622881518208:0@lo:400: 00000100:00100000:3.0:1787779842.339671:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779842.339705:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881517312 00000100:00100000:3.0:1787779842.339713:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881517312 00000100:00100000:3.0:1787779842.339767:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787779842.339776:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477840b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881517312:12345-0@lo:400: 00000100:00100000:3.0:1787779842.339882:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477840b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881517312:12345-0@lo:400: Request processed in 106us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779842.339890:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787779842.339917:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881517824 00000100:00100000:3.0:1787779842.339920:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881517824 00000100:00100000:3.0:1787779842.339950:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881518336 00000100:00100000:3.0:1787779842.339952:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881518336 00000100:00100000:3.0:1787779842.339962:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881517184 00000100:00100000:3.0:1787779842.339964:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881517184 00000100:00100000:3.0:1787779842.339972:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881517696 00000100:00100000:3.0:1787779842.339974:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881517696 00000100:00100000:3.0:1787779842.339984:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881518208 00000100:00100000:3.0:1787779842.339986:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881518208 00000100:00100000:3.0:1787779842.339997:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787779842.340003:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477842940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874622881517824:12345-0@lo:400: 00000100:00100000:3.0:1787779842.340031:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477842940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874622881517824:12345-0@lo:400: Request processed in 28us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779842.340335:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787779842.340356:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787779842.340363:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477843840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1874622881518336:12345-0@lo:400: 00000100:00100000:3.0:1787779842.340396:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477843840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1874622881518336:12345-0@lo:400: Request processed in 35us (874us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779842.340402:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787779842.340414:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787779842.340420:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477841680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874622881517184:12345-0@lo:400: 00000100:00100000:3.0:1787779842.340446:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477841680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874622881517184:12345-0@lo:400: Request processed in 27us (872us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779842.340451:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787779842.340470:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787779842.340476:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0461954000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1874622881517696:12345-0@lo:400: 00000100:00100000:0.0:1787779842.340676:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787779842.340687:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c047785c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1874622881518208:12345-0@lo:400: 00000100:00100000:0.0:1787779842.340721:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c047785c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1874622881518208:12345-0@lo:400: Request processed in 38us (1049us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779842.340726:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787779842.341177:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0461954000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1874622881517696:12345-0@lo:400: Request processed in 27us (894us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779842.341185:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787779842.341232:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477840f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1f575176-36bc-4786-83ee-2fea064a12a9:3642:1874622881517056:0@lo:400: 00000100:00100000:3.0:1787779842.341281:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779842.341324:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477843480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881517568:0@lo:400: 00000100:00100000:3.0:1787779842.341355:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779842.341375:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477842d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881518080:0@lo:400: 00000100:00100000:3.0:1787779842.341400:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779842.341427:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1787779842.341433:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477841a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1874622881517440:0@lo:400: 00000100:00100000:3.0:1787779842.341456:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779842.341471:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477840000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874622881517952:0@lo:400: 00000100:00100000:3.0:1787779842.341491:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779842.342265:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881517056 00000100:00100000:1.0:1787779842.342276:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881517056 00000100:00100000:1.0:1787779842.342487:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1787779842.342497:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471775850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+24:3642:x1874622881517056:12345-0@lo:400: 00000100:00100000:1.0:1787779842.342566:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471775850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+24:3642:x1874622881517056:12345-0@lo:400: Request processed in 70us (1284us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779842.342573:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1787779842.345417:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04778412c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881518464:0@lo:400: 00000100:00100000:0.0:1787779842.345485:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881517440 00000100:00100000:0.0:1787779842.345498:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881517440 00000100:00100000:0.0:1787779842.345586:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787779842.345597:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c047785f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1874622881517440:12345-0@lo:400: 00000100:00100000:0.0:1787779842.345709:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c047785f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1874622881517440:12345-0@lo:400: Request processed in 114us (4252us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779842.345717:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787779842.346263:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779842.346298:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881518080 00000100:00100000:1.0:1787779842.346304:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881518080 00000100:00100000:3.0:1787779842.346324:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477840f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1f575176-36bc-4786-83ee-2fea064a12a9:3642:1874622881517056:0@lo:400: 00000100:00100000:3.0:1787779842.346364:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477841a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1874622881517440:0@lo:400: 00000100:00100000:1.0:1787779842.346932:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881517952 00000100:00100000:3.0:1787779842.346934:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881518464 00000100:00100000:3.0:1787779842.346940:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881518464 00000100:00100000:1.0:1787779842.346940:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881517952 00000100:00100000:1.0:1787779842.346969:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787779842.346979:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c047785e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3642:x1874622881518080:12345-0@lo:400: 00000100:00100000:1.0:1787779842.347050:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c047785e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3642:x1874622881518080:12345-0@lo:400: Request processed in 72us (5649us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779842.347424:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787779842.347430:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787779842.347434:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c047785d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1874622881517952:12345-0@lo:400: 00000100:00100000:1.0:1787779842.347453:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787779842.347459:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c047785cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3642:x1874622881518464:12345-0@lo:400: 00000100:00100000:3.0:1787779842.347472:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c047785d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1874622881517952:12345-0@lo:400: Request processed in 42us (5980us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779842.347483:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787779842.347493:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c047785cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3642:x1874622881518464:12345-0@lo:400: Request processed in 35us (1231us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779842.347499:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:3.0:1787779842.347509:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787779842.347514:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787779842.347517:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787779842.347520:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787779842.347532:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881517568 00000100:00100000:3.0:1787779842.347537:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881517568 00000100:00100000:3.0:1787779842.347565:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787779842.347571:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c047785ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1874622881517568:12345-0@lo:400: 00000100:00100000:3.0:1787779842.347607:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c047785ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1874622881517568:12345-0@lo:400: Request processed in 36us (6252us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779842.347614:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787779842.347663:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477840780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874622881517184:0@lo:400: 00000100:00100000:3.0:1787779842.347679:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477843c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1874622881517696:0@lo:400: 00000100:00100000:3.0:1787779842.347692:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04778421c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1874622881518208:0@lo:400: 00000100:00100000:3.0:1787779842.347705:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477842580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881517312:0@lo:400: 00010000:00080000:3.0:1787779842.347720:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0477841e00 x1874622881517824/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779858 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779842.347731:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477841e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1874622881517824:0@lo:400: 00010000:00080000:3.0:1787779842.347744:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c04778430c0 x1874622881518336/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779858 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779842.347753:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04778430c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1874622881518336:0@lo:400: 00010000:00080000:3.0:1787779842.347816:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0477840000 x1874622881517952/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779858 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779842.347912:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477840000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874622881517952:0@lo:400: 00010000:00080000:3.0:1787779842.347928:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c04778412c0 x1874622881518464/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779858 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779842.347937:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04778412c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881518464:0@lo:400: 00000100:00100000:3.0:1787779842.347947:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477843480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881517568:0@lo:400: 00010000:00080000:3.0:1787779842.347957:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0477842d00 x1874622881518080/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779858 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779842.347964:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477842d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881518080:0@lo:400: 00000100:00100000:3.0:1787779842.847889:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c046efcd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881518592:0@lo:13: 00000100:00100000:3.0:1787779842.848813:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779842.849019:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881518592 00000100:00100000:2.0:1787779842.849036:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881518592 00000100:00100000:2.0:1787779842.849131:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787779842.849142:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c047785e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1874622881518592:12345-0@lo:13: 00002000:00000024:2.0:1787779842.849181:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787779842.849270:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c047785e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1874622881518592:12345-0@lo:13: Request processed in 130us (1203us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779842.849277:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:2.0:1787779842.849321:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c046efcd680 x1874622881518592/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779858 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787779842.849340:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c046efcd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881518592:0@lo:13: 00000100:00100000:1.0:1787779842.850204:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346de2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881518720:0@lo:13: 00000100:00100000:1.0:1787779842.850269:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779842.852603:0:8529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881518720 00000100:00100000:3.0:1787779842.852617:0:8529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881518720 00000100:00100000:3.0:1787779842.852676:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787779842.852688:0:8529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346de3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881518720:12345-0@lo:13: 00002000:00000024:3.0:1787779842.852722:0:8529:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787779842.852820:0:8529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346de3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881518720:12345-0@lo:13: Request processed in 134us (2550us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779842.852828:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:1.0:1787779842.854699:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0346de2580 x1874622881518720/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779858 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787779842.854746:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346de2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881518720:0@lo:13: 00000001:00100000:2.0:1787779842.856831:0:7442:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 781d29bb-23d2-48e3-b16d-c29e52cd5375 00000001:00100000:0.0:1787779842.861043:0:6491:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 781d29bb-23d2-48e3-b16d-c29e52cd5375 00010000:00010000:1.0:1787779843.163983:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787779843.357482:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047785d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881518848:0@lo:13: 00000100:00100000:0.0:1787779843.357546:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779843.357646:0:8529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881518848 00000100:00100000:3.0:1787779843.357654:0:8529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881518848 00000100:00100000:3.0:1787779843.357701:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787779843.357719:0:8529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0476497840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881518848:12345-0@lo:13: 00002000:00000024:3.0:1787779843.357741:0:8529:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787779843.357789:0:8529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0476497840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881518848:12345-0@lo:13: Request processed in 80us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779843.357815:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:3.0:1787779843.357880:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c047785d680 x1874622881518848/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779859 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779843.357897:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047785d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881518848:0@lo:13: 00000100:00100000:3.0:1787779843.477347:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787779843.477412:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787779843.477453:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787779843.477472:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787779843.477495:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863643008 00000100:00100000:3.0:1787779843.477506:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787779843.477508:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863643008 00000100:00100000:3.0:1787779843.477542:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863642752 00000100:00100000:3.0:1787779843.477552:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863642752 00000100:00100000:2.0:1787779843.477581:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863643136 00000100:00100000:2.0:1787779843.477589:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863643136 00000100:00100000:3.0:1787779843.477620:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863642880 00000100:00100000:3.0:1787779843.477628:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863642880 00000100:00100000:2.0:1787779843.477637:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 16 00000100:00100000:2.0:1787779843.477649:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c047785c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+6:2411:x1874622863643008:12345-192.168.203.31@tcp:400: 00000100:00100000:3.0:1787779843.477674:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 55 00000100:00100000:3.0:1787779843.477687:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c047785d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+6:2411:x1874622863642752:12345-192.168.203.31@tcp:400: 00000100:00100000:2.0:1787779843.477749:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c047785c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+6:2411:x1874622863643008:12345-192.168.203.31@tcp:400: Request processed in 100us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779843.477758:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c047785d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+6:2411:x1874622863642752:12345-192.168.203.31@tcp:400: Request processed in 72us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779843.477764:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 16 00000100:00100000:3.0:1787779843.477777:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 55 00000100:00100000:3.0:1787779843.477809:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 56 00000100:00100000:3.0:1787779843.477815:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c047785cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:2411:x1874622863642880:12345-192.168.203.31@tcp:400: 00000100:00100000:3.0:1787779843.477877:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c047785cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:2411:x1874622863642880:12345-192.168.203.31@tcp:400: Request processed in 61us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779843.477886:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 56 00000100:00100000:3.0:1787779843.477923:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 17 00000100:00100000:3.0:1787779843.477931:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c047785c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:2411:x1874622863643136:12345-192.168.203.31@tcp:400: 00000100:00100000:3.0:1787779843.477980:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c047785c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:2411:x1874622863643136:12345-192.168.203.31@tcp:400: Request processed in 50us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779843.477990:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 17 00000100:00100000:1.0:1787779843.478332:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863642624 00000100:00100000:1.0:1787779843.478339:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863642624 00000100:00100000:1.0:1787779843.478382:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 198 00000100:00100000:1.0:1787779843.478548:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471775050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+10:2411:x1874622863642624:12345-192.168.203.31@tcp:400: 00000100:00100000:1.0:1787779843.478594:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471775050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+10:2411:x1874622863642624:12345-192.168.203.31@tcp:400: Request processed in 50us (1141us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779843.478641:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 198 00000100:00080000:2.0:1787779843.479986:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787779843.479994:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787779843.479996:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787779843.479999:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:3.0:1787779843.738640:0:10178:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000001:00100000:1.0:1787779843.872598:0:8423:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 781d29bb-23d2-48e3-b16d-c29e52cd5375 00010000:00010000:2.0:1787779844.188408:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787779844.894797:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787779844.894821:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346de03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874622881518976:0@lo:41: 00000100:00100000:1.0:1787779844.894935:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779844.897375:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881518976 00000100:00100000:3.0:1787779844.897388:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881518976 00000100:00100000:3.0:1787779844.897503:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787779844.897513:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347a87c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1874622881518976:12345-0@lo:41: 00000004:00000024:3.0:1787779844.897551:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1787779844.897630:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347a87c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1874622881518976:12345-0@lo:41: Request processed in 118us (2694us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779844.897637:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787779844.897699:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346de03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874622881518976:0@lo:41: 00010000:00010000:0.0:1787779845.215453:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787779845.404251:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04764943c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881519104:0@lo:41: 00000100:00100000:3.0:1787779845.404309:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779845.404423:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881519104 00000100:00100000:2.0:1787779845.404429:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881519104 00000100:00100000:2.0:1787779845.404470:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787779845.404477:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c047785e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1874622881519104:12345-0@lo:41: 00000004:00000024:2.0:1787779845.404531:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787779845.404587:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c047785e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1874622881519104:12345-0@lo:41: Request processed in 109us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779845.404594:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787779845.405001:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04764943c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881519104:0@lo:41: 00010000:00010000:1.0:1787779846.239269:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787779847.209624:0:10326:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffee6a6a8a0 20000000:00000080:0.0:1787779847.209642:0:10326:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9c0347bc6800 uarg=0000000000000000 20000000:01000000:0.0:1787779847.209682:0:10326:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:0.0:1787779847.209691:0:10326:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:0.0:1787779847.209694:0:10326:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:0.0:1787779847.209698:0:10326:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:0.0:1787779847.209703:0:10326:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:0.0:1787779847.209761:0:10326:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1787779847.209764:0:10326:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1787779847.210584:0:10327:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 8 count 8 00000040:00080000:3.0:1787779847.210901:0:10326:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9632 00000040:00080000:3.0:1787779847.210933:0:10326:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 120 off9752 00000040:00080000:3.0:1787779847.210948:0:10326:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off9976 20000000:01000000:3.0:1787779847.210959:0:10326:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:3.0:1787779847.210962:0:10326:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1787779847.211767:0:10328:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000040:00080000:0.0:1787779847.212125:0:10326:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].43, 224 off15672 00000040:00080000:0.0:1787779847.212153:0:10326:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].44, 120 off15792 00000040:00080000:0.0:1787779847.212170:0:10326:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].45, 224 off16016 20000000:01000000:0.0:1787779847.212182:0:10326:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1787779847.212184:0:10326:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1787779847.212615:0:10329:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000040:00080000:0.0:1787779847.213283:0:10326:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].49, 224 off16608 00000040:00080000:0.0:1787779847.213390:0:10326:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].50, 120 off16728 00000040:00080000:0.0:1787779847.213490:0:10326:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].51, 224 off16952 20000000:01000000:0.0:1787779847.213503:0:10326:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1787779847.213505:0:10326:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1787779847.219053:0:10330:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000040:00080000:0.0:1787779847.219313:0:10326:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10160 00000040:00080000:0.0:1787779847.219343:0:10326:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 120 off10280 00000040:00080000:0.0:1787779847.219359:0:10326:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 224 off10504 20000000:01000000:0.0:1787779847.219370:0:10326:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1787779847.219373:0:10326:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1787779847.221800:0:10331:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000040:00080000:3.0:1787779847.222080:0:10326:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 224 off15640 00000040:00080000:3.0:1787779847.222125:0:10326:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 120 off15760 00000040:00080000:3.0:1787779847.222143:0:10326:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15984 10000000:01000000:3.0:1787779847.222158:0:10326:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1787779847.222175:0:10326:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c04766dd400/0xc8fc0a517996067e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779847.222208:0:10326:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c0440031200/0xc8fc0a5179960519 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a5179960512 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779847.222215:0:10326:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c0477a70800/0xc8fc0a5179960543 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a517996053c expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779847.222221:0:10326:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c0477a71c00/0xc8fc0a5179960582 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a517996057b expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779847.222226:0:10326:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c0477a71600/0xc8fc0a5179960590 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a5179960589 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779847.222233:0:10326:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c0477a71e00/0xc8fc0a517996059e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a5179960597 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779847.222240:0:10326:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c0477a71a00/0xc8fc0a51799605ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a51799605b3 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779847.222245:0:10326:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c04766dc800/0xc8fc0a51799605e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a51799605dd expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779847.222252:0:10326:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c044148ba00/0xc8fc0a5179960600 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a51799605f9 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779847.222258:0:10326:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c044148be00/0xc8fc0a517996062a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a5179960623 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779847.222267:0:10326:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c0440030400/0xc8fc0a5179960638 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1c56 expref: 9 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779847.222283:0:10326:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c0477a70e00/0xc8fc0a517996063f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1c5d expref: 9 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779847.222290:0:10326:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c04766dd400/0xc8fc0a517996067e lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779847.222330:0:10326:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c0477a70e00/0xc8fc0a517996063f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1c5d expref: 9 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779847.222346:0:10326:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c0477a70e00/0xc8fc0a517996063f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1c5d expref: 9 pid: 6507 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779847.222359:0:10326:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047785da40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10326:1874622881519232:192.168.203.31@tcp:104: 00010000:00010000:3.0:1787779847.222475:0:10326:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c0440030400/0xc8fc0a5179960638 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1c56 expref: 9 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779847.222487:0:10326:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c0440030400/0xc8fc0a5179960638 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1c56 expref: 9 pid: 6506 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779847.222495:0:10326:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047785f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10326:1874622881519360:192.168.203.31@tcp:104: 00010000:00010000:3.0:1787779847.222522:0:10326:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c044148be00/0xc8fc0a517996062a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc8fc0a5179960623 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779847.222529:0:10326:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c044148be00/0xc8fc0a517996062a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc8fc0a5179960623 expref: 23 pid: 6506 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779847.222537:0:10326:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047785fc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10326:1874622881519488:0@lo:104: 00000100:00100000:3.0:1787779847.222572:0:10326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787779847.222625:0:10326:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c044148ba00/0xc8fc0a5179960600 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc8fc0a51799605f9 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779847.222634:0:10326:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c044148ba00/0xc8fc0a5179960600 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc8fc0a51799605f9 expref: 23 pid: 6505 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779847.222641:0:10326:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047785f840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10326:1874622881519616:0@lo:104: 00000100:00100000:3.0:1787779847.222663:0:10326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787779847.222689:0:10326:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c04766dc800/0xc8fc0a51799605e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc8fc0a51799605dd expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779847.222697:0:10326:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c04766dc800/0xc8fc0a51799605e4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc8fc0a51799605dd expref: 23 pid: 6505 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779847.222704:0:10326:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346de03c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10326:1874622881519744:0@lo:104: 00000100:00100000:3.0:1787779847.222724:0:10326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787779847.222743:0:10326:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c0477a71a00/0xc8fc0a51799605ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc8fc0a51799605b3 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779847.222752:0:10326:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c0477a71a00/0xc8fc0a51799605ba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc8fc0a51799605b3 expref: 23 pid: 6505 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779847.222760:0:10326:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477843480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10326:1874622881519872:0@lo:104: 00000100:00100000:3.0:1787779847.222790:0:10326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787779847.222806:0:10326:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c0477a71e00/0xc8fc0a517996059e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc8fc0a5179960597 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779847.222815:0:10326:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c0477a71e00/0xc8fc0a517996059e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc8fc0a5179960597 expref: 23 pid: 6507 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779847.222823:0:10326:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04778412c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10326:1874622881520000:0@lo:104: 00010000:00010000:3.0:1787779847.222884:0:10326:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c0477a71600/0xc8fc0a5179960590 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc8fc0a5179960589 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779847.222891:0:10326:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c0477a71600/0xc8fc0a5179960590 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc8fc0a5179960589 expref: 23 pid: 6506 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779847.222898:0:10326:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477840000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10326:1874622881520128:0@lo:104: 00010000:00010000:3.0:1787779847.222916:0:10326:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c0477a71c00/0xc8fc0a5179960582 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc8fc0a517996057b expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779847.222923:0:10326:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c0477a71c00/0xc8fc0a5179960582 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc8fc0a517996057b expref: 23 pid: 6507 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779847.222930:0:10326:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04778430c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10326:1874622881520256:0@lo:104: 00010000:00010000:3.0:1787779847.222947:0:10326:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c0477a70800/0xc8fc0a5179960543 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc8fc0a517996053c expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779847.222954:0:10326:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c0477a70800/0xc8fc0a5179960543 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc8fc0a517996053c expref: 23 pid: 6505 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779847.222961:0:10326:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477841e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10326:1874622881520384:0@lo:104: 00010000:00010000:3.0:1787779847.222981:0:10326:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c0440031200/0xc8fc0a5179960519 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc8fc0a5179960512 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779847.222988:0:10326:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c0440031200/0xc8fc0a5179960519 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc8fc0a5179960512 expref: 23 pid: 6507 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779847.222996:0:10326:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477842580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10326:1874622881520512:0@lo:104: 00000100:00100000:3.0:1787779847.223023:0:10326:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0346be23c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787779847.223044:0:6495:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787779847.223067:0:6495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779847.223081:0:6495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779847.223092:0:6495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779847.223100:0:6495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779847.223119:0:6495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779847.223128:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881519488 00000100:00100000:1.0:1787779847.223134:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881519488 00000100:00100000:1.0:1787779847.223167:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881519616 00000100:00100000:1.0:1787779847.223170:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881519616 00000100:00100000:1.0:1787779847.223179:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881519744 00000100:00100000:1.0:1787779847.223181:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881519744 00000100:00100000:1.0:1787779847.223189:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881519872 00000100:00100000:1.0:1787779847.223191:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881519872 00000100:00100000:1.0:1787779847.223198:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881520000 00000100:00100000:1.0:1787779847.223200:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881520000 00000100:00100000:1.0:1787779847.223207:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881520128 00000100:00100000:1.0:1787779847.223209:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881520128 00000100:00100000:1.0:1787779847.223218:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881520256 00000100:00100000:1.0:1787779847.223220:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881520256 00000100:00100000:1.0:1787779847.223227:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881520384 00000100:00100000:1.0:1787779847.223229:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881520384 00000100:00100000:1.0:1787779847.223236:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881520512 00000100:00100000:1.0:1787779847.223238:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881520512 00000100:00100000:1.0:1787779847.223248:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787779847.223257:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c047785de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1f575176-36bc-4786-83ee-2fea064a12a9+11:10326:x1874622881519488:12345-0@lo:104: 00010000:00010000:1.0:1787779847.223269:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff9c04766dc600/0xc8fc0a5179960623 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xc8fc0a517996062a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779847.223324:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00010000:00010000:1.0:1787779847.223331:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787779847.223338:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346de2580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1f575176-36bc-4786-83ee-2fea064a12a9+11:10326:x1874622881519616:12345-0@lo:104: 00000100:00100000:1.0:1787779847.223342:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c047785de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1f575176-36bc-4786-83ee-2fea064a12a9+11:10326:x1874622881519488:12345-0@lo:104: Request processed in 84us (768us total) trans 0 rc 0/0 00010000:00010000:0.0:1787779847.223349:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff9c04766dca00/0xc8fc0a51799605f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xc8fc0a5179960600 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779847.223352:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787779847.223375:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787779847.223384:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477842d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1f575176-36bc-4786-83ee-2fea064a12a9+10:10326:x1874622881519744:12345-0@lo:104: 00010000:00010000:1.0:1787779847.223393:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff9c04766dd200/0xc8fc0a51799605dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xc8fc0a51799605e4 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779847.223400:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787779847.223409:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346de2580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1f575176-36bc-4786-83ee-2fea064a12a9+10:10326:x1874622881519616:12345-0@lo:104: Request processed in 76us (745us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779847.223438:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:1.0:1787779847.223446:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1787779847.223454:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477842d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1f575176-36bc-4786-83ee-2fea064a12a9+9:10326:x1874622881519744:12345-0@lo:104: Request processed in 71us (727us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779847.223459:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787779847.223467:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787779847.223471:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477958450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1f575176-36bc-4786-83ee-2fea064a12a9+9:10326:x1874622881519872:12345-0@lo:104: 00010000:00010000:0.0:1787779847.223480:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff9c044148a200/0xc8fc0a51799605b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xc8fc0a51799605ba expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779847.223489:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787779847.223498:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347a87480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1f575176-36bc-4786-83ee-2fea064a12a9+8:10326:x1874622881520000:12345-0@lo:104: 00010000:00010000:1.0:1787779847.223506:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff9c0477a70400/0xc8fc0a5179960597 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xc8fc0a517996059e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779847.223516:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1787779847.223523:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477958450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1f575176-36bc-4786-83ee-2fea064a12a9+8:10326:x1874622881519872:12345-0@lo:104: Request processed in 56us (732us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779847.223530:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:1.0:1787779847.223543:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:1.0:1787779847.223550:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347a87480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1f575176-36bc-4786-83ee-2fea064a12a9+7:10326:x1874622881520000:12345-0@lo:104: Request processed in 54us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779847.223557:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787779847.223574:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00010000:00010000:2.0:1787779847.223741:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1787779847.223748:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff9c04766dc600/0xc8fc0a5179960623 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xc8fc0a517996062a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779847.223756:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c04766dc600 already unused, calling callback (ffffffffc139ac20) 10000000:00010000:2.0:1787779847.223761:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff9c04766dc600/0xc8fc0a5179960623 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0xc8fc0a517996062a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779847.223776:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff9c04766dc600/0xc8fc0a5179960623 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0xc8fc0a517996062a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787779847.223783:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff9c04766dc600/0xc8fc0a5179960623 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0xc8fc0a517996062a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787779847.223788:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787779847.223816:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff9c04766dc600/0xc8fc0a5179960623 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a517996062a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779847.223822:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787779847.223858:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff9c04766dc600/0xc8fc0a5179960623 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a517996062a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779847.223865:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff9c04766dc600/0xc8fc0a5179960623 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a517996062a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779847.223888:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1787779847.223891:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff9c04766dca00/0xc8fc0a51799605f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xc8fc0a5179960600 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779847.223896:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c04766dca00 already unused, calling callback (ffffffffc139ac20) 10000000:00010000:2.0:1787779847.223899:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff9c04766dca00/0xc8fc0a51799605f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0xc8fc0a5179960600 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779847.223905:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff9c04766dca00/0xc8fc0a51799605f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xc8fc0a5179960600 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787779847.223911:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff9c04766dca00/0xc8fc0a51799605f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0xc8fc0a5179960600 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787779847.223916:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787779847.223929:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff9c04766dca00/0xc8fc0a51799605f9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a5179960600 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779847.223934:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787779847.223939:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff9c04766dca00/0xc8fc0a51799605f9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a5179960600 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779847.223945:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff9c04766dca00/0xc8fc0a51799605f9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a5179960600 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779847.223954:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787779847.223956:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff9c04766dd200/0xc8fc0a51799605dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xc8fc0a51799605e4 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779847.223972:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c04766dd200 already unused, calling callback (ffffffffc139ac20) 10000000:00010000:2.0:1787779847.223975:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff9c04766dd200/0xc8fc0a51799605dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xc8fc0a51799605e4 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779847.223991:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff9c04766dd200/0xc8fc0a51799605dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xc8fc0a51799605e4 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787779847.223997:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff9c04766dd200/0xc8fc0a51799605dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xc8fc0a51799605e4 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787779847.224002:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787779847.224015:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff9c04766dd200/0xc8fc0a51799605dd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a51799605e4 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779847.224020:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787779847.224036:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff9c04766dd200/0xc8fc0a51799605dd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a51799605e4 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779847.224044:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff9c04766dd200/0xc8fc0a51799605dd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a51799605e4 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779847.224052:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787779847.224056:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff9c044148a200/0xc8fc0a51799605b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xc8fc0a51799605ba expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779847.224061:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c044148a200 already unused, calling callback (ffffffffc139ac20) 10000000:00010000:2.0:1787779847.224064:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff9c044148a200/0xc8fc0a51799605b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xc8fc0a51799605ba expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779847.224080:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff9c044148a200/0xc8fc0a51799605b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xc8fc0a51799605ba expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787779847.224086:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff9c044148a200/0xc8fc0a51799605b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xc8fc0a51799605ba expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787779847.224092:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787779847.224104:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff9c044148a200/0xc8fc0a51799605b3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a51799605ba expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779847.224121:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787779847.224127:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff9c044148a200/0xc8fc0a51799605b3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a51799605ba expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779847.224133:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff9c044148a200/0xc8fc0a51799605b3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a51799605ba expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779847.224144:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787779847.224147:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff9c0477a70400/0xc8fc0a5179960597 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc8fc0a517996059e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779847.224153:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0477a70400 already unused, calling callback (ffffffffc139ac20) 10000000:00010000:2.0:1787779847.224155:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff9c0477a70400/0xc8fc0a5179960597 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xc8fc0a517996059e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779847.224161:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff9c0477a70400/0xc8fc0a5179960597 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xc8fc0a517996059e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787779847.224167:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff9c0477a70400/0xc8fc0a5179960597 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xc8fc0a517996059e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787779847.224177:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787779847.224190:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff9c0477a70400/0xc8fc0a5179960597 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a517996059e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779847.224195:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787779847.224200:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff9c0477a70400/0xc8fc0a5179960597 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a517996059e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779847.224206:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff9c0477a70400/0xc8fc0a5179960597 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a517996059e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779847.224214:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787779847.224216:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787779847.224217:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787779847.224230:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c046efcc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1f575176-36bc-4786-83ee-2fea064a12a9:3643:1874622881520640:0@lo:103: 00000100:00100000:2.0:1787779847.224266:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779847.224287:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c046efcfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1f575176-36bc-4786-83ee-2fea064a12a9:3643:1874622881521152:0@lo:103: 00000100:00100000:2.0:1787779847.224323:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779847.224342:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787779847.224348:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c046efce580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1f575176-36bc-4786-83ee-2fea064a12a9:3643:1874622881520768:0@lo:103: 00000100:00100000:2.0:1787779847.224365:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779847.224393:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c046efcda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1f575176-36bc-4786-83ee-2fea064a12a9:3641:1874622881520896:0@lo:103: 00000100:00100000:2.0:1787779847.224414:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779847.224433:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787779847.224438:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c046efcf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1f575176-36bc-4786-83ee-2fea064a12a9:3641:1874622881521024:0@lo:103: 00000100:00100000:2.0:1787779847.224457:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779847.224477:0:7921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881520640 00000100:00100000:2.0:1787779847.224488:0:7921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881520640 00010000:00010000:2.0:1787779847.224515:0:7921:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c044148be00/0xc8fc0a517996062a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc8fc0a5179960623 expref: 24 pid: 6506 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779847.224532:0:7921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881521152 00000100:00100000:2.0:1787779847.224535:0:7921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881521152 00010000:00010000:2.0:1787779847.224544:0:7921:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c0477a71e00/0xc8fc0a517996059e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc8fc0a5179960597 expref: 25 pid: 6507 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779847.224553:0:7921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881520768 00000100:00100000:2.0:1787779847.224555:0:7921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881520768 00010000:00010000:2.0:1787779847.224563:0:7921:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c044148ba00/0xc8fc0a5179960600 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc8fc0a51799605f9 expref: 26 pid: 6505 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779847.224573:0:7921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881520896 00000100:00100000:2.0:1787779847.224575:0:7921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881520896 00010000:00010000:2.0:1787779847.224585:0:7921:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c04766dc800/0xc8fc0a51799605e4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc8fc0a51799605dd expref: 27 pid: 6505 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779847.224595:0:7921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881521024 00000100:00100000:2.0:1787779847.224597:0:7921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881521024 00010000:00010000:2.0:1787779847.224607:0:7921:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c0477a71a00/0xc8fc0a51799605ba lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc8fc0a51799605b3 expref: 28 pid: 6505 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779847.224619:0:7921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787779847.224625:0:7921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046099d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1f575176-36bc-4786-83ee-2fea064a12a9+28:3643:x1874622881520640:12345-0@lo:103: 00010000:00010000:2.0:1787779847.224636:0:7921:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787779847.224641:0:7921:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c044148be00/0xc8fc0a517996062a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc8fc0a5179960623 expref: 28 pid: 6506 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779847.224650:0:7921:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c044148be00/0xc8fc0a517996062a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc8fc0a5179960623 expref: 28 pid: 6506 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779847.224676:0:7921:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787779847.224706:0:7921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046099d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1f575176-36bc-4786-83ee-2fea064a12a9+28:3643:x1874622881520640:12345-0@lo:103: Request processed in 81us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779847.224713:0:7921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787779847.224747:0:7921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787779847.224753:0:7921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046efcde00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1f575176-36bc-4786-83ee-2fea064a12a9+27:3643:x1874622881521152:12345-0@lo:103: 00010000:00010000:2.0:1787779847.224760:0:7921:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787779847.224764:0:7921:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c0477a71e00/0xc8fc0a517996059e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc8fc0a5179960597 expref: 27 pid: 6507 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779847.224784:0:7921:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c0477a71e00/0xc8fc0a517996059e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc8fc0a5179960597 expref: 27 pid: 6507 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779847.224793:0:7921:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787779847.224815:0:7921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046efcde00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1f575176-36bc-4786-83ee-2fea064a12a9+27:3643:x1874622881521152:12345-0@lo:103: Request processed in 62us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779847.224821:0:7921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787779847.224832:0:7921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787779847.224858:0:7921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046efcc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1f575176-36bc-4786-83ee-2fea064a12a9+26:3643:x1874622881520768:12345-0@lo:103: 00010000:00010000:2.0:1787779847.224866:0:7921:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787779847.224870:0:7921:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c044148ba00/0xc8fc0a5179960600 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc8fc0a51799605f9 expref: 26 pid: 6505 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779847.224878:0:7921:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c044148ba00/0xc8fc0a5179960600 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc8fc0a51799605f9 expref: 26 pid: 6505 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779847.224887:0:7921:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787779847.224913:0:7921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046efcc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1f575176-36bc-4786-83ee-2fea064a12a9+26:3643:x1874622881520768:12345-0@lo:103: Request processed in 75us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779847.224919:0:7921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787779847.224931:0:7921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787779847.224937:0:7921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046efced00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1f575176-36bc-4786-83ee-2fea064a12a9+25:3641:x1874622881520896:12345-0@lo:103: 00010000:00010000:2.0:1787779847.224944:0:7921:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787779847.224948:0:7921:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c04766dc800/0xc8fc0a51799605e4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc8fc0a51799605dd expref: 25 pid: 6505 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779847.224956:0:7921:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c04766dc800/0xc8fc0a51799605e4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc8fc0a51799605dd expref: 25 pid: 6505 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779847.224966:0:7921:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787779847.224991:0:7921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046efced00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1f575176-36bc-4786-83ee-2fea064a12a9+25:3641:x1874622881520896:12345-0@lo:103: Request processed in 55us (576us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779847.224998:0:7921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787779847.225009:0:7921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787779847.225015:0:7921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046efce1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1f575176-36bc-4786-83ee-2fea064a12a9+24:3641:x1874622881521024:12345-0@lo:103: 00010000:00010000:2.0:1787779847.225022:0:7921:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787779847.225026:0:7921:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c0477a71a00/0xc8fc0a51799605ba lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc8fc0a51799605b3 expref: 24 pid: 6505 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779847.225034:0:7921:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c0477a71a00/0xc8fc0a51799605ba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc8fc0a51799605b3 expref: 24 pid: 6505 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779847.225043:0:7921:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787779847.225063:0:7921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046efce1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1f575176-36bc-4786-83ee-2fea064a12a9+24:3641:x1874622881521024:12345-0@lo:103: Request processed in 49us (606us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779847.225069:0:7921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787779847.225105:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c046efcf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1f575176-36bc-4786-83ee-2fea064a12a9:3641:1874622881521024:0@lo:103: 00000100:00100000:2.0:1787779847.225112:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c046efcda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1f575176-36bc-4786-83ee-2fea064a12a9:3641:1874622881520896:0@lo:103: 00000100:00100000:2.0:1787779847.225137:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c046efce580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1f575176-36bc-4786-83ee-2fea064a12a9:3643:1874622881520768:0@lo:103: 00000100:00100000:2.0:1787779847.225145:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c046efcc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1f575176-36bc-4786-83ee-2fea064a12a9:3643:1874622881520640:0@lo:103: 00000100:00100000:2.0:1787779847.225151:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c046efcfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1f575176-36bc-4786-83ee-2fea064a12a9:3643:1874622881521152:0@lo:103: 00000100:00100000:1.0:1787779847.225314:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787779847.225327:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347a85a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1f575176-36bc-4786-83ee-2fea064a12a9+6:10326:x1874622881520256:12345-0@lo:104: 00010000:00010000:1.0:1787779847.225337:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff9c0477a70600/0xc8fc0a517996057b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc8fc0a5179960582 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779847.225354:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347a86580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1f575176-36bc-4786-83ee-2fea064a12a9+6:10326:x1874622881520128:12345-0@lo:104: 00010000:00010000:0.0:1787779847.225367:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff9c0477a70000/0xc8fc0a5179960589 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc8fc0a5179960590 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779847.225387:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787779847.225393:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347a85a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1f575176-36bc-4786-83ee-2fea064a12a9+6:10326:x1874622881520256:12345-0@lo:104: Request processed in 71us (2300us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779847.225401:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00010000:0.0:1787779847.225409:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787779847.225420:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787779847.225428:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04779421c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1f575176-36bc-4786-83ee-2fea064a12a9+5:10326:x1874622881520384:12345-0@lo:104: 00000100:00100000:0.0:1787779847.225430:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347a86580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1f575176-36bc-4786-83ee-2fea064a12a9+5:10326:x1874622881520128:12345-0@lo:104: Request processed in 1848us (2346us total) trans 0 rc 0/0 00010000:00010000:1.0:1787779847.225439:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff9c0440030200/0xc8fc0a517996053c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc8fc0a5179960543 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779847.225441:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787779847.225459:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787779847.225468:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04779403c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1f575176-36bc-4786-83ee-2fea064a12a9+4:10326:x1874622881520512:12345-0@lo:104: 00010000:00010000:0.0:1787779847.225477:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff9c04766dc400/0xc8fc0a5179960512 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc8fc0a5179960519 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779847.225481:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1787779847.225489:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04779421c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1f575176-36bc-4786-83ee-2fea064a12a9+4:10326:x1874622881520384:12345-0@lo:104: Request processed in 62us (2386us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779847.225496:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00010000:0.0:1787779847.225513:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00010000:00010000:1.0:1787779847.225516:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00000100:00100000:0.0:1787779847.225522:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04779403c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1f575176-36bc-4786-83ee-2fea064a12a9+3:10326:x1874622881520512:12345-0@lo:104: Request processed in 54us (2400us total) trans 0 rc 0/0 00010000:00010000:1.0:1787779847.225524:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff9c0477a70600/0xc8fc0a517996057b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc8fc0a5179960582 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779847.225538:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0477a70600 already unused, calling callback (ffffffffc139ac20) 00000100:00100000:0.0:1787779847.225542:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 10000000:00010000:1.0:1787779847.225544:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff9c0477a70600/0xc8fc0a517996057b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xc8fc0a5179960582 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779847.225554:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff9c0477a70600/0xc8fc0a517996057b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xc8fc0a5179960582 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787779847.225561:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff9c0477a70600/0xc8fc0a517996057b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xc8fc0a5179960582 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787779847.225567:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787779847.225569:0:7453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787779847.225575:0:7453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff9c0477a70000/0xc8fc0a5179960589 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc8fc0a5179960590 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779847.225582:0:7453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0477a70000 already unused, calling callback (ffffffffc139ac20) 10000000:00010000:0.0:1787779847.225586:0:7453:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff9c0477a70000/0xc8fc0a5179960589 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xc8fc0a5179960590 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779847.225589:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff9c0477a70600/0xc8fc0a517996057b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a5179960582 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779847.225595:0:7453:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff9c0477a70000/0xc8fc0a5179960589 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xc8fc0a5179960590 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787779847.225611:0:7453:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff9c0477a70000/0xc8fc0a5179960589 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xc8fc0a5179960590 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779847.225612:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:01000000:0.0:1787779847.225620:0:7453:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787779847.225627:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff9c0477a70600/0xc8fc0a517996057b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a5179960582 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779847.225636:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff9c0477a70600/0xc8fc0a517996057b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a5179960582 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779847.225639:0:7453:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff9c0477a70000/0xc8fc0a5179960589 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a5179960590 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779847.225646:0:7453:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787779847.225662:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787779847.225663:0:7453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff9c0477a70000/0xc8fc0a5179960589 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a5179960590 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779847.225667:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff9c0440030200/0xc8fc0a517996053c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc8fc0a5179960543 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779847.225679:0:7453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff9c0477a70000/0xc8fc0a5179960589 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a5179960590 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779847.225681:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0440030200 already unused, calling callback (ffffffffc139ac20) 10000000:00010000:1.0:1787779847.225687:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff9c0440030200/0xc8fc0a517996053c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xc8fc0a5179960543 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779847.225696:0:7453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787779847.225697:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff9c0440030200/0xc8fc0a517996053c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc8fc0a5179960543 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779847.225703:0:7453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff9c04766dc400/0xc8fc0a5179960512 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc8fc0a5179960519 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787779847.225707:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff9c0440030200/0xc8fc0a517996053c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc8fc0a5179960543 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787779847.225715:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787779847.225725:0:7453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c04766dc400 already unused, calling callback (ffffffffc139ac20) 10000000:00010000:0.0:1787779847.225729:0:7453:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff9c04766dc400/0xc8fc0a5179960512 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc8fc0a5179960519 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779847.225731:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff9c0440030200/0xc8fc0a517996053c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a5179960543 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779847.225743:0:7453:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff9c04766dc400/0xc8fc0a5179960512 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc8fc0a5179960519 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787779847.225751:0:7453:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff9c04766dc400/0xc8fc0a5179960512 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc8fc0a5179960519 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787779847.225756:0:7453:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787779847.225781:0:7453:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff9c04766dc400/0xc8fc0a5179960512 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a5179960519 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779847.225788:0:7453:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787779847.225793:0:7453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff9c04766dc400/0xc8fc0a5179960512 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a5179960519 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779847.225799:0:7453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff9c04766dc400/0xc8fc0a5179960512 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a5179960519 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779847.225809:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787779847.225811:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787779847.225812:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787779847.225831:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0476496940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1f575176-36bc-4786-83ee-2fea064a12a9:3642:1874622881521664:0@lo:103: 00000100:00100000:0.0:1787779847.225879:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779847.225908:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787779847.225914:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0476495680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1f575176-36bc-4786-83ee-2fea064a12a9:3642:1874622881521408:0@lo:103: 00000100:00100000:0.0:1787779847.225947:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787779847.225961:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787779847.225971:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff9c0440030200/0xc8fc0a517996053c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a5179960543 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779847.225973:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881521664 00000100:00100000:0.0:1787779847.225979:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881521664 00010000:00010000:1.0:1787779847.225981:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff9c0440030200/0xc8fc0a517996053c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a5179960543 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779847.226000:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787779847.226001:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c0440031200/0xc8fc0a5179960519 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc8fc0a5179960512 expref: 24 pid: 6507 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779847.226003:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787779847.226006:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787779847.226021:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881521408 00000100:00100000:0.0:1787779847.226025:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881521408 00010000:00010000:0.0:1787779847.226036:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c0477a71600/0xc8fc0a5179960590 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc8fc0a5179960589 expref: 25 pid: 6506 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779847.226048:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787779847.226054:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04764970c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1f575176-36bc-4786-83ee-2fea064a12a9+25:3642:x1874622881521664:12345-0@lo:103: 00010000:00010000:0.0:1787779847.226061:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787779847.226066:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c0440031200/0xc8fc0a5179960519 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc8fc0a5179960512 expref: 25 pid: 6507 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779847.226074:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c0440031200/0xc8fc0a5179960519 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc8fc0a5179960512 expref: 25 pid: 6507 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779847.226086:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787779847.226130:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04764970c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1f575176-36bc-4786-83ee-2fea064a12a9+25:3642:x1874622881521664:12345-0@lo:103: Request processed in 76us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779847.226136:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787779847.226150:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787779847.226156:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0476494780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1f575176-36bc-4786-83ee-2fea064a12a9+24:3642:x1874622881521408:12345-0@lo:103: 00010000:00010000:0.0:1787779847.226163:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787779847.226168:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c0477a71600/0xc8fc0a5179960590 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc8fc0a5179960589 expref: 24 pid: 6506 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779847.226186:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c0477a71600/0xc8fc0a5179960590 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc8fc0a5179960589 expref: 24 pid: 6506 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779847.226197:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787779847.226198:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0476496940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1f575176-36bc-4786-83ee-2fea064a12a9:3642:1874622881521664:0@lo:103: 00000100:00100000:0.0:1787779847.226226:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0476494780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1f575176-36bc-4786-83ee-2fea064a12a9+24:3642:x1874622881521408:12345-0@lo:103: Request processed in 69us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779847.226231:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0476495680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1f575176-36bc-4786-83ee-2fea064a12a9:3642:1874622881521408:0@lo:103: 00000100:00100000:0.0:1787779847.226237:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00010000:3.0:1787779847.229241:0:10326:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c044148be00/0xc8fc0a517996062a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc8fc0a5179960623 expref: 23 pid: 6506 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779847.229262:0:10326:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047785fc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10326:1874622881519488:0@lo:104: 00010000:00010000:3.0:1787779847.229274:0:10326:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c044148ba00/0xc8fc0a5179960600 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc8fc0a51799605f9 expref: 22 pid: 6505 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779847.229282:0:10326:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047785f840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10326:1874622881519616:0@lo:104: 00010000:00010000:3.0:1787779847.229291:0:10326:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c04766dc800/0xc8fc0a51799605e4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc8fc0a51799605dd expref: 21 pid: 6505 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779847.229299:0:10326:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346de03c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10326:1874622881519744:0@lo:104: 00010000:00010000:3.0:1787779847.229307:0:10326:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c0477a71a00/0xc8fc0a51799605ba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc8fc0a51799605b3 expref: 20 pid: 6505 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779847.229315:0:10326:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477843480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10326:1874622881519872:0@lo:104: 00010000:00010000:3.0:1787779847.229323:0:10326:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c0477a71e00/0xc8fc0a517996059e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc8fc0a5179960597 expref: 19 pid: 6507 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779847.229331:0:10326:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04778412c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10326:1874622881520000:0@lo:104: 00010000:00010000:3.0:1787779847.229340:0:10326:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c0477a71600/0xc8fc0a5179960590 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc8fc0a5179960589 expref: 18 pid: 6506 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779847.229347:0:10326:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477840000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10326:1874622881520128:0@lo:104: 00000100:00100000:3.0:1787779847.229354:0:10326:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04778430c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10326:1874622881520256:0@lo:104: 00000100:00100000:3.0:1787779847.229362:0:10326:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477841e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10326:1874622881520384:0@lo:104: 00010000:00010000:3.0:1787779847.229370:0:10326:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c0440031200/0xc8fc0a5179960519 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc8fc0a5179960512 expref: 17 pid: 6507 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779847.229398:0:10326:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477842580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10326:1874622881520512:0@lo:104: 00000100:00100000:0.0:1787779847.229907:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787779847.229941:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787779847.230045:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863643264 00000100:00100000:1.0:1787779847.230052:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863643264 00010000:00010000:1.0:1787779847.230085:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c0477a70e00/0xc8fc0a517996063f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1c5d expref: 10 pid: 6507 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779847.230112:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863643392 00000100:00100000:1.0:1787779847.230115:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863643392 00010000:00010000:1.0:1787779847.230127:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c0440030400/0xc8fc0a5179960638 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1c56 expref: 11 pid: 6506 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779847.230147:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 31 00000100:00100000:1.0:1787779847.230155:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046099f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+11:2411:x1874622863643264:12345-192.168.203.31@tcp:103: 00010000:00010000:1.0:1787779847.230169:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787779847.230174:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c0477a70e00/0xc8fc0a517996063f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1c5d expref: 11 pid: 6507 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779847.230185:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c0477a70e00/0xc8fc0a517996063f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1c5d expref: 11 pid: 6507 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779847.230205:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787779847.230254:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046099f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+11:2411:x1874622863643264:12345-192.168.203.31@tcp:103: Request processed in 99us (350us total) trans 0 rc 0/0 00010000:00010000:3.0:1787779847.230266:0:10326:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c0477a70e00/0xc8fc0a517996063f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1c5d expref: 11 pid: 6507 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779847.230266:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 31 00000100:00100000:3.0:1787779847.230278:0:10326:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047785da40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10326:1874622881519232:192.168.203.31@tcp:104: 00000100:00100000:3.0:1787779847.230287:0:10326:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047785f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10326:1874622881519360:192.168.203.31@tcp:104: 00000100:00100000:1.0:1787779847.230325:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 32 00010000:00010000:3.0:1787779847.230328:0:10326:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c04766dd400/0xc8fc0a517996067e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779847.230336:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0476496580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+9:2411:x1874622863643392:12345-192.168.203.31@tcp:103: 00010000:00010000:1.0:1787779847.230345:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787779847.230358:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c0440030400/0xc8fc0a5179960638 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1c56 expref: 9 pid: 6506 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779847.230367:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c0440030400/0xc8fc0a5179960638 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1c56 expref: 9 pid: 6506 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779847.230378:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c0440030400/0xc8fc0a5179960638 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1c56 expref: 9 pid: 6506 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779847.230390:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787779847.230412:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0476496580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+8:2411:x1874622863643392:12345-192.168.203.31@tcp:103: Request processed in 79us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779847.230419:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 32 00000100:00100000:2.0:1787779847.230429:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477940780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1f575176-36bc-4786-83ee-2fea064a12a9:3644:1874622881521280:0@lo:103: 00000100:00100000:2.0:1787779847.230461:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779847.230496:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787779847.230500:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477940f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1f575176-36bc-4786-83ee-2fea064a12a9:3644:1874622881521536:0@lo:103: 00000100:00100000:2.0:1787779847.230514:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787779847.230534:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787779847.230860:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881521280 00000100:00100000:3.0:1787779847.230865:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881521280 00010000:00010000:3.0:1787779847.230885:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c0477a71c00/0xc8fc0a5179960582 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc8fc0a517996057b expref: 17 pid: 6507 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779847.230900:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881521536 00000100:00100000:3.0:1787779847.230902:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881521536 00010000:00010000:3.0:1787779847.230911:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c0477a70800/0xc8fc0a5179960543 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc8fc0a517996053c expref: 18 pid: 6505 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779847.230922:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787779847.230928:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046efcfc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1f575176-36bc-4786-83ee-2fea064a12a9+18:3644:x1874622881521280:12345-0@lo:103: 00010000:00010000:3.0:1787779847.230935:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787779847.230940:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c0477a71c00/0xc8fc0a5179960582 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc8fc0a517996057b expref: 18 pid: 6507 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779847.230948:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c0477a71c00/0xc8fc0a5179960582 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc8fc0a517996057b expref: 18 pid: 6507 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779847.230969:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c0477a71c00/0xc8fc0a5179960582 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc8fc0a517996057b expref: 18 pid: 6507 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779847.230979:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787779847.231258:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046efcfc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1f575176-36bc-4786-83ee-2fea064a12a9+17:3644:x1874622881521280:12345-0@lo:103: Request processed in 329us (794us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779847.231264:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787779847.231279:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787779847.231285:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046efcc780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1f575176-36bc-4786-83ee-2fea064a12a9+16:3644:x1874622881521536:12345-0@lo:103: 00010000:00010000:3.0:1787779847.231293:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787779847.231298:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c0477a70800/0xc8fc0a5179960543 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc8fc0a517996053c expref: 16 pid: 6505 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779847.231306:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c0477a70800/0xc8fc0a5179960543 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc8fc0a517996053c expref: 16 pid: 6505 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779847.231315:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c0477a70800/0xc8fc0a5179960543 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc8fc0a517996053c expref: 16 pid: 6505 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779847.231325:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c04766dd400/0xc8fc0a517996067e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779847.231332:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c04766dd400/0xc8fc0a517996067e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779847.231344:0:6499:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c04766dd400/0xc8fc0a517996067e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779847.231351:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c04766dd400/0xc8fc0a517996067e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779847.231364:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c04766dd400/0xc8fc0a517996067e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779847.231370:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c04766dd400/0xc8fc0a517996067e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779847.231376:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c04766dd400 already unused, calling callback (ffffffffc0d97420) 00010000:00010000:3.0:1787779847.231380:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c04766dd400/0xc8fc0a517996067e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779847.231387:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c04766dd400/0xc8fc0a517996067e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779847.231411:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c04766dd400/0xc8fc0a517996067e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779847.231662:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787779847.231688:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046efcc780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1f575176-36bc-4786-83ee-2fea064a12a9+15:3644:x1874622881521536:12345-0@lo:103: Request processed in 403us (1172us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779847.231747:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00010000:1.0:1787779847.231804:0:10326:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c04766dd400/0xc8fc0a517996067e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779847.231814:0:10326:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c04766dd400/0xc8fc0a517996067e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779847.231821:0:10326:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c04766dd400/0xc8fc0a517996067e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779847.231890:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477940f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1f575176-36bc-4786-83ee-2fea064a12a9:3644:1874622881521536:0@lo:103: 00000100:00100000:2.0:1787779847.231902:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477940780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1f575176-36bc-4786-83ee-2fea064a12a9:3644:1874622881521280:0@lo:103: 00010000:00010000:1.0:1787779847.260651:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787779847.452303:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0476497c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874622881521920:0@lo:400: 00000100:00100000:1.0:1787779847.452394:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779847.452452:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04764943c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1874622881522432:0@lo:400: 00000100:00100000:1.0:1787779847.452474:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779847.452498:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0476496940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1874622881522944:0@lo:400: 00000100:00100000:1.0:1787779847.452519:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779847.452559:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1787779847.452565:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0476497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881522048:0@lo:400: 00000100:00100000:1.0:1787779847.452588:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779847.452602:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04764970c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1874622881522560:0@lo:400: 00000100:00100000:1.0:1787779847.452620:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779847.452635:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04618e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1874622881523072:0@lo:400: 00000100:00100000:1.0:1787779847.452666:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779847.452698:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881521920 00000100:00100000:1.0:1787779847.452704:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881521920 00000100:00100000:1.0:1787779847.452737:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881522432 00000100:00100000:1.0:1787779847.452740:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881522432 00000100:00100000:1.0:1787779847.452760:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881522944 00000100:00100000:1.0:1787779847.452762:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881522944 00000100:00100000:1.0:1787779847.452788:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881522560 00000100:00100000:1.0:1787779847.452791:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881522560 00000100:00100000:1.0:1787779847.452814:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881523072 00000100:00100000:1.0:1787779847.452818:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881523072 00000100:00100000:1.0:1787779847.452833:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787779847.452865:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477940f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874622881521920:12345-0@lo:400: 00000100:00100000:1.0:1787779847.452916:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477940f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874622881521920:12345-0@lo:400: Request processed in 53us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779847.452923:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787779847.452940:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787779847.452946:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477af0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874622881522432:12345-0@lo:400: 00000100:00100000:0.0:1787779847.453275:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787779847.453285:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0461beda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1874622881522944:12345-0@lo:400: 00000100:00100000:0.0:1787779847.453316:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0461beda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1874622881522944:12345-0@lo:400: Request processed in 34us (796us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779847.453322:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787779847.453334:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787779847.453339:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346efd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1874622881522560:12345-0@lo:400: 00000100:00100000:0.0:1787779847.453364:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346efd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1874622881522560:12345-0@lo:400: Request processed in 25us (743us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779847.453370:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787779847.453380:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787779847.453385:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c047796d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1874622881523072:12345-0@lo:400: 00000100:00100000:0.0:1787779847.453409:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c047796d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1874622881523072:12345-0@lo:400: Request processed in 24us (743us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779847.453415:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787779847.453484:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0476494f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874622881522176:0@lo:400: 00000100:00100000:3.0:1787779847.453514:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779847.453536:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0476494780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881522688:0@lo:400: 00000100:00100000:3.0:1787779847.453556:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779847.453580:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0345e77c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881523200:0@lo:400: 00000100:00100000:3.0:1787779847.453600:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779847.453620:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:3.0:1787779847.453626:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477940780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881521792:0@lo:13: 00000100:00100000:3.0:1787779847.453659:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779847.453674:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0476495a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881522304:0@lo:400: 00000100:00100000:3.0:1787779847.453694:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779847.453710:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0476495680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881522816:0@lo:400: 00000100:00100000:3.0:1787779847.453729:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779847.453746:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047785f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881523328:0@lo:400: 00000100:00100000:3.0:1787779847.453765:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779847.453894:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881522048 00000100:00100000:2.0:1787779847.453900:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881522048 00000100:00100000:2.0:1787779847.453925:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881522304 00000100:00100000:2.0:1787779847.453928:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881522304 00000100:00100000:2.0:1787779847.453940:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787779847.453946:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0461bec780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881522048:12345-0@lo:400: 00000100:00100000:2.0:1787779847.454056:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0461bec780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881522048:12345-0@lo:400: Request processed in 110us (1467us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779847.454063:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787779847.454077:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787779847.454083:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04778412c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881522304:12345-0@lo:400: 00000100:00100000:2.0:1787779847.454120:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04778412c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881522304:12345-0@lo:400: Request processed in 38us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779847.454126:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:2.0:1787779847.454142:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787779847.454146:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787779847.454156:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881522688 00000100:00100000:2.0:1787779847.454160:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881522688 00000100:00100000:2.0:1787779847.454183:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881523200 00000100:00100000:2.0:1787779847.454186:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881523200 00000100:00100000:2.0:1787779847.454197:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881522816 00000100:00100000:2.0:1787779847.454199:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881522816 00000100:00100000:2.0:1787779847.454210:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881523328 00000100:00100000:2.0:1787779847.454212:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881523328 00000100:00100000:2.0:1787779847.454226:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787779847.454232:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477841e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881522688:12345-0@lo:400: 00000100:00100000:2.0:1787779847.454261:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477841e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881522688:12345-0@lo:400: Request processed in 30us (704us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779847.454268:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787779847.454278:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787779847.454284:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04778430c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881523200:12345-0@lo:400: 00000100:00100000:2.0:1787779847.454310:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04778430c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881523200:12345-0@lo:400: Request processed in 27us (709us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779847.454316:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787779847.454327:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787779847.454333:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477843480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881522816:12345-0@lo:400: 00000100:00100000:2.0:1787779847.454358:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477843480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881522816:12345-0@lo:400: Request processed in 25us (627us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779847.454363:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787779847.454381:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787779847.454387:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04778421c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881523328:12345-0@lo:400: 00000100:00100000:2.0:1787779847.454414:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04778421c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881523328:12345-0@lo:400: Request processed in 27us (647us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779847.454419:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787779847.454436:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881521792 00000100:00100000:2.0:1787779847.454439:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881521792 00000100:00100000:2.0:1787779847.454461:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787779847.454468:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477840000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881521792:12345-0@lo:13: 00002000:00000024:2.0:1787779847.454487:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787779847.454518:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477840000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881521792:12345-0@lo:13: Request processed in 51us (858us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779847.454524:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:2.0:1787779847.454539:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787779847.454542:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787779847.454703:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c047785f480 x1874622881523328/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779863 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779847.454716:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047785f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881523328:0@lo:400: 00010000:00080000:3.0:1787779847.454727:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0476494780 x1874622881522688/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779863 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779847.454735:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0476494780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881522688:0@lo:400: 00010000:00080000:3.0:1787779847.454743:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0345e77c00 x1874622881523200/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779863 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779847.454751:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0345e77c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881523200:0@lo:400: 00010000:00080000:3.0:1787779847.454789:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0477940780 x1874622881521792/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779863 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779847.455244:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477940780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881521792:0@lo:13: 00000100:00100000:3.0:1787779847.455260:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0476495a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881522304:0@lo:400: 00010000:00080000:3.0:1787779847.455269:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0476495680 x1874622881522816/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779863 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779847.455276:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0476495680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881522816:0@lo:400: 00000100:00100000:3.0:1787779847.455338:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881522176 00000100:00100000:3.0:1787779847.455343:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881522176 00000100:00100000:3.0:1787779847.455366:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787779847.455373:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477842580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1874622881522176:12345-0@lo:400: 00000100:00100000:3.0:1787779847.455418:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477842580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1874622881522176:12345-0@lo:400: Request processed in 45us (1902us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779847.455424:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787779847.455765:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477af0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874622881522432:12345-0@lo:400: Request processed in 2818us (3288us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779847.455789:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787779847.456610:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0476497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881522048:0@lo:400: 00010000:00080000:1.0:1787779847.456637:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c04764970c0 x1874622881522560/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779863 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787779847.456647:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04764970c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1874622881522560:0@lo:400: 00010000:00080000:1.0:1787779847.456658:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c04618e8b40 x1874622881523072/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779863 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787779847.456666:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04618e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1874622881523072:0@lo:400: 00000100:00100000:1.0:1787779847.456677:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0476497c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874622881521920:0@lo:400: 00000100:00100000:1.0:1787779847.456687:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04764943c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1874622881522432:0@lo:400: 00000100:00100000:1.0:1787779847.456698:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0476496940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1874622881522944:0@lo:400: 00000100:00100000:2.0:1787779847.457049:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0476494f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874622881522176:0@lo:400: 00000100:00100000:3.0:1787779847.964167:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787779847.964194:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047796cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874622881523456:0@lo:13: 00000100:00100000:3.0:1787779847.964280:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779847.964358:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881523456 00000100:00100000:3.0:1787779847.964365:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881523456 00000100:00100000:3.0:1787779847.964412:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787779847.964422:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477843c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1874622881523456:12345-0@lo:13: 00002000:00000024:3.0:1787779847.964449:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787779847.964498:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477843c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1874622881523456:12345-0@lo:13: Request processed in 78us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779847.964506:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787779847.964578:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c046efce580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881523584:0@lo:13: 00000100:00100000:1.0:1787779847.964607:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1787779847.964688:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c047796cb40 x1874622881523456/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779863 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787779847.964704:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047796cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874622881523456:0@lo:13: 00000100:00100000:2.0:1787779847.965311:0:8529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881523584 00000100:00100000:2.0:1787779847.965317:0:8529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881523584 00000100:00100000:2.0:1787779847.965357:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787779847.965366:0:8529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c047796e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1874622881523584:12345-0@lo:13: 00002000:00000024:2.0:1787779847.965382:0:8529:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787779847.965429:0:8529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c047796e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1874622881523584:12345-0@lo:13: Request processed in 66us (822us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779847.965434:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:1.0:1787779847.965543:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c046efce580 x1874622881523584/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779863 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787779847.965559:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c046efce580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881523584:0@lo:13: 00010000:00010000:1.0:1787779848.286549:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787779848.476155:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477840780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881523712:0@lo:13: 00000100:00100000:2.0:1787779848.476220:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779848.476337:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881523712 00000100:00100000:0.0:1787779848.476346:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881523712 00000100:00100000:0.0:1787779848.476409:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787779848.476418:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046efcda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881523712:12345-0@lo:13: 00002000:00000024:0.0:1787779848.476439:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787779848.476651:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046efcda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881523712:12345-0@lo:13: Request processed in 233us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779848.476658:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:2.0:1787779848.476720:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0477840780 x1874622881523712/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779864 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787779848.476745:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477840780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881523712:0@lo:13: 00000100:00100000:2.0:1787779848.607039:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787779848.607078:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787779848.607119:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787779848.607151:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787779848.607181:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787779848.607210:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863643648 00000100:00100000:2.0:1787779848.607218:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863643648 00000100:00100000:2.0:1787779848.607273:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863643776 00000100:00100000:2.0:1787779848.607276:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863643776 00000100:00100000:2.0:1787779848.607298:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 63 00000100:00100000:2.0:1787779848.607321:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046efcf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+6:2410:x1874622863643648:12345-192.168.203.31@tcp:400: 00000100:00100000:2.0:1787779848.607392:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046efcf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+6:2410:x1874622863643648:12345-192.168.203.31@tcp:400: Request processed in 86us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779848.607400:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 63 00000100:00100000:2.0:1787779848.607417:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 64 00000100:00100000:2.0:1787779848.607423:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046efcd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:2410:x1874622863643776:12345-192.168.203.31@tcp:400: 00000100:00100000:2.0:1787779848.607447:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046efcd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:2410:x1874622863643776:12345-192.168.203.31@tcp:400: Request processed in 25us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779848.607454:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 64 00000100:00080000:2.0:1787779848.607566:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787779848.607570:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787779848.608093:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863643904 00000100:00100000:3.0:1787779848.608098:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863643904 00000100:00100000:3.0:1787779848.608157:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863644032 00000100:00100000:3.0:1787779848.608161:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863644032 00000100:00100000:3.0:1787779848.608184:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 22 00000100:00100000:3.0:1787779848.608193:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046efcf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:2410:x1874622863643904:12345-192.168.203.31@tcp:400: 00000100:00100000:3.0:1787779848.608231:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046efcf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:2410:x1874622863643904:12345-192.168.203.31@tcp:400: Request processed in 40us (1152us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779848.608237:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 22 00000100:00100000:3.0:1787779848.608264:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 23 00000100:00100000:3.0:1787779848.608270:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046efccb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:2410:x1874622863644032:12345-192.168.203.31@tcp:400: 00000100:00100000:3.0:1787779848.608293:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046efccb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:2410:x1874622863644032:12345-192.168.203.31@tcp:400: Request processed in 24us (1112us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779848.608299:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 23 00000100:00080000:2.0:1787779848.608430:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787779848.608434:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787779848.610816:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863643520 00000100:00100000:1.0:1787779848.610830:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863643520 00000100:00100000:1.0:1787779848.610941:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 199 00000100:00100000:1.0:1787779848.610953:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471777050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+8:2410:x1874622863643520:12345-192.168.203.31@tcp:400: 00000100:00100000:1.0:1787779848.611033:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471777050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+8:2410:x1874622863643520:12345-192.168.203.31@tcp:400: Request processed in 82us (3911us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779848.611042:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 199 10000000:01000000:0.0:1787779848.799581:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787779848.799591:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c0346bcb000 from 48 10000000:01000000:0.0:1787779848.799598:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787779848.799651:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c04427db200/0xc8fc0a5179960685 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779848.799662:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff9c04427db200/0xc8fc0a5179960685 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779848.799672:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff9c04427db200/0xc8fc0a5179960685 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779848.799696:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047785da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881523840:0@lo:101: 00000100:00100000:0.0:1787779848.799788:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779848.799884:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0346c21300 going to sleep for 11 seconds 00000100:00100000:1.0:1787779848.800682:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881523840 00000100:00100000:1.0:1787779848.800691:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881523840 00000100:00100000:1.0:1787779848.800769:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1787779848.800779:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471774850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+15:6509:x1874622881523840:12345-0@lo:101: 00010000:00010000:1.0:1787779848.800793:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787779848.800809:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0346dd7800/0xc8fc0a517996068c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc8fc0a5179960685 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779848.800833:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0346dd7800/0xc8fc0a517996068c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc8fc0a5179960685 expref: 16 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779848.800882:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0346dd7800/0xc8fc0a517996068c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a5179960685 expref: 16 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779848.800891:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0346dd7800, rc 0) 00000100:00100000:1.0:1787779848.800948:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471774850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+16:6509:x1874622881523840:12345-0@lo:101: Request processed in 170us (1159us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779848.800954:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1787779848.801120:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047785da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881523840:0@lo:101: 00010000:00010000:0.0:1787779848.801146:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff9c04427db200/0xc8fc0a5179960685 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a517996068c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779848.801155:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff9c04427db200/0xc8fc0a5179960685 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc8fc0a517996068c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779848.801220:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047785da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881523968:0@lo:501: 00000100:00100000:0.0:1787779848.801263:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779848.801297:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0346c21300 going to sleep for 11 seconds 00000100:00100000:1.0:1787779848.801468:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881523968 00000100:00100000:1.0:1787779848.801473:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881523968 00000100:00100000:1.0:1787779848.801508:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1787779848.801515:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471777450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+16:6509:x1874622881523968:12345-0@lo:501: 00000100:00100000:1.0:1787779848.801635:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471777450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+16:6509:x1874622881523968:12345-0@lo:501: Request processed in 121us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779848.801642:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1787779848.801774:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047785da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881523968:0@lo:501: 00000100:00100000:0.0:1787779848.801801:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047785da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881524096:0@lo:503: 00000100:00100000:0.0:1787779848.801862:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779848.801889:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0346c21300 going to sleep for 11 seconds 00000100:00100000:2.0:1787779848.802026:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881524096 00000100:00100000:2.0:1787779848.802031:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881524096 00000100:00100000:2.0:1787779848.802069:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1787779848.802077:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471776850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+16:6509:x1874622881524096:12345-0@lo:503: 00000100:00100000:2.0:1787779848.802335:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471776850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+16:6509:x1874622881524096:12345-0@lo:503: Request processed in 259us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779848.802342:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1787779848.802479:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047785da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881524096:0@lo:503: 00000100:00100000:2.0:1787779848.804105:0:10343:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c046efce580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f575176-36bc-4786-83ee-2fea064a12a9:10343:1874622881524224:0@lo:502: 00000100:00100000:2.0:1787779848.804183:0:10343:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779848.804220:0:10343:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0451537d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787779848.804342:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881524224 00000100:00100000:3.0:1787779848.804349:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881524224 00000100:00100000:3.0:1787779848.804395:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1787779848.804405:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471777c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+16:10343:x1874622881524224:12345-0@lo:502: 00000100:00100000:3.0:1787779848.804535:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471777c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+16:10343:x1874622881524224:12345-0@lo:502: Request processed in 132us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779848.804542:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1787779848.804768:0:10343:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c046efce580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f575176-36bc-4786-83ee-2fea064a12a9:10343:1874622881524224:0@lo:502: 00000100:00100000:0.0:1787779848.804811:0:10343:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047785da40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f575176-36bc-4786-83ee-2fea064a12a9:10343:1874622881524352:0@lo:502: 00000100:00100000:0.0:1787779848.804886:0:10343:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779848.804904:0:10343:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0346c21300 going to sleep for 11 seconds 00000100:00100000:2.0:1787779848.805209:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881524352 00000100:00100000:2.0:1787779848.805213:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881524352 00000100:00100000:2.0:1787779848.805323:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1787779848.805332:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471776c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+16:10343:x1874622881524352:12345-0@lo:502: 00000100:00100000:2.0:1787779848.805422:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471776c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+16:10343:x1874622881524352:12345-0@lo:502: Request processed in 91us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779848.805429:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1787779848.805499:0:10343:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047785da40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f575176-36bc-4786-83ee-2fea064a12a9:10343:1874622881524352:0@lo:502: 00000040:00080000:0.0:1787779848.805521:0:10343:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1787779848.805580:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1787779848.805599:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787779848.805608:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c04427db200/0xc8fc0a5179960685 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a517996068c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779848.805619:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff9c04427db200/0xc8fc0a5179960685 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a517996068c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787779848.805629:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1787779848.805631:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:0.0:1787779848.805634:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1787779848.805656:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c04427da000/0xc8fc0a5179960693 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779848.805676:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff9c04427da000/0xc8fc0a5179960693 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779848.805686:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff9c04427da000/0xc8fc0a5179960693 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779848.805700:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047785da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881524480:0@lo:101: 00000100:00100000:0.0:1787779848.805727:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779848.817523:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0346c21300 going to sleep for 11 seconds 00000100:00100000:3.0:1787779848.822409:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881524480 00000100:00100000:3.0:1787779848.822423:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881524480 00000100:00100000:3.0:1787779848.822826:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1787779848.822939:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471777850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+16:6509:x1874622881524480:12345-0@lo:101: 00010000:00010000:3.0:1787779848.822955:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787779848.822977:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c04766dc800/0xc8fc0a517996069a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc8fc0a5179960693 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779848.823006:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c04766dc800/0xc8fc0a517996069a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc8fc0a5179960693 expref: 17 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779848.823018:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c04766dc800/0xc8fc0a517996069a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a5179960693 expref: 17 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779848.823026:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c04766dc800, rc 0) 00000100:00100000:3.0:1787779848.823143:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471777850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+17:6509:x1874622881524480:12345-0@lo:101: Request processed in 308us (17414us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779848.823164:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1787779848.831559:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047785da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881524480:0@lo:101: 00010000:00010000:0.0:1787779848.831591:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff9c04427da000/0xc8fc0a5179960693 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a517996069a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779848.831604:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff9c04427da000/0xc8fc0a5179960693 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc8fc0a517996069a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779848.831695:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047785da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881524608:0@lo:501: 00000100:00100000:0.0:1787779848.831863:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779848.831910:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0346c21300 going to sleep for 11 seconds 00000100:00100000:1.0:1787779848.832009:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881524608 00000100:00100000:1.0:1787779848.832016:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881524608 00000100:00100000:1.0:1787779848.832066:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1787779848.832076:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471776050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+17:6509:x1874622881524608:12345-0@lo:501: 00000100:00100000:1.0:1787779848.832214:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471776050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+17:6509:x1874622881524608:12345-0@lo:501: Request processed in 139us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779848.832222:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1787779848.833491:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047785da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881524608:0@lo:501: 00000100:00100000:0.0:1787779848.833540:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047785da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881524736:0@lo:503: 00000100:00100000:0.0:1787779848.833606:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779848.833642:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0346c21300 going to sleep for 11 seconds 00000100:00100000:2.0:1787779848.835972:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881524736 00000100:00100000:2.0:1787779848.835987:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881524736 00000100:00100000:2.0:1787779848.836068:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1787779848.836079:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471774450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+17:6509:x1874622881524736:12345-0@lo:503: 00000100:00100000:2.0:1787779848.836259:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471774450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+17:6509:x1874622881524736:12345-0@lo:503: Request processed in 182us (2652us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779848.836267:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1787779848.836400:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047785da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881524736:0@lo:503: 00000100:00100000:0.0:1787779848.837714:0:10344:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047785da40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f575176-36bc-4786-83ee-2fea064a12a9:10344:1874622881524864:0@lo:502: 00000100:00100000:0.0:1787779848.837885:0:10344:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779848.837972:0:10344:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0346c21840 going to sleep for 11 seconds 00000100:00100000:1.0:1787779848.838011:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881524864 00000100:00100000:1.0:1787779848.838017:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881524864 00000100:00100000:1.0:1787779848.838261:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1787779848.838271:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471775450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+17:10344:x1874622881524864:12345-0@lo:502: 00000100:00100000:1.0:1787779848.838413:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471775450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+17:10344:x1874622881524864:12345-0@lo:502: Request processed in 143us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779848.838420:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1787779848.838491:0:10344:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047785da40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f575176-36bc-4786-83ee-2fea064a12a9:10344:1874622881524864:0@lo:502: 00000020:01000000:0.0:1787779848.838532:0:10344:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787779848.838542:0:10344:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787779848.838545:0:10344:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787779848.838549:0:10344:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1787779848.838571:0:10344:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047785da40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f575176-36bc-4786-83ee-2fea064a12a9:10344:1874622881524992:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787779848.838605:0:10344:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779848.839539:0:10344:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0346c21840 going to sleep for 11 seconds 00000100:00100000:2.0:1787779848.839635:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881524992 00000100:00100000:2.0:1787779848.839641:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881524992 00000100:00100000:2.0:1787779848.839674:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1787779848.839682:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471774c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+17:10344:x1874622881524992:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787779848.839878:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471774c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+17:10344:x1874622881524992:12345-0@lo:502:llog_process_th.0 Request processed in 196us (1271us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779848.839893:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1787779848.840064:0:10344:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047785da40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f575176-36bc-4786-83ee-2fea064a12a9:10344:1874622881524992:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787779848.840089:0:10344:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787779848.840095:0:10344:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787779848.840097:0:10344:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787779848.840102:0:10344:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 11 count 11 00000020:01000000:2.0:1787779848.840285:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:2.0:1787779848.840314:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1787779848.840325:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c04427da000/0xc8fc0a5179960693 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a517996069a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779848.840337:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff9c04427da000/0xc8fc0a5179960693 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a517996069a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787779848.840348:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787779848.840351:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c046ecd6000 from 48 10000000:01000000:2.0:1787779848.840354:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787779848.840383:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c0477a71000/0xc8fc0a51799606a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779848.840391:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff9c0477a71000/0xc8fc0a51799606a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779848.840401:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff9c0477a71000/0xc8fc0a51799606a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779848.840420:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c046efccf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881525120:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787779848.840452:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779848.840471:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0443d6e480 going to sleep for 11 seconds 00000100:00100000:1.0:1787779848.840653:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881525120 00000100:00100000:1.0:1787779848.840658:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881525120 00000100:00100000:1.0:1787779848.840694:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1787779848.840701:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471775c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+17:6509:x1874622881525120:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787779848.840711:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787779848.840722:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0346dd6c00/0xc8fc0a51799606a8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc8fc0a51799606a1 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779848.840752:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0346dd6c00/0xc8fc0a51799606a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc8fc0a51799606a1 expref: 18 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779848.840771:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0346dd6c00/0xc8fc0a51799606a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a51799606a1 expref: 18 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779848.840779:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0346dd6c00, rc 0) 00000100:00100000:1.0:1787779848.840824:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471775c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+18:6509:x1874622881525120:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779848.840831:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1787779848.840980:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c046efccf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881525120:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787779848.840993:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff9c0477a71000/0xc8fc0a51799606a1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a51799606a8 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779848.841002:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff9c0477a71000/0xc8fc0a51799606a1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc8fc0a51799606a8 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779848.841049:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047785da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881525248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787779848.841081:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779848.841096:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0346c21840 going to sleep for 11 seconds 00000100:00100000:3.0:1787779848.841142:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881525248 00000100:00100000:3.0:1787779848.841147:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881525248 00000100:00100000:3.0:1787779848.841170:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1787779848.841176:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471774050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+18:6509:x1874622881525248:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787779848.841278:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471774050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+18:6509:x1874622881525248:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 101us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779848.841284:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1787779848.841383:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047785da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881525248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787779848.841407:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047785da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881525376:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787779848.841443:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779848.841451:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0346c21840 going to sleep for 11 seconds 00000100:00100000:3.0:1787779848.841478:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881525376 00000100:00100000:3.0:1787779848.841482:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881525376 00000100:00100000:3.0:1787779848.841551:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1787779848.841558:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471776450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+18:6509:x1874622881525376:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787779848.841636:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471776450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+18:6509:x1874622881525376:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 78us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779848.841642:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1787779848.841708:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047785da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881525376:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787779848.842240:0:10345:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047796cb40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f575176-36bc-4786-83ee-2fea064a12a9:10345:1874622881525504:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787779848.842278:0:10345:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779848.843211:0:10345:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c04717aea80 going to sleep for 11 seconds 00000100:00100000:2.0:1787779848.847114:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881525504 00000100:00100000:2.0:1787779848.847131:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881525504 00000100:00100000:2.0:1787779848.847187:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:2.0:1787779848.847197:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471772050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+18:10345:x1874622881525504:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787779848.847468:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471772050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+18:10345:x1874622881525504:12345-0@lo:502:llog_process_th.0 Request processed in 272us (5188us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779848.847485:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1787779848.847721:0:10345:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047796cb40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f575176-36bc-4786-83ee-2fea064a12a9:10345:1874622881525504:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787779848.847888:0:10345:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477841a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f575176-36bc-4786-83ee-2fea064a12a9:10345:1874622881525632:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787779848.847930:0:10345:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779848.847967:0:10345:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0346be2780 going to sleep for 11 seconds 00000100:00100000:2.0:1787779848.848044:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881525632 00000100:00100000:2.0:1787779848.848050:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881525632 00000100:00100000:2.0:1787779848.848082:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:2.0:1787779848.848089:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471770450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+18:10345:x1874622881525632:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787779848.848179:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471770450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+18:10345:x1874622881525632:12345-0@lo:502:llog_process_th.0 Request processed in 90us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779848.848186:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1787779848.848260:0:10345:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477841a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f575176-36bc-4786-83ee-2fea064a12a9:10345:1874622881525632:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1787779848.848279:0:10345:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1787779848.848489:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1787779848.848521:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787779848.848532:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c0477a71000/0xc8fc0a51799606a1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a51799606a8 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779848.848543:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff9c0477a71000/0xc8fc0a51799606a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a51799606a8 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787779848.848553:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1787779848.848556:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:0.0:1787779848.848559:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1787779848.848582:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c04427daa00/0xc8fc0a51799606af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779848.848589:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff9c04427daa00/0xc8fc0a51799606af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779848.848603:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff9c04427daa00/0xc8fc0a51799606af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779848.848617:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047785da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881525760:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787779848.848645:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779848.848671:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0346c21840 going to sleep for 11 seconds 00000100:00100000:1.0:1787779848.848812:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881525760 00000100:00100000:1.0:1787779848.848817:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881525760 00000100:00100000:1.0:1787779848.848906:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1787779848.848915:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471771450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+18:6509:x1874622881525760:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787779848.848924:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787779848.848937:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0346dd6800/0xc8fc0a51799606b6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc8fc0a51799606af expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779848.848957:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0346dd6800/0xc8fc0a51799606b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc8fc0a51799606af expref: 19 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779848.848968:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0346dd6800/0xc8fc0a51799606b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a51799606af expref: 19 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779848.848977:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0346dd6800, rc 0) 00000100:00100000:1.0:1787779848.849044:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471771450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+19:6509:x1874622881525760:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779848.849051:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1787779848.849415:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047785da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881525760:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787779848.849427:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff9c04427daa00/0xc8fc0a51799606af lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a51799606b6 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779848.849446:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff9c04427daa00/0xc8fc0a51799606af lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc8fc0a51799606b6 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779848.849548:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047785da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881525888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787779848.849576:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779848.849630:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0346c21840 going to sleep for 11 seconds 00000100:00100000:1.0:1787779848.849658:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881525888 00000100:00100000:1.0:1787779848.849667:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881525888 00000100:00100000:1.0:1787779848.849727:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1787779848.849734:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471770c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+19:6509:x1874622881525888:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787779848.850027:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471770c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+19:6509:x1874622881525888:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 292us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779848.850035:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1787779848.850228:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047785da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881525888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787779848.850256:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047785da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881526016:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787779848.850293:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779848.850414:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0346c21840 going to sleep for 11 seconds 00000100:00100000:3.0:1787779848.850444:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881526016 00000100:00100000:3.0:1787779848.850449:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881526016 00000100:00100000:3.0:1787779848.850521:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1787779848.850529:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471771c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+19:6509:x1874622881526016:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787779848.850614:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471771c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+19:6509:x1874622881526016:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 86us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779848.850630:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1787779848.850731:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047785da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881526016:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787779848.851345:0:10346:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047796f840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f575176-36bc-4786-83ee-2fea064a12a9:10346:1874622881526144:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787779848.851386:0:10346:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779848.851414:0:10346:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c04717ae600 going to sleep for 11 seconds 00000100:00100000:3.0:1787779848.851521:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881526144 00000100:00100000:3.0:1787779848.851527:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881526144 00000100:00100000:3.0:1787779848.851564:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1787779848.851571:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471770050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+19:10346:x1874622881526144:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787779848.851646:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471770050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+19:10346:x1874622881526144:12345-0@lo:502:llog_process_th.0 Request processed in 76us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779848.851654:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1787779848.851834:0:10346:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047796f840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f575176-36bc-4786-83ee-2fea064a12a9:10346:1874622881526144:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787779848.851878:0:10346:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787779848.851887:0:10346:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787779848.851890:0:10346:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787779848.851895:0:10346:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1787779848.851913:0:10346:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047796f840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f575176-36bc-4786-83ee-2fea064a12a9:10346:1874622881526272:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787779848.851944:0:10346:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779848.851965:0:10346:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c04717ae600 going to sleep for 11 seconds 00000100:00100000:3.0:1787779848.852013:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881526272 00000100:00100000:3.0:1787779848.852018:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881526272 00000100:00100000:3.0:1787779848.852045:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1787779848.852051:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471772450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+19:10346:x1874622881526272:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787779848.852110:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471772450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+19:10346:x1874622881526272:12345-0@lo:502:llog_process_th.0 Request processed in 59us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779848.852117:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1787779848.852231:0:10346:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047796f840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f575176-36bc-4786-83ee-2fea064a12a9:10346:1874622881526272:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787779848.852248:0:10346:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787779848.852252:0:10346:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787779848.852253:0:10346:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787779848.852257:0:10346:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 14 count 14 00000020:01000000:3.0:1787779848.852454:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:3.0:1787779848.852474:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1787779848.852484:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c04427daa00/0xc8fc0a51799606af lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a51799606b6 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779848.852505:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff9c04427daa00/0xc8fc0a51799606af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a51799606b6 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787779848.852516:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787779848.852519:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c04764fa000 from 48 10000000:01000000:3.0:1787779848.852523:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787779848.852553:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c04766dce00/0xc8fc0a51799606bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779848.852570:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff9c04766dce00/0xc8fc0a51799606bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779848.852581:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff9c04766dce00/0xc8fc0a51799606bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779848.852595:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477840f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881526400:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787779848.852627:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779848.852658:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c04778dc9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787779848.852756:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881526400 00000100:00100000:1.0:1787779848.852769:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881526400 00000100:00100000:1.0:1787779848.852806:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1787779848.852813:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471771850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+19:6509:x1874622881526400:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787779848.852823:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787779848.852861:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0346dd7200/0xc8fc0a51799606c4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc8fc0a51799606bd expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779848.852882:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0346dd7200/0xc8fc0a51799606c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc8fc0a51799606bd expref: 20 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779848.852892:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0346dd7200/0xc8fc0a51799606c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a51799606bd expref: 20 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779848.852900:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0346dd7200, rc 0) 00000100:00100000:1.0:1787779848.852927:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471771850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+20:6509:x1874622881526400:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779848.852934:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1787779848.853063:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477840f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881526400:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787779848.853074:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff9c04766dce00/0xc8fc0a51799606bd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a51799606c4 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779848.853083:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff9c04766dce00/0xc8fc0a51799606bd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xc8fc0a51799606c4 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779848.853134:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477840f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881526528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787779848.853158:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779848.853182:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c04778dc9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787779848.853222:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881526528 00000100:00100000:1.0:1787779848.853227:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881526528 00000100:00100000:1.0:1787779848.853254:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1787779848.853260:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471771050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+20:6509:x1874622881526528:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787779848.853490:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471771050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+20:6509:x1874622881526528:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 229us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779848.853506:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1787779848.853701:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477840f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881526528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787779848.853729:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477840f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881526656:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787779848.853963:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779848.854017:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c04778dc9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787779848.854052:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881526656 00000100:00100000:1.0:1787779848.854057:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881526656 00000100:00100000:1.0:1787779848.854123:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1787779848.854131:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471773050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+20:6509:x1874622881526656:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787779848.854231:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471773050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+20:6509:x1874622881526656:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 99us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779848.854237:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1787779848.854316:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477840f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881526656:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787779848.854722:0:10347:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c046efcde00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f575176-36bc-4786-83ee-2fea064a12a9:10347:1874622881526784:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787779848.854779:0:10347:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779848.855070:0:10347:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0448e8aa80 going to sleep for 11 seconds 00000100:00100000:3.0:1787779848.855124:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881526784 00000100:00100000:3.0:1787779848.855129:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881526784 00000100:00100000:3.0:1787779848.855159:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1787779848.855165:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471770850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+20:10347:x1874622881526784:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787779848.855255:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471770850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+20:10347:x1874622881526784:12345-0@lo:502:llog_process_th.0 Request processed in 89us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779848.855262:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1787779848.855407:0:10347:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c046efcde00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f575176-36bc-4786-83ee-2fea064a12a9:10347:1874622881526784:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787779848.855444:0:10347:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c046efcde00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f575176-36bc-4786-83ee-2fea064a12a9:10347:1874622881526912:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787779848.855477:0:10347:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779848.855505:0:10347:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0448e8aa80 going to sleep for 11 seconds 00000100:00100000:3.0:1787779848.855589:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881526912 00000100:00100000:3.0:1787779848.855594:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881526912 00000100:00100000:3.0:1787779848.855611:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1787779848.855617:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471773450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+20:10347:x1874622881526912:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787779848.855684:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471773450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+20:10347:x1874622881526912:12345-0@lo:502:llog_process_th.0 Request processed in 66us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779848.855690:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1787779848.855773:0:10347:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c046efcde00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f575176-36bc-4786-83ee-2fea064a12a9:10347:1874622881526912:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1787779848.855792:0:10347:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1787779848.855994:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:3.0:1787779848.856015:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787779848.856024:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c04766dce00/0xc8fc0a51799606bd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a51799606c4 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779848.856034:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff9c04766dce00/0xc8fc0a51799606bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a51799606c4 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787779848.856044:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1787779848.856047:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 43 10000000:01000000:3.0:1787779848.856050:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1787779848.856072:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c04766dd000/0xc8fc0a51799606cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779848.856080:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff9c04766dd000/0xc8fc0a51799606cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779848.856099:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff9c04766dd000/0xc8fc0a51799606cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779848.856112:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477840f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881527040:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787779848.856140:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779848.856168:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0346b50840 going to sleep for 11 seconds 00000100:00100000:2.0:1787779848.856213:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881527040 00000100:00100000:2.0:1787779848.856217:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881527040 00000100:00100000:2.0:1787779848.856234:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1787779848.856240:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471772850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+20:6509:x1874622881527040:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787779848.856248:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787779848.856265:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0477a71200/0xc8fc0a51799606d2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xc8fc0a51799606cb expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779848.856285:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0477a71200/0xc8fc0a51799606d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc8fc0a51799606cb expref: 21 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779848.856295:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0477a71200/0xc8fc0a51799606d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a51799606cb expref: 21 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779848.856372:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0477a71200, rc 0) 00000100:00100000:2.0:1787779848.856508:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471772850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+21:6509:x1874622881527040:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 267us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779848.856515:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1787779848.856691:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477840f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881527040:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787779848.856704:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff9c04766dd000/0xc8fc0a51799606cb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a51799606d2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779848.856714:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff9c04766dd000/0xc8fc0a51799606cb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xc8fc0a51799606d2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779848.857064:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477840f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881527168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787779848.857092:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779848.857122:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0346b50840 going to sleep for 11 seconds 00000100:00100000:2.0:1787779848.857167:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881527168 00000100:00100000:2.0:1787779848.857171:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881527168 00000100:00100000:2.0:1787779848.857202:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1787779848.857209:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471773c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+21:6509:x1874622881527168:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787779848.857326:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471773c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+21:6509:x1874622881527168:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 117us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779848.857332:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1787779848.857441:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477840f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881527168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787779848.857470:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047785da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881527296:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787779848.857519:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779848.857541:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0346c21300 going to sleep for 11 seconds 00000100:00100000:2.0:1787779848.857612:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881527296 00000100:00100000:2.0:1787779848.857617:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881527296 00000100:00100000:2.0:1787779848.857646:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1787779848.857652:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471772c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+21:6509:x1874622881527296:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787779848.857721:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471772c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+21:6509:x1874622881527296:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 68us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779848.857727:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1787779848.857888:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047785da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881527296:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787779848.858418:0:10348:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477841a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f575176-36bc-4786-83ee-2fea064a12a9:10348:1874622881527424:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787779848.858458:0:10348:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779848.858528:0:10348:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0450cc4b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787779848.858606:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881527424 00000100:00100000:2.0:1787779848.858616:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881527424 00000100:00100000:2.0:1787779848.858675:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1787779848.858682:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471773850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+21:10348:x1874622881527424:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787779848.858861:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471773850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+21:10348:x1874622881527424:12345-0@lo:502:llog_process_th.0 Request processed in 158us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779848.858868:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1787779848.858939:0:10348:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477841a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f575176-36bc-4786-83ee-2fea064a12a9:10348:1874622881527424:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787779848.858965:0:10348:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787779848.858974:0:10348:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787779848.858976:0:10348:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787779848.858982:0:10348:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1787779848.858999:0:10348:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477841a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f575176-36bc-4786-83ee-2fea064a12a9:10348:1874622881527552:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787779848.859040:0:10348:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779848.859229:0:10348:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c04766606c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787779848.859287:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881527552 00000100:00100000:0.0:1787779848.859293:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881527552 00000100:00100000:1.0:1787779848.859475:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1787779848.859490:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046098c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+21:10348:x1874622881527552:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787779848.859587:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046098c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+21:10348:x1874622881527552:12345-0@lo:502:llog_process_th.0 Request processed in 98us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779848.859594:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1787779848.859708:0:10348:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477841a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f575176-36bc-4786-83ee-2fea064a12a9:10348:1874622881527552:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787779848.859727:0:10348:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787779848.859731:0:10348:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787779848.859733:0:10348:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787779848.860929:0:10348:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 46 count 46 00000020:01000000:0.0:1787779848.861140:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 43-45 (rc=0) 10000000:01000000:0.0:1787779848.861164:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1787779848.861175:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c04766dd000/0xc8fc0a51799606cb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a51799606d2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779848.861187:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff9c04766dd000/0xc8fc0a51799606cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a51799606d2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787779848.861212:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787779848.861214:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c044407a000 from 48 10000000:01000000:0.0:1787779848.861217:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787779848.861251:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c04427db400/0xc8fc0a51799606d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779848.861259:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff9c04427db400/0xc8fc0a51799606d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779848.861269:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff9c04427db400/0xc8fc0a51799606d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779848.861289:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047785da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881527680:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787779848.861354:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779848.861720:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0346c21300 going to sleep for 11 seconds 00000100:00100000:2.0:1787779848.861919:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881527680 00000100:00100000:2.0:1787779848.861926:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881527680 00000100:00100000:2.0:1787779848.861962:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1787779848.861972:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046098e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+21:6509:x1874622881527680:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787779848.861986:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787779848.861999:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0477a70c00/0xc8fc0a51799606e0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xc8fc0a51799606d9 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779848.862023:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0477a70c00/0xc8fc0a51799606e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc8fc0a51799606d9 expref: 22 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779848.862033:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0477a70c00/0xc8fc0a51799606e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a51799606d9 expref: 22 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779848.862041:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0477a70c00, rc 0) 00000100:00100000:2.0:1787779848.862116:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046098e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+22:6509:x1874622881527680:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 145us (762us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779848.862131:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1787779848.862294:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047785da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881527680:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787779848.862371:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff9c04427db400/0xc8fc0a51799606d9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a51799606e0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779848.862381:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff9c04427db400/0xc8fc0a51799606d9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xc8fc0a51799606e0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779848.862441:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047785da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881527808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787779848.862468:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779848.862550:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0346c21300 going to sleep for 11 seconds 00000100:00100000:2.0:1787779848.862587:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881527808 00000100:00100000:2.0:1787779848.862591:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881527808 00000100:00100000:2.0:1787779848.862643:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1787779848.862650:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046098d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+22:6509:x1874622881527808:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787779848.862873:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046098d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+22:6509:x1874622881527808:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 222us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779848.862880:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1787779848.862972:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047785da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881527808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787779848.862999:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047785da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881527936:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787779848.863044:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779848.863230:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0346c21300 going to sleep for 11 seconds 00000100:00100000:1.0:1787779848.863264:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881527936 00000100:00100000:1.0:1787779848.863269:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881527936 00000100:00100000:1.0:1787779848.863293:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1787779848.863299:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046098d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+22:6509:x1874622881527936:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787779848.863390:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046098d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+22:6509:x1874622881527936:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 90us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779848.863396:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1787779848.864080:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047785da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881527936:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787779848.865010:0:10349:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047785da40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f575176-36bc-4786-83ee-2fea064a12a9:10349:1874622881528064:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787779848.865074:0:10349:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779848.865105:0:10349:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0346c216c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787779848.865222:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881528064 00000100:00100000:1.0:1787779848.865229:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881528064 00000100:00100000:1.0:1787779848.865260:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1787779848.865269:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046098f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+22:10349:x1874622881528064:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787779848.865403:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046098f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+22:10349:x1874622881528064:12345-0@lo:502:llog_process_th.0 Request processed in 134us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779848.865410:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1787779848.865625:0:10349:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047785da40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f575176-36bc-4786-83ee-2fea064a12a9:10349:1874622881528064:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787779848.865663:0:10349:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047785da40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f575176-36bc-4786-83ee-2fea064a12a9:10349:1874622881528192:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787779848.865697:0:10349:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779848.865717:0:10349:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0346c216c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787779848.865770:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881528192 00000100:00100000:1.0:1787779848.865774:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881528192 00000100:00100000:1.0:1787779848.865791:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1787779848.865797:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046098c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+22:10349:x1874622881528192:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787779848.865891:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046098c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+22:10349:x1874622881528192:12345-0@lo:502:llog_process_th.0 Request processed in 94us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779848.865897:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1787779848.866029:0:10349:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047785da40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f575176-36bc-4786-83ee-2fea064a12a9:10349:1874622881528192:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1787779848.866048:0:10349:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1787779848.866272:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:1.0:1787779848.866298:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787779848.866432:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c04427db400/0xc8fc0a51799606d9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a51799606e0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779848.866442:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff9c04427db400/0xc8fc0a51799606d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a51799606e0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787779848.866451:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1787779848.866454:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 43 10000000:01000000:1.0:1787779848.866456:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1787779848.866479:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c0346dd7000/0xc8fc0a51799606e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779848.866486:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff9c0346dd7000/0xc8fc0a51799606e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779848.866609:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff9c0346dd7000/0xc8fc0a51799606e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779848.866627:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047796f840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881528320:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787779848.866659:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779848.866723:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c046c909d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787779848.866856:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881528320 00000100:00100000:2.0:1787779848.866861:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881528320 00000100:00100000:3.0:1787779848.866935:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1787779848.866946:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046098f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+22:6509:x1874622881528320:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787779848.866957:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787779848.866971:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c04766dd800/0xc8fc0a51799606ee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xc8fc0a51799606e7 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779848.866997:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c04766dd800/0xc8fc0a51799606ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc8fc0a51799606e7 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779848.867009:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c04766dd800/0xc8fc0a51799606ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a51799606e7 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779848.867016:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c04766dd800, rc 0) 00000100:00100000:3.0:1787779848.867055:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046098f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+23:6509:x1874622881528320:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779848.867061:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1787779848.867142:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047796f840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881528320:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787779848.867155:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff9c0346dd7000/0xc8fc0a51799606e7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a51799606ee expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779848.867163:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff9c0346dd7000/0xc8fc0a51799606e7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xc8fc0a51799606ee expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779848.867213:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047796f840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881528448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787779848.867245:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779848.869128:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c046c909d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787779848.869181:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881528448 00000100:00100000:0.0:1787779848.869189:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881528448 00000100:00100000:0.0:1787779848.869235:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1787779848.869243:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046098e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+23:6509:x1874622881528448:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787779848.869435:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046098e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+23:6509:x1874622881528448:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 192us (2189us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779848.869442:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1787779848.869641:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047796f840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881528448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787779848.869683:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047796f840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881528576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787779848.869743:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779848.869800:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c046c909d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787779848.869959:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881528576 00000100:00100000:0.0:1787779848.869963:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881528576 00000100:00100000:0.0:1787779848.869988:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1787779848.869993:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046098fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+23:6509:x1874622881528576:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787779848.870098:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046098fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+23:6509:x1874622881528576:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 104us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779848.870110:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1787779848.870163:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047796f840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881528576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787779848.870673:0:10350:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047796f840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f575176-36bc-4786-83ee-2fea064a12a9:10350:1874622881528704:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787779848.870755:0:10350:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779848.870820:0:10350:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c046ef9ce40 going to sleep for 11 seconds 00000100:00100000:3.0:1787779848.870937:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881528704 00000100:00100000:3.0:1787779848.870941:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881528704 00000100:00100000:3.0:1787779848.870970:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1787779848.870978:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046098ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+23:10350:x1874622881528704:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787779848.871097:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046098ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+23:10350:x1874622881528704:12345-0@lo:502:llog_process_th.0 Request processed in 119us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779848.871110:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1787779848.871170:0:10350:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047796f840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f575176-36bc-4786-83ee-2fea064a12a9:10350:1874622881528704:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787779848.871191:0:10350:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787779848.871199:0:10350:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787779848.871202:0:10350:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787779848.871206:0:10350:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1787779848.871223:0:10350:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047796f840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f575176-36bc-4786-83ee-2fea064a12a9:10350:1874622881528832:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787779848.871252:0:10350:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779848.871272:0:10350:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c046ef9ce40 going to sleep for 11 seconds 00000100:00100000:0.0:1787779848.871284:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881528832 00000100:00100000:0.0:1787779848.871289:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881528832 00000100:00100000:0.0:1787779848.871381:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1787779848.871388:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046098f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+23:10350:x1874622881528832:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787779848.871464:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046098f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+23:10350:x1874622881528832:12345-0@lo:502:llog_process_th.0 Request processed in 76us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779848.871471:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1787779848.871560:0:10350:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047796f840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f575176-36bc-4786-83ee-2fea064a12a9:10350:1874622881528832:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787779848.871577:0:10350:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787779848.871581:0:10350:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787779848.871583:0:10350:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787779848.871587:0:10350:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:0.0:1787779848.871732:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 43-45 (rc=0) 10000000:01000000:0.0:1787779848.871749:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787779848.871767:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c0346dd7000/0xc8fc0a51799606e7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a51799606ee expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779848.871779:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff9c0346dd7000/0xc8fc0a51799606e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a51799606ee expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787779848.871789:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1787779848.871792:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9c04515699b8 from 1 10000000:01000000:0.0:1787779848.871795:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787779848.871815:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c04427dae00/0xc8fc0a51799606f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779848.871823:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff9c04427dae00/0xc8fc0a51799606f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779848.871832:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff9c04427dae00/0xc8fc0a51799606f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779848.872042:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047785da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881528960:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787779848.872076:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779848.872140:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0346c21c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787779848.872169:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881528960 00000100:00100000:3.0:1787779848.872173:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881528960 00000100:00100000:3.0:1787779848.872226:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1787779848.872234:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046098e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+23:6509:x1874622881528960:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787779848.872243:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787779848.872255:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c04766dde00/0xc8fc0a51799606fc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xc8fc0a51799606f5 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779848.872274:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c04766dde00/0xc8fc0a51799606fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc8fc0a51799606f5 expref: 24 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779848.872284:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c04766dde00/0xc8fc0a51799606fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a51799606f5 expref: 24 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779848.872291:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c04766dde00, rc 0) 00000100:00100000:3.0:1787779848.872337:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046098e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+24:6509:x1874622881528960:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 104us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779848.872343:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1787779848.872393:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047785da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881528960:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787779848.872404:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff9c04427dae00/0xc8fc0a51799606f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a51799606fc expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779848.872419:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff9c04427dae00/0xc8fc0a51799606f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xc8fc0a51799606fc expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779848.872461:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047796f840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881529088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787779848.872484:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779848.872632:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c046ef9ce40 going to sleep for 11 seconds 00000100:00100000:0.0:1787779848.872661:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881529088 00000100:00100000:0.0:1787779848.872665:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881529088 00000100:00100000:0.0:1787779848.872691:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1787779848.872698:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046098c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+24:6509:x1874622881529088:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787779848.872825:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046098c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+24:6509:x1874622881529088:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 127us (339us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787779848.872832:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1787779848.872943:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047796f840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881529088:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1787779848.872976:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787779848.872981:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c04427dae00/0xc8fc0a51799606f5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a51799606fc expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779848.872989:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff9c04427dae00/0xc8fc0a51799606f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a51799606fc expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779849.308292:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787779850.012252:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787779850.012277:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047796f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881529216:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787779850.012344:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779850.012460:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881529216 00000100:00100000:3.0:1787779850.012469:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881529216 00000100:00100000:3.0:1787779850.012519:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787779850.012529:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c047785f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881529216:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787779850.012559:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787779850.012613:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c047785f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881529216:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779850.012620:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787779850.012680:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047796f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881529216:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787779850.335885:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787779850.525058:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047785fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881529344:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787779850.525166:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779850.525332:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881529344 00000100:00100000:2.0:1787779850.525340:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881529344 00000100:00100000:2.0:1787779850.525389:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787779850.525410:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477841a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874622881529344:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787779850.525440:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787779850.525495:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477841a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874622881529344:12345-0@lo:41:osp-pre-1-0.0 Request processed in 88us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779850.525503:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787779850.525634:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047785fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881529344:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787779851.356984:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787779852.380467:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787779852.572191:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047785fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1874622881529600:0@lo:400:kworker.0 00000100:00100000:0.0:1787779852.572257:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779852.572311:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346de3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1874622881530112:0@lo:400:kworker.0 00000100:00100000:0.0:1787779852.572332:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779852.572351:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04812a8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1874622881530624:0@lo:400:kworker.0 00000100:00100000:0.0:1787779852.572372:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779852.572399:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1787779852.572404:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047785da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881529728:0@lo:400:kworker.0 00000100:00100000:0.0:1787779852.572428:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779852.572443:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346de3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1874622881530240:0@lo:400:kworker.0 00000100:00100000:0.0:1787779852.572462:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779852.572474:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04812aa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1874622881530752:0@lo:400:kworker.0 00000100:00100000:0.0:1787779852.572490:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779852.572521:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881529600 00000100:00100000:0.0:1787779852.572527:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881529600 00000100:00100000:0.0:1787779852.572560:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881530112 00000100:00100000:0.0:1787779852.572563:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881530112 00000100:00100000:0.0:1787779852.572580:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881530624 00000100:00100000:0.0:1787779852.572582:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881530624 00000100:00100000:0.0:1787779852.572592:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881530240 00000100:00100000:0.0:1787779852.572594:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881530240 00000100:00100000:0.0:1787779852.572603:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881530752 00000100:00100000:0.0:1787779852.572605:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881530752 00000100:00100000:0.0:1787779852.572620:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787779852.572627:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04812abc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1874622881529600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787779852.572673:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04812abc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1874622881529600:12345-0@lo:400:kworker.0 Request processed in 46us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779852.572680:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787779852.572695:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787779852.572701:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04812a9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1874622881530112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787779852.572742:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04812a9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1874622881530112:12345-0@lo:400:kworker.0 Request processed in 32us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779852.572747:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787779852.572865:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047785de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1f575176-36bc-4786-83ee-2fea064a12a9:3642:1874622881529472:0@lo:400:kworker.0 00000100:00100000:3.0:1787779852.572898:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779852.572926:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346de03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881529984:0@lo:400:kworker.0 00000100:00100000:3.0:1787779852.572946:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779852.572961:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346de2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881530496:0@lo:400:kworker.0 00000100:00100000:3.0:1787779852.572981:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779852.572997:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04812ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881531008:0@lo:400:kworker.0 00000100:00100000:3.0:1787779852.573016:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779852.573034:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1787779852.573039:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047785f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1874622881529856:0@lo:400:kworker.0 00000100:00100000:3.0:1787779852.573060:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779852.573070:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346de1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874622881530368:0@lo:400:kworker.0 00000100:00100000:3.0:1787779852.573088:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779852.573104:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04812a9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874622881530880:0@lo:400:kworker.0 00000100:00100000:3.0:1787779852.573123:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779852.573146:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881530496 00000100:00100000:3.0:1787779852.573150:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881530496 00000100:00100000:3.0:1787779852.573171:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881531008 00000100:00100000:3.0:1787779852.573174:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881531008 00000100:00100000:3.0:1787779852.573184:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881530368 00000100:00100000:3.0:1787779852.573187:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881530368 00000100:00100000:3.0:1787779852.573198:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881530880 00000100:00100000:3.0:1787779852.573200:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881530880 00000100:00100000:3.0:1787779852.573223:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787779852.573228:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477842d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1874622881530496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779852.573260:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477842d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1874622881530496:12345-0@lo:400:kworker.0 Request processed in 32us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779852.573266:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787779852.573277:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787779852.573283:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477840f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1874622881531008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779852.573307:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477840f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1874622881531008:12345-0@lo:400:kworker.0 Request processed in 25us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779852.573313:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787779852.573322:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787779852.573327:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0345e77c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1874622881530368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779852.573350:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0345e77c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1874622881530368:12345-0@lo:400:kworker.0 Request processed in 23us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779852.573355:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787779852.573365:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787779852.573369:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0476494f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1874622881530880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779852.573389:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0476494f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1874622881530880:12345-0@lo:400:kworker.0 Request processed in 20us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779852.573395:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:3.0:1787779852.573429:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0346de1e00 x1874622881530368/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779868 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779852.573442:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346de1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874622881530368:0@lo:400:kworker.0 00010000:00080000:3.0:1787779852.573451:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c04812a9a40 x1874622881530880/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779868 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779852.573471:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04812a9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874622881530880:0@lo:400:kworker.0 00010000:00080000:3.0:1787779852.573481:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0346de2580 x1874622881530496/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779868 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779852.573489:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346de2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881530496:0@lo:400:kworker.0 00010000:00080000:3.0:1787779852.573497:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c04812ab480 x1874622881531008/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779868 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779852.573505:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04812ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881531008:0@lo:400:kworker.0 00000100:00100000:3.0:1787779852.573549:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881529856 00000100:00100000:3.0:1787779852.573553:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881529856 00000100:00100000:3.0:1787779852.573571:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787779852.573576:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04812a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1874622881530624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779852.573605:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04812a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1874622881530624:12345-0@lo:400:kworker.0 Request processed in 29us (1233us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779852.573610:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787779852.573621:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787779852.573627:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04812aa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1874622881530240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779852.573650:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04812aa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1874622881530240:12345-0@lo:400:kworker.0 Request processed in 23us (1187us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779852.573655:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787779852.573665:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787779852.573670:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04812ab0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1874622881530752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779852.573692:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04812ab0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1874622881530752:12345-0@lo:400:kworker.0 Request processed in 22us (1201us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779852.573706:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787779852.573718:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787779852.573724:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477940780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1874622881529856:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787779852.573873:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787779852.573878:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787779852.573880:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787779852.573882:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787779852.573896:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881529728 00000100:00100000:2.0:1787779852.573900:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881529728 00000100:00100000:2.0:1787779852.573920:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881529984 00000100:00100000:2.0:1787779852.573922:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881529984 00000100:00100000:2.0:1787779852.573934:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787779852.573940:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04812aad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881529728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779852.573977:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04812aad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881529728:12345-0@lo:400:kworker.0 Request processed in 37us (1548us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779852.573992:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787779852.574005:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787779852.574011:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477840780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1874622881529984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779852.574045:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477840780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1874622881529984:12345-0@lo:400:kworker.0 Request processed in 34us (1098us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779852.574051:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787779852.574073:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346de03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881529984:0@lo:400:kworker.0 00000100:00100000:2.0:1787779852.574092:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881529472 00000100:00100000:2.0:1787779852.574095:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881529472 00000100:00100000:2.0:1787779852.574119:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1787779852.574124:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046098d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+24:3642:x1874622881529472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779852.574155:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046098d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+24:3642:x1874622881529472:12345-0@lo:400:kworker.0 Request processed in 30us (1256us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779852.574160:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1787779852.574188:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047785de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1f575176-36bc-4786-83ee-2fea064a12a9:3642:1874622881529472:0@lo:400:kworker.0 00000100:00100000:2.0:1787779852.574235:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047785da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881529728:0@lo:400:kworker.0 00010000:00080000:2.0:1787779852.574246:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0346de3c00 x1874622881530240/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779868 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787779852.574256:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346de3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1874622881530240:0@lo:400:kworker.0 00010000:00080000:2.0:1787779852.574265:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c04812aa580 x1874622881530752/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779868 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787779852.574273:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04812aa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1874622881530752:0@lo:400:kworker.0 00000100:00100000:2.0:1787779852.574283:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047785fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1874622881529600:0@lo:400:kworker.0 00000100:00100000:2.0:1787779852.574300:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346de3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1874622881530112:0@lo:400:kworker.0 00000100:00100000:2.0:1787779852.574311:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04812a8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1874622881530624:0@lo:400:kworker.0 00000100:00100000:1.0:1787779852.574427:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787779852.574437:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047796d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881531136:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787779852.574468:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779852.574503:0:8529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881531136 00000100:00100000:2.0:1787779852.574507:0:8529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881531136 00000100:00100000:2.0:1787779852.574533:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787779852.574539:0:8529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c047796c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881531136:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787779852.574560:0:8529:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787779852.574604:0:8529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c047796c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881531136:12345-0@lo:13:osp-pre-1-1.0 Request processed in 65us (135us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779852.574610:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787779852.574637:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477940780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1874622881529856:12345-0@lo:400:kworker.0 Request processed in 913us (1575us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779852.574648:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00010000:00080000:1.0:1787779852.574672:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c047796d680 x1874622881531136/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779868 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787779852.574685:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047796d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881531136:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787779852.574752:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047785f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1874622881529856:0@lo:400:kworker.0 00000100:00100000:0.0:1787779853.084421:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047796d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881531264:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787779853.084493:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779853.084545:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787779853.084559:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c046efcde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881531392:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787779853.084587:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779853.086098:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881531264 00000100:00100000:3.0:1787779853.086110:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881531264 00000100:00100000:3.0:1787779853.086204:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881531392 00000100:00100000:3.0:1787779853.086208:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881531392 00000100:00100000:0.0:1787779853.086242:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787779853.086252:0:8529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04812a92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881531264:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787779853.086282:0:8529:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787779853.086338:0:8529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04812a92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881531264:12345-0@lo:13:osp-pre-0-1.0 Request processed in 88us (1846us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779853.086356:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787779853.086374:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787779853.086380:0:8529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046efcc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1874622881531392:12345-0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1787779853.086386:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c047796d680 x1874622881531264/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779869 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00002000:00000024:0.0:1787779853.086389:0:8529:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787779853.086405:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047796d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881531264:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787779853.086420:0:8529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046efcc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1874622881531392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 40us (1832us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779853.086425:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:2.0:1787779853.086452:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c046efcde00 x1874622881531392/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779869 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787779853.086466:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c046efcde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881531392:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787779853.404397:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787779853.606357:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0476496940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881531520:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787779853.606442:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779853.606591:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881531520 00000100:00100000:3.0:1787779853.606600:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881531520 00000100:00100000:3.0:1787779853.606778:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787779853.606789:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046efcde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1874622881531520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787779853.606812:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787779853.607123:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046efcde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1874622881531520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 275us (619us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779853.607131:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:2.0:1787779853.607208:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0476496940 x1874622881531520/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779869 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787779853.607244:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0476496940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881531520:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787779853.722321:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787779853.722372:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787779853.722387:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863644288 00000100:00100000:0.0:1787779853.722396:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863644288 00000100:00100000:2.0:1787779853.722411:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787779853.722426:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863644160 00000100:00100000:1.0:1787779853.722432:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863644160 00000100:00100000:0.0:1787779853.722454:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 71 00000100:00100000:0.0:1787779853.722465:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046efced00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+6:2411:x1874622863644288:12345-192.168.203.31@tcp:400: 00000100:00100000:1.0:1787779853.722485:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 243 00000100:00100000:1.0:1787779853.722496:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046098cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+8:2410:x1874622863644160:12345-192.168.203.31@tcp:400: 00000100:00080000:3.0:1787779853.722518:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787779853.722532:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046efced00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+6:2411:x1874622863644288:12345-192.168.203.31@tcp:400: Request processed in 69us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779853.722536:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863644544 00000100:00100000:1.0:1787779853.722538:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046098cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+8:2410:x1874622863644160:12345-192.168.203.31@tcp:400: Request processed in 41us (162us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779853.722542:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863644544 00000100:00100000:0.0:1787779853.722543:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 71 00000100:00100000:3.0:1787779853.722592:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 28 00000100:00100000:3.0:1787779853.722612:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046efce1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:2411:x1874622863644544:12345-192.168.203.31@tcp:400: 00000100:00100000:3.0:1787779853.722676:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046efce1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:2411:x1874622863644544:12345-192.168.203.31@tcp:400: Request processed in 66us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779853.722685:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 28 00000100:00080000:3.0:1787779853.722708:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787779853.723516:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 243 00000100:00100000:2.0:1787779853.725336:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787779853.725373:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787779853.725439:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863644672 00000100:00100000:0.0:1787779853.725443:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863644416 00000100:00100000:3.0:1787779853.725447:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863644672 00000100:00100000:0.0:1787779853.725449:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863644416 00000100:00100000:3.0:1787779853.725519:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 29 00000100:00100000:3.0:1787779853.725531:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046efcd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:2410:x1874622863644672:12345-192.168.203.31@tcp:400: 00000100:00100000:0.0:1787779853.725552:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 72 00000100:00100000:0.0:1787779853.725562:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046efcc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:2410:x1874622863644416:12345-192.168.203.31@tcp:400: 00000100:00100000:3.0:1787779853.725604:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046efcd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:2410:x1874622863644672:12345-192.168.203.31@tcp:400: Request processed in 65us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779853.725613:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 29 00000100:00100000:0.0:1787779853.725646:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046efcc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:2410:x1874622863644416:12345-192.168.203.31@tcp:400: Request processed in 87us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779853.725674:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 72 00000100:00080000:1.0:1787779853.726086:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787779853.726092:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787779854.231456:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787779854.231539:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863644800 00000100:00100000:3.0:1787779854.231548:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863644800 00000100:00100000:3.0:1787779854.231617:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 244 00000100:00100000:3.0:1787779854.231627:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046098dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+8:6179:x1874622863644800:12345-192.168.203.31@tcp:101: 00010000:00010000:3.0:1787779854.231643:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787779854.231659:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c04766dda00/0xc8fc0a5179960703 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xf757128131ea1ccd expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779854.231698:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c04766dda00/0xc8fc0a5179960703 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1ccd expref: 9 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779854.231731:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c04766dda00/0xc8fc0a5179960703 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1ccd expref: 9 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779854.231742:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c04766dda00, rc 0) 00000100:00100000:3.0:1787779854.231803:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046098dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+9:6179:x1874622863644800:12345-192.168.203.31@tcp:101: Request processed in 177us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779854.231810:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 244 00000100:00100000:3.0:1787779854.234355:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787779854.237309:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863644928 00000100:00100000:1.0:1787779854.237323:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863644928 00000100:00100000:1.0:1787779854.237424:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 245 00000100:00100000:1.0:1787779854.237433:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046082b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+9:6179:x1874622863644928:12345-192.168.203.31@tcp:501: 00000100:00100000:1.0:1787779854.237601:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046082b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+9:6179:x1874622863644928:12345-192.168.203.31@tcp:501: Request processed in 169us (3253us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779854.237609:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 245 00000100:00100000:1.0:1787779854.245873:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787779854.249768:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863645056 00000100:00100000:0.0:1787779854.249782:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863645056 00000100:00100000:0.0:1787779854.249939:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 246 00000100:00100000:0.0:1787779854.249959:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0460828850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+9:6179:x1874622863645056:12345-192.168.203.31@tcp:503: 00000100:00100000:0.0:1787779854.250957:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0460828850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+9:6179:x1874622863645056:12345-192.168.203.31@tcp:503: Request processed in 1004us (5115us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779854.250967:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 246 00000100:00100000:0.0:1787779854.257976:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787779854.258065:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863645184 00000100:00100000:2.0:1787779854.258075:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863645184 00000100:00100000:2.0:1787779854.258148:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 247 00000100:00100000:2.0:1787779854.258159:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0448bf3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+9:6689:x1874622863645184:12345-192.168.203.31@tcp:502: 00000100:00100000:2.0:1787779854.258322:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0448bf3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+9:6689:x1874622863645184:12345-192.168.203.31@tcp:502: Request processed in 164us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779854.258329:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 247 00000100:00100000:3.0:1787779854.287278:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787779854.287361:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863645312 00000100:00100000:0.0:1787779854.287371:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863645312 00000100:00100000:0.0:1787779854.287426:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 248 00000100:00100000:0.0:1787779854.287436:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c045ab81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+9:6689:x1874622863645312:12345-192.168.203.31@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787779854.287575:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c045ab81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+9:6689:x1874622863645312:12345-192.168.203.31@tcp:502:llog_process_th.0 Request processed in 140us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779854.287584:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 248 00000100:00100000:3.0:1787779854.293901:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787779854.294293:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863645440 00000100:00100000:1.0:1787779854.294303:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863645440 00000100:00100000:1.0:1787779854.294355:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 249 00000100:00100000:1.0:1787779854.294364:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c045ab83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+9:6179:x1874622863645440:12345-192.168.203.31@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787779854.294380:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787779854.294398:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0346dd7e00/0xc8fc0a517996070a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xf757128131ea1cd4 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779854.294426:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0346dd7e00/0xc8fc0a517996070a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1cd4 expref: 10 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779854.294437:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0346dd7e00/0xc8fc0a517996070a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1cd4 expref: 10 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779854.294453:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0346dd7e00, rc 0) 00000100:00100000:1.0:1787779854.294517:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c045ab83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+10:6179:x1874622863645440:12345-192.168.203.31@tcp:101:ll_cfg_requeue.0 Request processed in 154us (638us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779854.294524:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 249 00000100:00100000:1.0:1787779854.298426:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787779854.299412:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863645568 00000100:00100000:2.0:1787779854.299424:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863645568 00000100:00100000:2.0:1787779854.299526:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 250 00000100:00100000:2.0:1787779854.299536:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0478612050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+10:6179:x1874622863645568:12345-192.168.203.31@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787779854.299659:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0478612050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+10:6179:x1874622863645568:12345-192.168.203.31@tcp:501:ll_cfg_requeue.0 Request processed in 124us (1242us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787779854.299667:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 250 00010000:00010000:1.0:1787779854.432403:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787779855.132690:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047796cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881531648:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787779855.132779:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779855.134828:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881531648 00000100:00100000:3.0:1787779855.134868:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881531648 00000100:00100000:3.0:1787779855.134957:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787779855.134967:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04812a8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881531648:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787779855.134999:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787779855.135074:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04812a8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881531648:12345-0@lo:41:osp-pre-0-1.0 Request processed in 109us (2295us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779855.135080:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787779855.140852:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047796cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881531648:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787779855.452198:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787779855.648165:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787779855.648188:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04812aa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881531776:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787779855.648257:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779855.648318:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881531776 00000100:00100000:0.0:1787779855.648325:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881531776 00000100:00100000:0.0:1787779855.648366:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787779855.648374:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04812ab840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881531776:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787779855.648418:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787779855.648460:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04812ab840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881531776:12345-0@lo:41:osp-pre-1-0.0 Request processed in 86us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779855.648467:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787779855.648515:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04812aa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881531776:0@lo:41:osp-pre-1-0.0 00000020:00000080:0.0:1787779855.863681:0:10388:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc8a358210 20000000:00000080:0.0:1787779855.863697:0:10388:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9c0347cfe400 uarg=0000000000000000 20000000:01000000:0.0:1787779855.864589:0:10388:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1787779855.864596:0:10388:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1787779855.864601:0:10388:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1787779855.865218:0:10389:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:2.0:1787779855.865366:0:10388:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:2.0:1787779855.869920:0:10388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:2.0:1787779855.869978:0:10388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:2.0:1787779855.869996:0:10388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:2.0:1787779855.870014:0:10388:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787779855.870045:0:10388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c0477a70e00/0xc8fc0a5179960711 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779855.870158:0:10388:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c044148bc00/0xc8fc0a51799603ad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a51799603a6 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779855.870168:0:10388:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c04766ddc00/0xc8fc0a51799603bb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a51799603b4 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779855.870175:0:10388:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c044148ae00/0xc8fc0a517996040f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a5179960408 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779855.870182:0:10388:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c0440031e00/0xc8fc0a5179960535 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a517996052e expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779855.870192:0:10388:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c0477a70200/0xc8fc0a517996064d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1c95 expref: 9 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779855.870200:0:10388:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c0477a70e00/0xc8fc0a5179960711 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779855.870241:0:10388:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c0477a70200/0xc8fc0a517996064d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1c95 expref: 9 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779855.870257:0:10388:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c0477a70200/0xc8fc0a517996064d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1c95 expref: 9 pid: 6507 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779855.870271:0:10388:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c046efce580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10388:1874622881531904:192.168.203.31@tcp:104: 00010000:00010000:2.0:1787779855.870380:0:10388:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c0440031e00/0xc8fc0a5179960535 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc8fc0a517996052e expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779855.870399:0:10388:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c0440031e00/0xc8fc0a5179960535 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc8fc0a517996052e expref: 23 pid: 6506 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779855.870410:0:10388:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047785f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10388:1874622881532032:0@lo:104: 00000100:00100000:2.0:1787779855.870450:0:10388:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787779855.870490:0:10388:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c044148ae00/0xc8fc0a517996040f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc8fc0a5179960408 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779855.870499:0:10388:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c044148ae00/0xc8fc0a517996040f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc8fc0a5179960408 expref: 23 pid: 6506 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779855.870508:0:10388:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047785da40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10388:1874622881532160:0@lo:104: 00000100:00100000:2.0:1787779855.870531:0:10388:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787779855.870552:0:10388:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c04766ddc00/0xc8fc0a51799603bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc8fc0a51799603b4 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779855.870560:0:10388:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c04766ddc00/0xc8fc0a51799603bb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc8fc0a51799603b4 expref: 23 pid: 6506 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779855.870568:0:10388:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047785de00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10388:1874622881532288:0@lo:104: 00000100:00100000:0.0:1787779855.870588:0:6496:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:2.0:1787779855.870597:0:10388:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c044148bc00/0xc8fc0a51799603ad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc8fc0a51799603a6 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779855.870606:0:10388:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c044148bc00/0xc8fc0a51799603ad lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc8fc0a51799603a6 expref: 23 pid: 6507 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779855.870614:0:10388:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347a84000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10388:1874622881532416:0@lo:104: 00000100:00100000:0.0:1787779855.870622:0:6496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779855.870643:0:10388:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779855.870650:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881532032 00000100:00100000:0.0:1787779855.870658:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881532032 00000100:00100000:2.0:1787779855.870667:0:10388:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0347ce3300 going to sleep for 11 seconds 00000100:00100000:0.0:1787779855.870699:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881532160 00000100:00100000:0.0:1787779855.870703:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881532160 00000100:00100000:0.0:1787779855.870729:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881532288 00000100:00100000:0.0:1787779855.870732:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881532288 00000100:00100000:0.0:1787779855.870749:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881532416 00000100:00100000:0.0:1787779855.870755:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881532416 00000100:00100000:0.0:1787779855.870773:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787779855.870781:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c047785fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1f575176-36bc-4786-83ee-2fea064a12a9+6:10388:x1874622881532032:12345-0@lo:104: 00010000:00010000:0.0:1787779855.870794:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff9c04766dc200/0xc8fc0a517996052e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc8fc0a5179960535 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779855.871171:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787779855.871177:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c047785fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1f575176-36bc-4786-83ee-2fea064a12a9+6:10388:x1874622881532032:12345-0@lo:104: Request processed in 397us (727us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779855.871184:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787779855.871203:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787779855.871209:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477892050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1f575176-36bc-4786-83ee-2fea064a12a9+5:10388:x1874622881532160:12345-0@lo:104: 00010000:00010000:0.0:1787779855.871217:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff9c04413c8800/0xc8fc0a5179960408 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc8fc0a517996040f expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779855.871363:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787779855.871368:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477892050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1f575176-36bc-4786-83ee-2fea064a12a9+5:10388:x1874622881532160:12345-0@lo:104: Request processed in 161us (837us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779855.871374:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787779855.871405:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787779855.871412:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04812aa940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1f575176-36bc-4786-83ee-2fea064a12a9+4:10388:x1874622881532288:12345-0@lo:104: 00010000:00010000:0.0:1787779855.871419:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff9c04766dc000/0xc8fc0a51799603b4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc8fc0a51799603bb expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779855.871447:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1787779855.871452:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04812aa940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1f575176-36bc-4786-83ee-2fea064a12a9+4:10388:x1874622881532288:12345-0@lo:104: Request processed in 42us (836us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779855.871457:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787779855.871469:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787779855.871474:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347a86d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1f575176-36bc-4786-83ee-2fea064a12a9+3:10388:x1874622881532416:12345-0@lo:104: 00010000:00010000:0.0:1787779855.871480:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff9c04766dd600/0xc8fc0a51799603a6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc8fc0a51799603ad expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779855.871504:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1787779855.871509:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347a86d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1f575176-36bc-4786-83ee-2fea064a12a9+3:10388:x1874622881532416:12345-0@lo:104: Request processed in 36us (868us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779855.871514:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00010000:3.0:1787779855.872039:0:7453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1787779855.872047:0:7453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff9c04766dc200/0xc8fc0a517996052e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc8fc0a5179960535 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779855.872056:0:7453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c04766dc200 already unused, calling callback (ffffffffc139ac20) 10000000:00010000:3.0:1787779855.872192:0:7453:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff9c04766dc200/0xc8fc0a517996052e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xc8fc0a5179960535 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779855.872202:0:7453:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff9c04766dc200/0xc8fc0a517996052e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xc8fc0a5179960535 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787779855.872210:0:7453:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff9c04766dc200/0xc8fc0a517996052e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xc8fc0a5179960535 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787779855.872216:0:7453:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787779855.872258:0:7453:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff9c04766dc200/0xc8fc0a517996052e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a5179960535 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779855.872265:0:7453:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787779855.872288:0:7453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff9c04766dc200/0xc8fc0a517996052e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a5179960535 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779855.872307:0:7453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff9c04766dc200/0xc8fc0a517996052e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a5179960535 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779855.872321:0:7453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787779855.872325:0:7453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff9c04413c8800/0xc8fc0a5179960408 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc8fc0a517996040f expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779855.872331:0:7453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c04413c8800 already unused, calling callback (ffffffffc139ac20) 10000000:00010000:3.0:1787779855.872335:0:7453:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff9c04413c8800/0xc8fc0a5179960408 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc8fc0a517996040f expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779855.872342:0:7453:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff9c04413c8800/0xc8fc0a5179960408 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc8fc0a517996040f expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787779855.872349:0:7453:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff9c04413c8800/0xc8fc0a5179960408 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc8fc0a517996040f expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787779855.872354:0:7453:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787779855.872368:0:7453:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff9c04413c8800/0xc8fc0a5179960408 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a517996040f expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779855.872375:0:7453:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787779855.872381:0:7453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff9c04413c8800/0xc8fc0a5179960408 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a517996040f expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779855.872388:0:7453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff9c04413c8800/0xc8fc0a5179960408 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a517996040f expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779855.872398:0:7453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787779855.872407:0:7453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff9c04766dc000/0xc8fc0a51799603b4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc8fc0a51799603bb expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779855.872414:0:7453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c04766dc000 already unused, calling callback (ffffffffc139ac20) 10000000:00010000:3.0:1787779855.872417:0:7453:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff9c04766dc000/0xc8fc0a51799603b4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc8fc0a51799603bb expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779855.872424:0:7453:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff9c04766dc000/0xc8fc0a51799603b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc8fc0a51799603bb expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787779855.872431:0:7453:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff9c04766dc000/0xc8fc0a51799603b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc8fc0a51799603bb expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787779855.872436:0:7453:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787779855.872449:0:7453:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff9c04766dc000/0xc8fc0a51799603b4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a51799603bb expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779855.872455:0:7453:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787779855.872470:0:7453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff9c04766dc000/0xc8fc0a51799603b4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a51799603bb expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779855.872477:0:7453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff9c04766dc000/0xc8fc0a51799603b4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a51799603bb expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779855.872486:0:7453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787779855.872490:0:7453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff9c04766dd600/0xc8fc0a51799603a6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc8fc0a51799603ad expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779855.872495:0:7453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c04766dd600 already unused, calling callback (ffffffffc139ac20) 10000000:00010000:3.0:1787779855.872498:0:7453:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff9c04766dd600/0xc8fc0a51799603a6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc8fc0a51799603ad expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779855.872514:0:7453:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff9c04766dd600/0xc8fc0a51799603a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc8fc0a51799603ad expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787779855.872519:0:7453:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff9c04766dd600/0xc8fc0a51799603a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc8fc0a51799603ad expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787779855.872525:0:7453:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787779855.872537:0:7453:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff9c04766dd600/0xc8fc0a51799603a6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a51799603ad expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779855.872543:0:7453:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787779855.872549:0:7453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff9c04766dd600/0xc8fc0a51799603a6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a51799603ad expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779855.872555:0:7453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff9c04766dd600/0xc8fc0a51799603a6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a51799603ad expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779855.872567:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787779855.872568:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787779855.872570:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787779855.872585:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04764943c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1f575176-36bc-4786-83ee-2fea064a12a9:3641:1874622881532544:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787779855.872627:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779855.872665:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881532544 00000100:00100000:0.0:1787779855.872671:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881532544 00000100:00100000:3.0:1787779855.872674:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787779855.872682:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0476497c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1f575176-36bc-4786-83ee-2fea064a12a9:3641:1874622881532672:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787779855.872705:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787779855.872707:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c0440031e00/0xc8fc0a5179960535 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc8fc0a517996052e expref: 24 pid: 6506 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779855.872748:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04764970c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1f575176-36bc-4786-83ee-2fea064a12a9:3643:1874622881532800:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787779855.872764:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881532672 00000100:00100000:0.0:1787779855.872769:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881532672 00000100:00100000:3.0:1787779855.872774:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787779855.872790:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c044148ae00/0xc8fc0a517996040f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc8fc0a5179960408 expref: 25 pid: 6506 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779855.872795:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787779855.872802:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881532800 00000100:00100000:0.0:1787779855.872806:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881532800 00000100:00100000:3.0:1787779855.872811:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0476497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1f575176-36bc-4786-83ee-2fea064a12a9:3643:1874622881532928:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787779855.872819:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c04766ddc00/0xc8fc0a51799603bb lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc8fc0a51799603b4 expref: 26 pid: 6506 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779855.872834:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787779855.872871:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779855.872900:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881532928 00000100:00100000:3.0:1787779855.872904:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881532928 00010000:00010000:3.0:1787779855.872920:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c044148bc00/0xc8fc0a51799603ad lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc8fc0a51799603a6 expref: 27 pid: 6507 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779855.872935:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787779855.872941:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0476495a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1f575176-36bc-4786-83ee-2fea064a12a9+27:3641:x1874622881532672:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787779855.872971:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0476495680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1f575176-36bc-4786-83ee-2fea064a12a9+27:3641:x1874622881532544:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787779855.872984:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787779855.872989:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c0440031e00/0xc8fc0a5179960535 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc8fc0a517996052e expref: 27 pid: 6506 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779855.872999:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c0440031e00/0xc8fc0a5179960535 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc8fc0a517996052e expref: 27 pid: 6506 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779855.873014:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787779855.873046:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0476495680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1f575176-36bc-4786-83ee-2fea064a12a9+27:3641:x1874622881532544:12345-0@lo:103:ldlm_bl.0 Request processed in 180us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779855.873053:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787779855.873068:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787779855.873074:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0476494780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1f575176-36bc-4786-83ee-2fea064a12a9+26:3643:x1874622881532800:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787779855.873081:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787779855.873085:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c04766ddc00/0xc8fc0a51799603bb lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc8fc0a51799603b4 expref: 26 pid: 6506 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779855.873117:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c04766ddc00/0xc8fc0a51799603bb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc8fc0a51799603b4 expref: 26 pid: 6506 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779855.873128:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787779855.873154:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0476494780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1f575176-36bc-4786-83ee-2fea064a12a9+26:3643:x1874622881532800:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779855.873174:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787779855.873188:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787779855.873194:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046099c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1f575176-36bc-4786-83ee-2fea064a12a9+25:3643:x1874622881532928:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787779855.873201:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787779855.873206:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c044148bc00/0xc8fc0a51799603ad lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc8fc0a51799603a6 expref: 25 pid: 6507 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779855.873213:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c044148bc00/0xc8fc0a51799603ad lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc8fc0a51799603a6 expref: 25 pid: 6507 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779855.873233:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787779855.873254:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046099c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1f575176-36bc-4786-83ee-2fea064a12a9+25:3643:x1874622881532928:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779855.873260:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787779855.874009:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04764943c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1f575176-36bc-4786-83ee-2fea064a12a9:3641:1874622881532544:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787779855.874743:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787779855.874752:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c044148ae00/0xc8fc0a517996040f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc8fc0a5179960408 expref: 24 pid: 6506 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779855.874763:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c044148ae00/0xc8fc0a517996040f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc8fc0a5179960408 expref: 24 pid: 6506 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779855.874776:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787779855.874826:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0476495a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1f575176-36bc-4786-83ee-2fea064a12a9+24:3641:x1874622881532672:12345-0@lo:103:ldlm_bl.0 Request processed in 1884us (2121us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779855.874835:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787779855.874912:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0476497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1f575176-36bc-4786-83ee-2fea064a12a9:3643:1874622881532928:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787779855.874921:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04764970c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1f575176-36bc-4786-83ee-2fea064a12a9:3643:1874622881532800:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787779855.874967:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0476497c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1f575176-36bc-4786-83ee-2fea064a12a9:3641:1874622881532672:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787779855.875372:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787779855.875378:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787779855.875655:0:10388:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c046efce580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10388:1874622881531904:192.168.203.31@tcp:104: 00010000:00010000:2.0:1787779855.875667:0:10388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c0440031e00/0xc8fc0a5179960535 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc8fc0a517996052e expref: 23 pid: 6506 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779855.875679:0:10388:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047785f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10388:1874622881532032:0@lo:104: 00010000:00010000:2.0:1787779855.875688:0:10388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c044148ae00/0xc8fc0a517996040f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc8fc0a5179960408 expref: 22 pid: 6506 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779855.875695:0:10388:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047785da40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10388:1874622881532160:0@lo:104: 00010000:00010000:2.0:1787779855.875703:0:10388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c04766ddc00/0xc8fc0a51799603bb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc8fc0a51799603b4 expref: 21 pid: 6506 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779855.875722:0:10388:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047785de00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10388:1874622881532288:0@lo:104: 00010000:00010000:2.0:1787779855.875732:0:10388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c044148bc00/0xc8fc0a51799603ad lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc8fc0a51799603a6 expref: 20 pid: 6507 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779855.875740:0:10388:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347a84000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10388:1874622881532416:0@lo:104: 00010000:00010000:2.0:1787779855.875762:0:10388:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c0477a70e00/0xc8fc0a5179960711 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779855.877704:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787779855.878456:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863645696 00000100:00100000:0.0:1787779855.878466:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863645696 00010000:00010000:0.0:1787779855.878503:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c0477a70200/0xc8fc0a517996064d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1c95 expref: 10 pid: 6507 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779855.878582:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 39 00000100:00100000:0.0:1787779855.878606:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0476497c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+10:2411:x1874622863645696:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787779855.878620:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787779855.878625:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c0477a70200/0xc8fc0a517996064d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1c95 expref: 10 pid: 6507 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779855.878637:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c0477a70200/0xc8fc0a517996064d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1c95 expref: 10 pid: 6507 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779855.878654:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c0477a70200/0xc8fc0a517996064d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1c95 expref: 10 pid: 6507 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779855.878670:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c0477a70e00/0xc8fc0a5179960711 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779855.878679:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0477a70e00/0xc8fc0a5179960711 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779855.878694:0:6498:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c0477a70e00/0xc8fc0a5179960711 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779855.878701:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c0477a70e00/0xc8fc0a5179960711 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779855.878717:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c0477a70e00/0xc8fc0a5179960711 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779855.878725:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c0477a70e00/0xc8fc0a5179960711 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779855.878731:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0477a70e00 already unused, calling callback (ffffffffc0d97420) 00010000:00010000:0.0:1787779855.878736:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c0477a70e00/0xc8fc0a5179960711 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779855.878750:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c0477a70e00/0xc8fc0a5179960711 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779855.878773:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c0477a70e00/0xc8fc0a5179960711 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779855.878785:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787779855.878830:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0476497c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+9:2411:x1874622863645696:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 227us (1133us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779855.878915:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 39 00010000:00010000:3.0:1787779855.879575:0:10388:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c0477a70e00/0xc8fc0a5179960711 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779855.879586:0:10388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c0477a70e00/0xc8fc0a5179960711 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779855.879599:0:10388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c0477a70e00/0xc8fc0a5179960711 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779856.204254:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787779856.204340:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863645824 00000100:00100000:0.0:1787779856.204350:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863645824 00000100:00100000:0.0:1787779856.204408:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 251 00000100:00100000:0.0:1787779856.204418:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0478610450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+9:6179:x1874622863645824:12345-192.168.203.31@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787779856.204433:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787779856.204452:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0477869600/0xc8fc0a5179960718 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf757128131ea1cdb expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779856.204478:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0477869600/0xc8fc0a5179960718 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1cdb expref: 10 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779856.204489:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0477869600/0xc8fc0a5179960718 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1cdb expref: 10 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779856.204497:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0477869600, rc 0) 00000100:00100000:0.0:1787779856.204551:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0478610450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+10:6179:x1874622863645824:12345-192.168.203.31@tcp:101:ll_cfg_requeue.0 Request processed in 134us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779856.204916:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 251 00000100:00100000:1.0:1787779856.230773:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787779856.230879:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863645952 00000100:00100000:2.0:1787779856.230889:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863645952 00000100:00100000:2.0:1787779856.230979:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 252 00000100:00100000:2.0:1787779856.230989:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0478611450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+10:6179:x1874622863645952:12345-192.168.203.31@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787779856.231187:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0478611450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+10:6179:x1874622863645952:12345-192.168.203.31@tcp:501:ll_cfg_requeue.0 Request processed in 199us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779856.231211:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 252 00000100:00100000:3.0:1787779856.244131:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787779856.244244:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863646080 00000100:00100000:1.0:1787779856.244253:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863646080 00000100:00100000:1.0:1787779856.244308:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 253 00000100:00100000:1.0:1787779856.244319:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0478610c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+10:6179:x1874622863646080:12345-192.168.203.31@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787779856.244460:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0478610c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+10:6179:x1874622863646080:12345-192.168.203.31@tcp:503:ll_cfg_requeue.0 Request processed in 142us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779856.244468:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 253 00000100:00100000:1.0:1787779856.265032:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787779856.265127:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863646208 00000100:00100000:2.0:1787779856.265136:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863646208 00000100:00100000:2.0:1787779856.265190:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 254 00000100:00100000:2.0:1787779856.265200:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0478611c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+10:6730:x1874622863646208:12345-192.168.203.31@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787779856.265387:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0478611c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+10:6730:x1874622863646208:12345-192.168.203.31@tcp:502:llog_process_th.0 Request processed in 187us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779856.265396:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 254 00000100:00100000:3.0:1787779856.274474:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787779856.274953:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863646336 00000100:00100000:0.0:1787779856.274963:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863646336 00000100:00100000:0.0:1787779856.275026:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 255 00000100:00100000:0.0:1787779856.275036:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0478610050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+10:6730:x1874622863646336:12345-192.168.203.31@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787779856.275191:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0478610050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+10:6730:x1874622863646336:12345-192.168.203.31@tcp:502:llog_process_th.0 Request processed in 156us (725us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779856.275199:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 255 00010000:00010000:3.0:1787779856.476186:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787779857.115934:0:6509:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787779857.115942:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c0346bcb000 from 4 10000000:01000000:0.0:1787779857.115947:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787779857.115988:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c0477869c00/0xc8fc0a517996071f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779857.116001:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff9c0477869c00/0xc8fc0a517996071f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779857.116012:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff9c0477869c00/0xc8fc0a517996071f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779857.116036:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04812a9680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881533056:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787779857.116109:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779857.116159:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0477b8de40 going to sleep for 11 seconds 00000100:00100000:2.0:1787779857.116267:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881533056 00000100:00100000:2.0:1787779857.116273:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881533056 00000100:00100000:2.0:1787779857.116325:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1787779857.116333:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0442d5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+20:6509:x1874622881533056:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787779857.116345:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787779857.116367:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0477a70600/0xc8fc0a5179960726 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc8fc0a517996071f expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779857.116389:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0477a70600/0xc8fc0a5179960726 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc8fc0a517996071f expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779857.116400:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0477a70600/0xc8fc0a5179960726 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a517996071f expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779857.116409:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0477a70600, rc 0) 00000100:00100000:2.0:1787779857.116453:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0442d5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+21:6509:x1874622881533056:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779857.116460:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1787779857.116573:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04812a9680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881533056:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787779857.116586:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff9c0477869c00/0xc8fc0a517996071f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a5179960726 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779857.116596:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff9c0477869c00/0xc8fc0a517996071f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc8fc0a5179960726 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779857.116646:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0476496580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881533184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787779857.116742:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779857.116820:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0476660240 going to sleep for 11 seconds 00000100:00100000:2.0:1787779857.116885:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881533184 00000100:00100000:2.0:1787779857.116889:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881533184 00000100:00100000:2.0:1787779857.116909:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1787779857.116915:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0442d58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+21:6509:x1874622881533184:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787779857.117003:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0442d58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+21:6509:x1874622881533184:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 87us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779857.117010:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1787779857.117076:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0476496580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881533184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787779857.117163:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0476496580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881533312:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787779857.117200:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779857.117255:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0476660240 going to sleep for 11 seconds 00000100:00100000:2.0:1787779857.122994:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881533312 00000100:00100000:2.0:1787779857.123008:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881533312 00000100:00100000:2.0:1787779857.123116:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1787779857.123126:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0442d59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+21:6509:x1874622881533312:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787779857.123285:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0442d59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+21:6509:x1874622881533312:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 160us (6083us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779857.123293:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1787779857.123373:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0476496580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881533312:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787779857.123610:0:10429:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347a84000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f575176-36bc-4786-83ee-2fea064a12a9:10429:1874622881533440:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787779857.123653:0:10429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779857.123687:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881533440 00000100:00100000:2.0:1787779857.123691:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881533440 00000100:00100000:2.0:1787779857.123720:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1787779857.123727:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0442d58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+21:10429:x1874622881533440:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787779857.124481:0:10429:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0347ce3900 going to sleep for 11 seconds 00000100:00100000:2.0:1787779857.127205:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0442d58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+21:10429:x1874622881533440:12345-0@lo:502:llog_process_th.0 Request processed in 3470us (3544us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779857.127219:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1787779857.127621:0:10429:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347a84000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f575176-36bc-4786-83ee-2fea064a12a9:10429:1874622881533440:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787779857.127654:0:10429:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787779857.127674:0:10429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787779857.127676:0:10429:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787779857.127689:0:10429:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c0346bcb000 00000020:00000080:3.0:1787779857.127692:0:10429:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787779857.127801:0:10429:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0476495680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f575176-36bc-4786-83ee-2fea064a12a9:10429:1874622881533568:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787779857.127868:0:10429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779857.127898:0:10429:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0476660480 going to sleep for 11 seconds 00000100:00100000:0.0:1787779857.128164:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881533568 00000100:00100000:0.0:1787779857.128172:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881533568 00000100:00100000:0.0:1787779857.128209:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1787779857.128218:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0442d59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+21:10429:x1874622881533568:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787779857.128368:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0442d59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+21:10429:x1874622881533568:12345-0@lo:502:llog_process_th.0 Request processed in 151us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779857.128376:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1787779857.129466:0:10429:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0476495680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f575176-36bc-4786-83ee-2fea064a12a9:10429:1874622881533568:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787779857.129496:0:10429:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787779857.129503:0:10429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787779857.129506:0:10429:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1787779857.129511:0:10429:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1787779857.131067:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1787779857.131105:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787779857.131121:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c0477869c00/0xc8fc0a517996071f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a5179960726 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779857.131133:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff9c0477869c00/0xc8fc0a517996071f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a5179960726 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787779857.131143:0:6509:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787779857.131146:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c046ecd6000 from 4 10000000:01000000:2.0:1787779857.131148:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787779857.131181:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c0477a71800/0xc8fc0a517996072d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779857.131189:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff9c0477a71800/0xc8fc0a517996072d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779857.131200:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff9c0477a71800/0xc8fc0a517996072d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779857.131221:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347a84000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881533696:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787779857.131277:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779857.131319:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0347ce3d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787779857.131337:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881533696 00000100:00100000:2.0:1787779857.131342:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881533696 00000100:00100000:2.0:1787779857.131394:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1787779857.131403:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471775850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+21:6509:x1874622881533696:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787779857.131414:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787779857.131425:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0477a70a00/0xc8fc0a5179960734 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc8fc0a517996072d expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779857.131446:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0477a70a00/0xc8fc0a5179960734 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc8fc0a517996072d expref: 22 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779857.131464:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0477a70a00/0xc8fc0a5179960734 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a517996072d expref: 22 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779857.131472:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0477a70a00, rc 0) 00000100:00100000:2.0:1787779857.131504:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471775850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+22:6509:x1874622881533696:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 102us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779857.131510:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1787779857.131550:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347a84000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881533696:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787779857.131562:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff9c0477a71800/0xc8fc0a517996072d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a5179960734 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779857.131570:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff9c0477a71800/0xc8fc0a517996072d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc8fc0a5179960734 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779857.131621:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347a84000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881533824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787779857.131644:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779857.131877:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0347ce3d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787779857.131888:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881533824 00000100:00100000:2.0:1787779857.131891:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881533824 00000100:00100000:2.0:1787779857.131911:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1787779857.131917:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471775050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+22:6509:x1874622881533824:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787779857.132010:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471775050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+22:6509:x1874622881533824:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 93us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779857.132018:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1787779857.132047:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347a84000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881533824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787779857.132081:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347a84000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881533952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787779857.132177:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779857.132191:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0347ce3d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787779857.132201:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881533952 00000100:00100000:2.0:1787779857.132204:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881533952 00000100:00100000:2.0:1787779857.132223:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1787779857.132229:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471777050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+22:6509:x1874622881533952:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787779857.132298:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471777050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+22:6509:x1874622881533952:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 69us (120us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779857.132305:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1787779857.132341:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347a84000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881533952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787779857.132579:0:10434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347a84000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f575176-36bc-4786-83ee-2fea064a12a9:10434:1874622881534080:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787779857.132612:0:10434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779857.132629:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881534080 00000100:00100000:2.0:1787779857.132632:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881534080 00000100:00100000:2.0:1787779857.132652:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1787779857.132658:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471774850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+22:10434:x1874622881534080:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787779857.134060:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471774850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+22:10434:x1874622881534080:12345-0@lo:502:llog_process_th.0 Request processed in 1398us (1444us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779857.134071:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1787779857.134992:0:10434:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0347ce3600 going to sleep for 11 seconds 00000100:00100000:2.0:1787779857.135017:0:10434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347a84000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f575176-36bc-4786-83ee-2fea064a12a9:10434:1874622881534080:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787779857.135045:0:10434:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787779857.135054:0:10434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787779857.135062:0:10434:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787779857.135069:0:10434:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c046ecd6000 00000020:00000080:2.0:1787779857.135072:0:10434:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787779857.138349:0:10434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347a84000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f575176-36bc-4786-83ee-2fea064a12a9:10434:1874622881534208:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787779857.140468:0:10434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779857.140507:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881534208 00000100:00100000:2.0:1787779857.140513:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881534208 00000100:00100000:2.0:1787779857.140558:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1787779857.140567:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471777450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+22:10434:x1874622881534208:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787779857.140691:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471777450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+22:10434:x1874622881534208:12345-0@lo:502:llog_process_th.0 Request processed in 125us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779857.140708:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1787779857.140759:0:10434:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0347ce3600 going to sleep for 11 seconds 00000100:00100000:2.0:1787779857.140780:0:10434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347a84000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f575176-36bc-4786-83ee-2fea064a12a9:10434:1874622881534208:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787779857.140808:0:10434:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787779857.140816:0:10434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787779857.140818:0:10434:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1787779857.140822:0:10434:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1787779857.140896:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1787779857.140914:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787779857.140923:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c0477a71800/0xc8fc0a517996072d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a5179960734 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779857.140933:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff9c0477a71800/0xc8fc0a517996072d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a5179960734 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787779857.140943:0:6509:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787779857.140946:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c04764fa000 from 4 10000000:01000000:2.0:1787779857.140949:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787779857.140979:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c0477a71400/0xc8fc0a517996073b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779857.140987:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff9c0477a71400/0xc8fc0a517996073b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779857.140996:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff9c0477a71400/0xc8fc0a517996073b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779857.141015:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347a84000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881534336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787779857.141039:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779857.141060:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0347ce3600 going to sleep for 11 seconds 00000100:00100000:2.0:1787779857.141073:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881534336 00000100:00100000:2.0:1787779857.141076:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881534336 00000100:00100000:2.0:1787779857.143772:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1787779857.143790:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471776850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+22:6509:x1874622881534336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787779857.143806:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787779857.143823:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0477a71a00/0xc8fc0a5179960742 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc8fc0a517996073b expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779857.143865:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0477a71a00/0xc8fc0a5179960742 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc8fc0a517996073b expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779857.143875:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0477a71a00/0xc8fc0a5179960742 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a517996073b expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779857.143883:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0477a71a00, rc 0) 00000100:00100000:2.0:1787779857.143943:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471776850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+23:6509:x1874622881534336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 160us (2902us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779857.143950:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1787779857.144004:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347a84000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881534336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787779857.144020:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff9c0477a71400/0xc8fc0a517996073b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a5179960742 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779857.144029:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff9c0477a71400/0xc8fc0a517996073b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc8fc0a5179960742 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779857.144414:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347a84000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881534464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787779857.144447:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779857.144474:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0347ce3600 going to sleep for 11 seconds 00000100:00100000:2.0:1787779857.144486:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881534464 00000100:00100000:2.0:1787779857.144491:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881534464 00000100:00100000:2.0:1787779857.144528:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1787779857.144535:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471777c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+23:6509:x1874622881534464:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787779857.144628:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471777c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+23:6509:x1874622881534464:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 93us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779857.144635:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1787779857.145799:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347a84000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881534464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787779857.145857:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347a84000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881534592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787779857.145903:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779857.145932:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0347ce3600 going to sleep for 11 seconds 00000100:00100000:2.0:1787779857.145950:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881534592 00000100:00100000:2.0:1787779857.145954:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881534592 00000100:00100000:2.0:1787779857.145982:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1787779857.145988:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471776c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+23:6509:x1874622881534592:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787779857.146067:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471776c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+23:6509:x1874622881534592:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 78us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779857.146080:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1787779857.146919:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347a84000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881534592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787779857.147142:0:10436:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347a84000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f575176-36bc-4786-83ee-2fea064a12a9:10436:1874622881534720:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787779857.147180:0:10436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779857.147204:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881534720 00000100:00100000:2.0:1787779857.147208:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881534720 00000100:00100000:2.0:1787779857.147234:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1787779857.147241:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471777850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+23:10436:x1874622881534720:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787779857.147315:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471777850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+23:10436:x1874622881534720:12345-0@lo:502:llog_process_th.0 Request processed in 74us (134us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779857.147322:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1787779857.147369:0:10436:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0347ce3600 going to sleep for 11 seconds 00000100:00100000:2.0:1787779857.147382:0:10436:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347a84000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f575176-36bc-4786-83ee-2fea064a12a9:10436:1874622881534720:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787779857.147401:0:10436:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787779857.147409:0:10436:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787779857.147411:0:10436:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787779857.147418:0:10436:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c04764fa000 00000020:00000080:2.0:1787779857.147420:0:10436:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787779857.149006:0:10436:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347a84000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f575176-36bc-4786-83ee-2fea064a12a9:10436:1874622881534848:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787779857.149063:0:10436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779857.149115:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881534848 00000100:00100000:2.0:1787779857.149121:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881534848 00000100:00100000:2.0:1787779857.149154:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1787779857.149161:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471776050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+23:10436:x1874622881534848:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787779857.149242:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471776050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+23:10436:x1874622881534848:12345-0@lo:502:llog_process_th.0 Request processed in 81us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779857.149254:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1787779857.149314:0:10436:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c04717ae300 going to sleep for 11 seconds 00000100:00100000:2.0:1787779857.149332:0:10436:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347a84000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f575176-36bc-4786-83ee-2fea064a12a9:10436:1874622881534848:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787779857.149913:0:10436:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787779857.149924:0:10436:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787779857.149926:0:10436:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1787779857.149932:0:10436:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1787779857.149997:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1787779857.150013:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787779857.150023:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c0477a71400/0xc8fc0a517996073b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a5179960742 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779857.150034:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff9c0477a71400/0xc8fc0a517996073b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a5179960742 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787779857.150044:0:6509:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787779857.150047:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c044407a000 from 4 10000000:01000000:2.0:1787779857.150049:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787779857.150075:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c0477a71e00/0xc8fc0a5179960749 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779857.150083:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff9c0477a71e00/0xc8fc0a5179960749 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779857.150103:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff9c0477a71e00/0xc8fc0a5179960749 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779857.150119:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347a84000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881534976:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787779857.150151:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779857.150182:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c04717ae300 going to sleep for 11 seconds 00000100:00100000:2.0:1787779857.150197:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881534976 00000100:00100000:2.0:1787779857.150201:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881534976 00000100:00100000:2.0:1787779857.150227:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1787779857.150234:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471774450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+23:6509:x1874622881534976:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787779857.150243:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787779857.150255:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0477a71600/0xc8fc0a5179960750 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc8fc0a5179960749 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779857.150275:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0477a71600/0xc8fc0a5179960750 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc8fc0a5179960749 expref: 24 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779857.150285:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0477a71600/0xc8fc0a5179960750 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a5179960749 expref: 24 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779857.150293:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0477a71600, rc 0) 00000100:00100000:2.0:1787779857.150323:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471774450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+24:6509:x1874622881534976:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 89us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779857.150329:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1787779857.150549:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347a84000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881534976:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787779857.150560:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff9c0477a71e00/0xc8fc0a5179960749 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a5179960750 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779857.150568:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff9c0477a71e00/0xc8fc0a5179960749 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc8fc0a5179960750 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779857.150616:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347a84000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881535104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787779857.150638:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779857.150671:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c04717ae300 going to sleep for 11 seconds 00000100:00100000:2.0:1787779857.150685:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881535104 00000100:00100000:2.0:1787779857.150688:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881535104 00000100:00100000:2.0:1787779857.150718:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1787779857.150725:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471775450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+24:6509:x1874622881535104:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787779857.150826:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471775450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+24:6509:x1874622881535104:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 101us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779857.150832:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1787779857.150887:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347a84000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881535104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787779857.150912:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347a84000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881535232:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787779857.150948:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779857.150965:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c04717ae300 going to sleep for 11 seconds 00000100:00100000:2.0:1787779857.150976:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881535232 00000100:00100000:2.0:1787779857.150978:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881535232 00000100:00100000:2.0:1787779857.150999:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1787779857.151004:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471774c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+24:6509:x1874622881535232:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787779857.151068:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471774c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+24:6509:x1874622881535232:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 63us (119us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779857.151074:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1787779857.151220:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347a84000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881535232:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787779857.153640:0:10437:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347a84000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f575176-36bc-4786-83ee-2fea064a12a9:10437:1874622881535360:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787779857.153721:0:10437:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779857.153761:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881535360 00000100:00100000:2.0:1787779857.153765:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881535360 00000100:00100000:2.0:1787779857.153799:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1787779857.153806:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471775c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+24:10437:x1874622881535360:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787779857.153911:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471775c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+24:10437:x1874622881535360:12345-0@lo:502:llog_process_th.0 Request processed in 104us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779857.153918:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1787779857.153963:0:10437:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c04717ae300 going to sleep for 11 seconds 00000100:00100000:2.0:1787779857.153979:0:10437:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347a84000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f575176-36bc-4786-83ee-2fea064a12a9:10437:1874622881535360:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787779857.154000:0:10437:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787779857.154007:0:10437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787779857.154010:0:10437:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787779857.154017:0:10437:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c044407a000 00000020:00000080:2.0:1787779857.154019:0:10437:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787779857.154381:0:10437:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347a84000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f575176-36bc-4786-83ee-2fea064a12a9:10437:1874622881535488:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787779857.154413:0:10437:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779857.154432:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881535488 00000100:00100000:2.0:1787779857.154435:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881535488 00000100:00100000:2.0:1787779857.154457:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1787779857.154462:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471774050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+24:10437:x1874622881535488:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787779857.154514:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471774050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+24:10437:x1874622881535488:12345-0@lo:502:llog_process_th.0 Request processed in 51us (100us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779857.154520:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1787779857.154547:0:10437:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0347ce3600 going to sleep for 11 seconds 00000100:00100000:2.0:1787779857.154557:0:10437:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347a84000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f575176-36bc-4786-83ee-2fea064a12a9:10437:1874622881535488:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787779857.154573:0:10437:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787779857.154576:0:10437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787779857.154578:0:10437:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1787779857.154581:0:10437:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1787779857.154626:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1787779857.154649:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787779857.154657:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c0477a71e00/0xc8fc0a5179960749 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a5179960750 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779857.154667:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff9c0477a71e00/0xc8fc0a5179960749 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a5179960750 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779857.500825:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787779857.693989:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04812a8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874622881535872:0@lo:400:kworker.0 00000100:00100000:0.0:1787779857.694066:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779857.694116:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04779421c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881536384:0@lo:400:kworker.0 00000100:00100000:2.0:1787779857.694133:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04812a8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874622881535616:0@lo:400:kworker.0 00000100:00100000:0.0:1787779857.694143:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779857.694158:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779857.694166:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047785f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881536896:0@lo:400:kworker.0 00000100:00100000:2.0:1787779857.694174:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04812ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1874622881536128:0@lo:400:kworker.0 00000100:00100000:0.0:1787779857.694189:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779857.694217:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1787779857.694223:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04812aa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881536000:0@lo:400:kworker.0 00000100:00100000:0.0:1787779857.694244:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779857.694315:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04779403c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881536512:0@lo:400:kworker.0 00000100:00100000:0.0:1787779857.694336:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779857.694574:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047785fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881537024:0@lo:400:kworker.0 00000100:00100000:0.0:1787779857.694599:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779857.694637:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881535872 00000100:00100000:0.0:1787779857.694645:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881535872 00000100:00100000:2.0:1787779857.694670:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779857.694689:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047785de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1874622881536640:0@lo:400:kworker.0 00000100:00100000:2.0:1787779857.694720:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779857.694739:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1787779857.694827:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881535616 00000100:00100000:0.0:1787779857.694831:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881535616 00000100:00100000:0.0:1787779857.694856:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881536128 00000100:00100000:0.0:1787779857.694859:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881536128 00000100:00100000:0.0:1787779857.694879:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881536640 00000100:00100000:0.0:1787779857.694881:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881536640 00000100:00100000:0.0:1787779857.694895:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787779857.694902:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346d4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1874622881535872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787779857.694960:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346d4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1874622881535872:12345-0@lo:400:kworker.0 Request processed in 57us (893us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779857.694967:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787779857.694985:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787779857.694991:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347a84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874622881535616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787779857.695016:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347a84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874622881535616:12345-0@lo:400:kworker.0 Request processed in 26us (857us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779857.695021:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787779857.695031:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787779857.695037:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347a87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874622881536128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787779857.695057:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347a87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874622881536128:12345-0@lo:400:kworker.0 Request processed in 21us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779857.695062:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787779857.695071:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787779857.695076:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347a85a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1874622881536640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787779857.695098:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347a85a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1874622881536640:12345-0@lo:400:kworker.0 Request processed in 21us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779857.695103:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787779857.695120:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881536384 00000100:00100000:0.0:1787779857.695123:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881536384 00000100:00100000:0.0:1787779857.695141:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881536896 00000100:00100000:0.0:1787779857.695143:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881536896 00000100:00100000:0.0:1787779857.695154:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881536512 00000100:00100000:0.0:1787779857.695156:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881536512 00000100:00100000:0.0:1787779857.695165:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881537024 00000100:00100000:0.0:1787779857.695167:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881537024 00000100:00100000:0.0:1787779857.695179:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787779857.695191:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346d4ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881536384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787779857.695218:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346d4ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881536384:12345-0@lo:400:kworker.0 Request processed in 28us (1075us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779857.695223:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787779857.695234:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787779857.695239:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346d4e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881536896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787779857.695262:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346d4e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881536896:12345-0@lo:400:kworker.0 Request processed in 23us (1072us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779857.695267:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787779857.695277:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787779857.695282:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346d4d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881536512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787779857.695304:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787779857.695306:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346d4d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881536512:12345-0@lo:400:kworker.0 Request processed in 25us (969us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779857.695311:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787779857.695312:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346d4cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881537024:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1787779857.695332:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787779857.695335:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787779857.695338:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787779857.695340:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346d4cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881537024:12345-0@lo:400:kworker.0 Request processed in 31us (741us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779857.695346:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787779857.695364:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881536000 00010000:00080000:0.0:1787779857.695372:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c04779403c0 x1874622881536512/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779873 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787779857.695373:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881536000 00000100:00100000:0.0:1787779857.695385:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04779403c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881536512:0@lo:400:kworker.0 00000100:00100000:1.0:1787779857.695396:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787779857.695402:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346d4f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881536000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779857.695502:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04812a9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881535744:0@lo:400:kworker.0 00000100:00100000:3.0:1787779857.695686:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787779857.695704:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0476495680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874622881537152:0@lo:13:osp-pre-1-1.0 00010000:00080000:0.0:1787779857.695807:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c047785fc00 x1874622881537024/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779873 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787779857.695816:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047785fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881537024:0@lo:400:kworker.0 00000100:00100000:1.0:1787779857.698604:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346d4f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881536000:12345-0@lo:400:kworker.0 Request processed in 3195us (4352us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779857.698617:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787779857.708887:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779857.709492:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881535744 00000100:00100000:2.0:1787779857.709502:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881535744 00000100:00100000:2.0:1787779857.711480:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787779857.711495:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347a86580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881535744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779857.711579:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347a86580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881535744:12345-0@lo:400:kworker.0 Request processed in 89us (2698us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779857.711587:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787779857.711652:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04812a9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881535744:0@lo:400:kworker.0 00000100:00100000:2.0:1787779857.711665:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04812a9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1874622881536256:0@lo:400:kworker.0 00000100:00100000:2.0:1787779857.711726:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779857.711763:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047785da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1874622881536768:0@lo:400:kworker.0 00000100:00100000:2.0:1787779857.711786:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779857.711813:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04812a8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874622881535616:0@lo:400:kworker.0 00000100:00100000:2.0:1787779857.711825:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04812ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1874622881536128:0@lo:400:kworker.0 00000100:00100000:2.0:1787779857.711851:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047785de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1874622881536640:0@lo:400:kworker.0 00000100:00100000:0.0:1787779857.714828:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04812a8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874622881535872:0@lo:400:kworker.0 00000100:00100000:0.0:1787779857.714873:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881536256 00000100:00100000:0.0:1787779857.714879:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881536256 00000100:00100000:0.0:1787779857.714929:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881536768 00000100:00100000:0.0:1787779857.714933:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881536768 00000100:00100000:0.0:1787779857.714956:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787779857.714963:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346dac3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1874622881536256:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787779857.715060:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787779857.722323:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787779857.722342:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346dacf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1874622881536768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779857.723721:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779857.723780:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881537152 00000100:00100000:3.0:1787779857.723788:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881537152 00000100:00100000:3.0:1787779857.723833:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787779857.723869:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0476494780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1874622881537152:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787779857.723895:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787779857.723936:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0476494780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1874622881537152:12345-0@lo:13:osp-pre-1-1.0 Request processed in 95us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779857.723942:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:3.0:1787779857.724012:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0476495680 x1874622881537152/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779873 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779857.724034:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0476495680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874622881537152:0@lo:13:osp-pre-1-1.0 00010000:00080000:3.0:1787779857.724117:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c04779421c0 x1874622881536384/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779873 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779857.724128:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04779421c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881536384:0@lo:400:kworker.0 00010000:00080000:3.0:1787779857.724153:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c047785f480 x1874622881536896/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779873 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779857.724161:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047785f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881536896:0@lo:400:kworker.0 00000100:00100000:3.0:1787779857.724191:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04812aa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881536000:0@lo:400:kworker.0 00000100:00100000:0.0:1787779857.727299:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346dac3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1874622881536256:12345-0@lo:400:kworker.0 Request processed in 12328us (15565us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779857.727313:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00010000:00080000:2.0:1787779857.727364:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c04812a9a40 x1874622881536256/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779873 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787779857.727379:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04812a9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1874622881536256:0@lo:400:kworker.0 00000100:00100000:1.0:1787779857.729341:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346dacf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1874622881536768:12345-0@lo:400:kworker.0 Request processed in 7000us (17547us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779857.729352:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00010000:00080000:2.0:1787779857.729458:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c047785da40 x1874622881536768/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779873 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787779857.729470:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047785da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1874622881536768:0@lo:400:kworker.0 00000100:00100000:2.0:1787779858.205244:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787779858.205266:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346dac780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881537280:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787779858.205332:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779858.205397:0:8529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881537280 00000100:00100000:2.0:1787779858.205405:0:8529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881537280 00000100:00100000:2.0:1787779858.205446:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787779858.205454:0:8529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346dae580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881537280:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787779858.205482:0:8529:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787779858.205525:0:8529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346dae580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881537280:12345-0@lo:13:osp-pre-0-1.0 Request processed in 71us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779858.205533:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:2.0:1787779858.205568:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0346dac780 x1874622881537280/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779874 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787779858.205595:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346dac780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881537280:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787779858.205744:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787779858.205754:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0476495a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881537408:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787779858.205782:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779858.205814:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881537408 00000100:00100000:3.0:1787779858.205818:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881537408 00000100:00100000:3.0:1787779858.205876:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787779858.205883:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04764970c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881537408:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787779858.205894:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787779858.205925:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04764970c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881537408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 43us (142us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779858.205938:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:3.0:1787779858.205964:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0476495a40 x1874622881537408/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779874 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779858.205977:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0476495a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881537408:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787779858.526174:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787779858.717644:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787779858.717668:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0476495a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881537536:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787779858.717757:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779858.717944:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881537536 00000100:00100000:3.0:1787779858.717953:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881537536 00000100:00100000:3.0:1787779858.718005:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787779858.718026:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346dac780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881537536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787779858.718049:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787779858.718104:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346dac780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881537536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779858.718133:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:2.0:1787779858.718383:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0476495a40 x1874622881537536/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779874 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787779858.718400:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0476495a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881537536:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787779858.839949:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787779858.840000:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787779858.840047:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787779858.840066:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787779858.840118:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787779858.840268:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863646976 00000100:00100000:0.0:1787779858.840281:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863646976 00000100:00100000:0.0:1787779858.840352:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863646848 00000100:00100000:0.0:1787779858.840355:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863646848 00000100:00100000:0.0:1787779858.840380:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 34 00000100:00100000:0.0:1787779858.840390:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046f1b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:2410:x1874622863646976:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1787779858.840489:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046f1b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:2410:x1874622863646976:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 98us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779858.840495:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863646464 00000100:00100000:0.0:1787779858.840503:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 34 00000100:00100000:2.0:1787779858.840510:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863646464 00000100:00100000:2.0:1787779858.840589:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 276 00000100:00100000:2.0:1787779858.840604:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471776450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+10:2410:x1874622863646464:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1787779858.840710:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 35 00000100:00100000:0.0:1787779858.840720:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04764943c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:2410:x1874622863646848:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1787779858.840750:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04764943c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:2410:x1874622863646848:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 33us (632us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779858.840757:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 35 00000100:00080000:0.0:1787779858.840806:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787779858.840811:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787779858.841134:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471776450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+10:2410:x1874622863646464:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 533us (1203us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779858.841143:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 276 00000100:00100000:3.0:1787779858.841301:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863646720 00000100:00100000:3.0:1787779858.841308:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863646720 00000100:00100000:3.0:1787779858.841361:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863646592 00000100:00100000:3.0:1787779858.841364:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863646592 00000100:00100000:3.0:1787779858.841387:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 79 00000100:00100000:3.0:1787779858.841395:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0476497480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:2410:x1874622863646720:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1787779858.841436:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0476497480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:2410:x1874622863646720:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 43us (1436us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779858.841443:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 79 00000100:00100000:3.0:1787779858.841457:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 80 00000100:00100000:3.0:1787779858.841463:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0476496580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+6:2410:x1874622863646592:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1787779858.841485:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0476496580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+6:2410:x1874622863646592:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 23us (1418us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779858.841491:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 80 00000100:00080000:2.0:1787779858.842501:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787779858.842508:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1787779859.551384:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787779860.252177:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346d4ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881537664:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787779860.252279:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779860.252512:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881537664 00000100:00100000:0.0:1787779860.252542:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881537664 00000100:00100000:0.0:1787779860.252617:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787779860.252628:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346daf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881537664:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787779860.252670:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787779860.252747:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346daf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881537664:12345-0@lo:41:osp-pre-0-1.0 Request processed in 121us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779860.252756:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787779860.252817:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346d4ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881537664:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1787779860.582877:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787779860.764755:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787779860.764784:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346d4ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881537792:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787779860.764892:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779860.765042:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881537792 00000100:00100000:2.0:1787779860.765052:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881537792 00000100:00100000:2.0:1787779860.765120:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787779860.765131:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346d4e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874622881537792:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787779860.765174:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787779860.765227:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346d4e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874622881537792:12345-0@lo:41:osp-pre-1-0.0 Request processed in 97us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779860.765255:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787779860.765379:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346d4ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881537792:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787779861.597115:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787779862.620474:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787779862.814111:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787779862.814141:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0476494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881537920:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787779862.814228:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779862.814307:0:8529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881537920 00000100:00100000:3.0:1787779862.814315:0:8529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881537920 00000100:00100000:3.0:1787779862.814457:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787779862.814468:0:8529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0476495e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881537920:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787779862.814505:0:8529:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787779862.814552:0:8529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0476495e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881537920:12345-0@lo:13:osp-pre-1-1.0 Request processed in 87us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779862.814560:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:3.0:1787779862.814602:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0476494000 x1874622881537920/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779878 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779862.814623:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0476494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881537920:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787779862.817681:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346daed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874622881538432:0@lo:400:kworker.0 00000100:00100000:2.0:1787779862.817771:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779862.817810:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346dacb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881538944:0@lo:400:kworker.0 00000100:00100000:2.0:1787779862.817870:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779862.818009:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346dafc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1f575176-36bc-4786-83ee-2fea064a12a9:3644:1874622881538048:0@lo:400:kworker.0 00000100:00100000:1.0:1787779862.818055:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779862.818086:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346dae1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881538560:0@lo:400:kworker.0 00000100:00100000:1.0:1787779862.818113:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779862.818130:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346dae940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881539072:0@lo:400:kworker.0 00000100:00100000:2.0:1787779862.818508:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047785e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881539456:0@lo:400:kworker.0 00000100:00100000:2.0:1787779862.818537:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779862.818608:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881538944 00000100:00100000:1.0:1787779862.818618:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881538944 00000100:00100000:1.0:1787779862.818694:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881539456 00000100:00100000:1.0:1787779862.818698:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881539456 00000100:00100000:1.0:1787779862.818726:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787779862.818737:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c047785cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881538944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779862.818836:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881538432 00000100:00100000:3.0:1787779862.818863:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881538432 00000100:00100000:3.0:1787779862.818902:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1787779862.818910:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c047785d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1874622881538432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779862.819056:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881538048 00000100:00100000:2.0:1787779862.819061:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881538048 00000100:00100000:2.0:1787779862.819101:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1787779862.819108:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471772050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+24:3644:x1874622881538048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779862.819144:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471772050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+24:3644:x1874622881538048:12345-0@lo:400:kworker.0 Request processed in 36us (1088us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779862.819152:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1787779862.819191:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881538560 00000100:00100000:2.0:1787779862.819195:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881538560 00000100:00100000:2.0:1787779862.819222:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787779862.819228:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c047796e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881538560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779862.819262:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c047796e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881538560:12345-0@lo:400:kworker.0 Request processed in 35us (1149us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779862.819269:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787779862.822023:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346dade00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874622881538176:0@lo:400:kworker.0 00000100:00100000:2.0:1787779862.822126:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779862.822179:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346daf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1874622881538688:0@lo:400:kworker.0 00000100:00100000:2.0:1787779862.822221:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779862.822241:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346daf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1874622881539200:0@lo:400:kworker.0 00000100:00100000:2.0:1787779862.822265:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779862.822288:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1787779862.822296:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346dac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881538304:0@lo:400:kworker.0 00000100:00100000:2.0:1787779862.822322:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779862.822344:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346dad2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1874622881538816:0@lo:400:kworker.0 00000100:00100000:2.0:1787779862.822367:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779862.822379:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346dad680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1874622881539328:0@lo:400:kworker.0 00000100:00100000:2.0:1787779862.822400:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779862.822438:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881538304 00000100:00100000:2.0:1787779862.822448:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881538304 00000100:00100000:2.0:1787779862.822502:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787779862.822512:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c047785fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881538304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779862.822577:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c047785fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881538304:12345-0@lo:400:kworker.0 Request processed in 66us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779862.822585:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787779862.822636:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346dac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881538304:0@lo:400:kworker.0 00000100:00100000:0.0:1787779862.822919:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787779862.822934:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c047785c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881539456:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787779862.823038:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787779862.823045:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787779862.823063:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881538176 00000100:00100000:2.0:1787779862.823068:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881538176 00000100:00100000:2.0:1787779862.823088:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881538688 00000100:00100000:2.0:1787779862.823090:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881538688 00000100:00100000:2.0:1787779862.823106:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881539200 00000100:00100000:2.0:1787779862.823108:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881539200 00000100:00100000:2.0:1787779862.823118:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881538816 00000100:00100000:2.0:1787779862.823128:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881538816 00000100:00100000:2.0:1787779862.823142:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881539328 00000100:00100000:2.0:1787779862.823144:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881539328 00000100:00100000:2.0:1787779862.823156:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787779862.823161:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c047785c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874622881538176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779862.823197:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c047785c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874622881538176:12345-0@lo:400:kworker.0 Request processed in 36us (1073us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779862.823203:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787779862.823214:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787779862.823219:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c047785da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874622881538688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779862.823244:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c047785da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874622881538688:12345-0@lo:400:kworker.0 Request processed in 25us (1023us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779862.823249:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787779862.823259:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787779862.823265:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c047785f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1874622881539200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779862.823291:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c047785f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1874622881539200:12345-0@lo:400:kworker.0 Request processed in 26us (1025us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779862.823296:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787779862.823307:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787779862.823312:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c047785de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1874622881538816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779862.823416:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c047785de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1874622881538816:12345-0@lo:400:kworker.0 Request processed in 103us (1047us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779862.823422:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787779862.823433:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787779862.823438:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04812a83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1874622881539328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779862.823460:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04812a83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1874622881539328:12345-0@lo:400:kworker.0 Request processed in 23us (1061us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779862.823472:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:2.0:1787779862.823486:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787779862.823488:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787779862.823511:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0346dad2c0 x1874622881538816/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779878 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787779862.823522:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346dad2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1874622881538816:0@lo:400:kworker.0 00010000:00080000:2.0:1787779862.823531:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0346dad680 x1874622881539328/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779878 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787779862.823538:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346dad680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1874622881539328:0@lo:400:kworker.0 00000100:00100000:2.0:1787779862.823548:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346dade00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874622881538176:0@lo:400:kworker.0 00000100:00100000:2.0:1787779862.823557:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346daf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1874622881538688:0@lo:400:kworker.0 00000100:00100000:2.0:1787779862.823567:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346daf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1874622881539200:0@lo:400:kworker.0 00000100:00100000:1.0:1787779862.823825:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c047785cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881538944:12345-0@lo:400:kworker.0 Request processed in 5087us (5951us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779862.823833:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787779862.826981:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c047785d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1874622881538432:12345-0@lo:400:kworker.0 Request processed in 8055us (9194us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779862.827000:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787779862.831493:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c047785c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881539456:12345-0@lo:400:kworker.0 Request processed in 8544us (12934us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779862.831515:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787779862.831596:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779862.831704:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346dafc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1f575176-36bc-4786-83ee-2fea064a12a9:3644:1874622881538048:0@lo:400:kworker.0 00000100:00100000:0.0:1787779862.831722:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346dae1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881538560:0@lo:400:kworker.0 00000100:00100000:0.0:1787779862.831761:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881539072 00000100:00100000:0.0:1787779862.831769:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881539072 00000100:00100000:0.0:1787779862.831872:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787779862.831883:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346d4ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881539072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787779862.831985:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346d4ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881539072:12345-0@lo:400:kworker.0 Request processed in 104us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779862.831992:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:0.0:1787779862.832049:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0346dae940 x1874622881539072/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779878 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787779862.832061:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346dae940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881539072:0@lo:400:kworker.0 00000100:00100000:2.0:1787779862.833602:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346daed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874622881538432:0@lo:400:kworker.0 00000100:00080000:2.0:1787779862.833627:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787779862.833656:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0346dacb40 x1874622881538944/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779878 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787779862.833679:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346dacb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881538944:0@lo:400:kworker.0 00010000:00080000:2.0:1787779862.833695:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c047785e1c0 x1874622881539456/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779878 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787779862.833704:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047785e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881539456:0@lo:400:kworker.0 00000100:00100000:2.0:1787779863.324170:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787779863.324212:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04812a9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881539584:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787779863.324309:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779863.324416:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881539584 00000100:00100000:2.0:1787779863.324426:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881539584 00000100:00100000:2.0:1787779863.324487:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787779863.324497:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04812aa580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881539584:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787779863.324541:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787779863.324599:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04812aa580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881539584:12345-0@lo:13:osp-pre-0-1.0 Request processed in 103us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779863.324607:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:2.0:1787779863.324666:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c04812a9a40 x1874622881539584/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779879 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787779863.324688:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04812a9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881539584:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787779863.325877:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787779863.325912:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04812a9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881539712:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787779863.325987:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779863.326205:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881539712 00000100:00100000:2.0:1787779863.326213:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881539712 00000100:00100000:2.0:1787779863.326262:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787779863.326273:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c047796da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1874622881539712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787779863.326298:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787779863.326370:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c047796da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1874622881539712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779863.326378:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:0.0:1787779863.326548:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c04812a9a40 x1874622881539712/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779879 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787779863.326568:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04812a9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881539712:0@lo:13:osp-pre-1-0.0 00000001:02000400:1.0:1787779863.556828:0:10688:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg331-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:1.0:1787779863.645636:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787779863.836346:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787779863.836381:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0476494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881539840:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787779863.836483:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779863.836636:0:8529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881539840 00000100:00100000:3.0:1787779863.836646:0:8529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881539840 00000100:00100000:3.0:1787779863.836722:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787779863.836734:0:8529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04812a8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874622881539840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787779863.836764:0:8529:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787779863.836826:0:8529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04812a8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874622881539840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779863.836834:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:1.0:1787779863.837133:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0476494000 x1874622881539840/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779879 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787779863.837157:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0476494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881539840:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787779863.970562:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787779863.970617:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787779863.970682:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787779863.970708:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787779863.970741:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787779863.970781:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863647488 00000100:00100000:3.0:1787779863.970795:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863647488 00000100:00100000:3.0:1787779863.970924:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863647616 00000100:00100000:3.0:1787779863.970928:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863647616 00000100:00100000:3.0:1787779863.970957:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 18 00000100:00100000:3.0:1787779863.970969:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0476494000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:2407:x1874622863647488:12345-192.168.203.31@tcp:9:kworker.0 00000100:00100000:1.0:1787779863.971299:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863647360 00000100:00100000:1.0:1787779863.971304:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863647360 00000100:00100000:1.0:1787779863.971344:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863647232 00000100:00100000:1.0:1787779863.971347:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863647232 00000100:00100000:1.0:1787779863.971373:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 87 00000100:00100000:1.0:1787779863.971381:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0476495a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:2411:x1874622863647360:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1787779863.971464:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0476495a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:2411:x1874622863647360:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 83us (845us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779863.971472:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 87 00000100:00100000:1.0:1787779863.971494:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 88 00000100:00100000:1.0:1787779863.971501:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0476495680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+6:2411:x1874622863647232:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1787779863.971528:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0476495680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+6:2411:x1874622863647232:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 28us (846us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779863.971534:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 88 00000100:00100000:1.0:1787779863.971741:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 19 00000100:00100000:1.0:1787779863.971750:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0476496940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:2407:x1874622863647616:12345-192.168.203.31@tcp:9:kworker.0 00000020:00000080:1.0:1787779863.971780:0:9899:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc8fc0a5179960669 00000100:00080000:1.0:1787779863.971805:0:9899:0:(import.c:65:import_set_state_nolock()) ffff9c0347cea000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787779863.971905:0:9899:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:1.0:1787779863.972614:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0476496940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+2:2407:x1874622863647616:12345-192.168.203.31@tcp:9:kworker.0 Request processed in 862us (1868us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779863.972624:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 19 00010000:00010000:1.0:1787779863.972669:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787779863.972992:0:8427:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc8fc0a5179960662 00000100:00080000:3.0:1787779863.973073:0:8427:0:(import.c:65:import_set_state_nolock()) ffff9c0346f6d000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787779863.973128:0:8427:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1787779863.973259:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0476494000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+2:2407:x1874622863647488:12345-192.168.203.31@tcp:9:kworker.0 Request processed in 2292us (2548us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779863.973268:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 18 00000100:00100000:2.0:1787779863.973761:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863647104 00000100:00100000:2.0:1787779863.973770:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863647104 00000100:00100000:2.0:1787779863.973829:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 278 00000100:00100000:2.0:1787779863.973859:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471770450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+10:2411:x1874622863647104:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1787779863.973914:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471770450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+10:2411:x1874622863647104:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 77us (3368us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779863.973921:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 278 00000100:00080000:2.0:1787779863.973957:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787779863.973963:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787779863.973967:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787779863.973970:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787779863.974381:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787779864.670075:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787779865.373051:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787779865.373087:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346d4d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881539968:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787779865.373195:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779865.373357:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881539968 00000100:00100000:2.0:1787779865.373367:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881539968 00000100:00100000:2.0:1787779865.373436:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787779865.373448:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c047796fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881539968:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787779865.373501:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787779865.373568:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c047796fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881539968:12345-0@lo:41:osp-pre-0-1.0 Request processed in 122us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779865.373575:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787779865.373748:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346d4d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881539968:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787779865.692581:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787779865.890370:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346d4cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881540096:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787779865.890450:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779865.891223:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881540096 00000100:00100000:3.0:1787779865.891234:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881540096 00000100:00100000:3.0:1787779865.891286:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787779865.891296:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c047796de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881540096:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787779865.891334:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787779865.891400:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c047796de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881540096:12345-0@lo:41:osp-pre-1-0.0 Request processed in 106us (950us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779865.891408:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787779865.893380:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346d4cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881540096:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1787779866.716718:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787779867.746039:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787779867.934149:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477942d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1874622881540352:0@lo:400:kworker.0 00000100:00100000:3.0:1787779867.934217:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779867.934261:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477941680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1874622881540864:0@lo:400:kworker.0 00000100:00100000:3.0:1787779867.934280:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779867.934310:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c046efcf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1874622881541376:0@lo:400:kworker.0 00000100:00100000:3.0:1787779867.934328:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779867.934354:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:3.0:1787779867.934359:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0476494f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1f575176-36bc-4786-83ee-2fea064a12a9:3642:1874622881540224:0@lo:400:kworker.0 00000100:00100000:3.0:1787779867.934381:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779867.934399:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477942580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881540736:0@lo:400:kworker.0 00000100:00100000:3.0:1787779867.934420:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779867.934435:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04779403c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881541248:0@lo:400:kworker.0 00000100:00100000:3.0:1787779867.934457:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779867.934475:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c046efcd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881541760:0@lo:400:kworker.0 00000100:00100000:3.0:1787779867.934494:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779867.934520:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477940000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881540480:0@lo:400:kworker.0 00000100:00100000:3.0:1787779867.934542:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779867.934560:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477942940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1874622881540992:0@lo:400:kworker.0 00000100:00100000:3.0:1787779867.934579:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779867.934596:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c046efccb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1874622881541504:0@lo:400:kworker.0 00000100:00100000:3.0:1787779867.934616:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779867.934637:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1787779867.934643:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477943c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874622881540608:0@lo:400:kworker.0 00000100:00100000:3.0:1787779867.934664:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779867.934674:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04779421c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881541120:0@lo:400:kworker.0 00000100:00100000:3.0:1787779867.934693:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779867.934709:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c046efce1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881541632:0@lo:400:kworker.0 00000100:00100000:3.0:1787779867.934730:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779867.934766:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881540352 00000100:00100000:3.0:1787779867.934773:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881540352 00000100:00100000:3.0:1787779867.934805:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881540864 00000100:00100000:3.0:1787779867.934808:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881540864 00000100:00100000:3.0:1787779867.934829:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881541376 00000100:00100000:3.0:1787779867.934832:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881541376 00000100:00100000:3.0:1787779867.934866:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881540992 00000100:00100000:3.0:1787779867.934869:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881540992 00000100:00100000:3.0:1787779867.934880:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881541504 00000100:00100000:3.0:1787779867.934883:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881541504 00000100:00100000:3.0:1787779867.934893:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881540608 00000100:00100000:3.0:1787779867.934895:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881540608 00000100:00100000:3.0:1787779867.934909:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787779867.934918:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046efccf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1874622881540352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779867.934969:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046efccf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1874622881540352:12345-0@lo:400:kworker.0 Request processed in 52us (751us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779867.934977:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787779867.934994:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787779867.935000:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046efce580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1874622881540864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779867.935027:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046efce580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1874622881540864:12345-0@lo:400:kworker.0 Request processed in 28us (745us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779867.935033:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787779867.935044:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787779867.935050:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046efcfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1874622881541376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779867.935073:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046efcfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1874622881541376:12345-0@lo:400:kworker.0 Request processed in 24us (743us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779867.935078:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787779867.935088:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1787779867.935094:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346de0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1874622881540992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779867.935132:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346de0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1874622881540992:12345-0@lo:400:kworker.0 Request processed in 38us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779867.935138:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1787779867.935150:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1787779867.935157:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346de3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1874622881541504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779867.935181:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346de3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1874622881541504:12345-0@lo:400:kworker.0 Request processed in 25us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779867.935186:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1787779867.935196:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787779867.935202:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346de3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1874622881540608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779867.935227:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346de3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1874622881540608:12345-0@lo:400:kworker.0 Request processed in 26us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779867.935233:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787779867.935257:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881540224 00000100:00100000:3.0:1787779867.935260:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881540224 00000100:00100000:3.0:1787779867.935282:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:3.0:1787779867.935287:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471771450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+24:3642:x1874622881540224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779867.935310:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471771450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+24:3642:x1874622881540224:12345-0@lo:400:kworker.0 Request processed in 24us (928us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779867.935315:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:3.0:1787779867.935335:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881540736 00000100:00100000:3.0:1787779867.935337:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881540736 00000100:00100000:3.0:1787779867.935348:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881540480 00000100:00100000:3.0:1787779867.935350:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881540480 00000100:00100000:3.0:1787779867.935358:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787779867.935362:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046efcc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1874622881540736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779867.935395:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046efcc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1874622881540736:12345-0@lo:400:kworker.0 Request processed in 32us (974us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779867.935400:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787779867.935409:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787779867.935413:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346de2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881540480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779867.935431:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346de2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881540480:12345-0@lo:400:kworker.0 Request processed in 18us (889us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779867.935435:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787779867.935447:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881541248 00000100:00100000:3.0:1787779867.935450:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881541248 00000100:00100000:3.0:1787779867.935463:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881541760 00000100:00100000:3.0:1787779867.935465:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881541760 00000100:00100000:3.0:1787779867.935473:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881541120 00000100:00100000:3.0:1787779867.935475:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881541120 00000100:00100000:3.0:1787779867.935482:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881541632 00000100:00100000:3.0:1787779867.935484:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881541632 00000100:00100000:3.0:1787779867.935492:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787779867.935496:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346de12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3642:x1874622881541248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779867.935518:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346de12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3642:x1874622881541248:12345-0@lo:400:kworker.0 Request processed in 22us (1061us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779867.935523:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787779867.935530:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787779867.935534:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346de2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3642:x1874622881541760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779867.935552:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346de2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3642:x1874622881541760:12345-0@lo:400:kworker.0 Request processed in 18us (1058us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779867.935556:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787779867.935563:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787779867.935572:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346de03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881541120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779867.935591:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346de03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881541120:12345-0@lo:400:kworker.0 Request processed in 19us (897us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779867.935595:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787779867.935603:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787779867.935607:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346de2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881541632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779867.935637:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346de2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881541632:12345-0@lo:400:kworker.0 Request processed in 29us (906us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779867.935643:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:3.0:1787779867.935676:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787779867.935679:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787779867.935681:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787779867.935683:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787779867.935709:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477943c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874622881540608:0@lo:400:kworker.0 00010000:00080000:3.0:1787779867.935719:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c04779421c0 x1874622881541120/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779883 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779867.935729:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04779421c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881541120:0@lo:400:kworker.0 00010000:00080000:3.0:1787779867.935736:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c046efce1c0 x1874622881541632/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779883 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779867.935744:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c046efce1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881541632:0@lo:400:kworker.0 00000100:00100000:3.0:1787779867.935751:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477940000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881540480:0@lo:400:kworker.0 00010000:00080000:3.0:1787779867.935758:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0477942940 x1874622881540992/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779883 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779867.935765:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477942940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1874622881540992:0@lo:400:kworker.0 00010000:00080000:3.0:1787779867.935780:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c046efccb40 x1874622881541504/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779883 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779867.935786:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c046efccb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1874622881541504:0@lo:400:kworker.0 00000100:00100000:3.0:1787779867.935816:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0476494f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1f575176-36bc-4786-83ee-2fea064a12a9:3642:1874622881540224:0@lo:400:kworker.0 00000100:00100000:3.0:1787779867.935823:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477942580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881540736:0@lo:400:kworker.0 00010000:00080000:3.0:1787779867.935830:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c04779403c0 x1874622881541248/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779883 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779867.935855:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04779403c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881541248:0@lo:400:kworker.0 00010000:00080000:3.0:1787779867.935863:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c046efcd680 x1874622881541760/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779883 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779867.935871:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c046efcd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881541760:0@lo:400:kworker.0 00000100:00100000:3.0:1787779867.935881:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477942d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1874622881540352:0@lo:400:kworker.0 00000100:00100000:3.0:1787779867.935889:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477941680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1874622881540864:0@lo:400:kworker.0 00000100:00100000:3.0:1787779867.935898:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c046efcf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1874622881541376:0@lo:400:kworker.0 00000100:00100000:2.0:1787779867.936063:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787779867.936073:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346d4e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881541888:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787779867.936104:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779867.936168:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881541888 00000100:00100000:0.0:1787779867.936172:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881541888 00000100:00100000:0.0:1787779867.936208:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787779867.936216:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04812a8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881541888:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787779867.936236:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787779867.936272:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04812a8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881541888:12345-0@lo:13:osp-pre-1-1.0 Request processed in 57us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779867.936278:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:2.0:1787779867.936340:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0346d4e940 x1874622881541888/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779883 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787779867.936353:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346d4e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881541888:0@lo:13:osp-pre-1-1.0 00000001:02000400:1.0:1787779868.233361:0:10932:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg331-server.virtnet: executing yml_node 00000100:00100000:3.0:1787779868.444253:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346d4f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881542016:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787779868.444331:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779868.444391:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787779868.444398:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346d4d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881542144:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787779868.444422:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779868.445913:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881542016 00000100:00100000:1.0:1787779868.445924:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881542016 00000100:00100000:1.0:1787779868.445980:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881542144 00000100:00100000:1.0:1787779868.445983:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881542144 00000100:00100000:1.0:1787779868.446002:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787779868.446010:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346de1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881542016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787779868.446030:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787779868.446085:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346de1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881542016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (1754us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779868.446102:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787779868.446120:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787779868.446126:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0476494f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881542144:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787779868.446143:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787779868.446170:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0476494f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881542144:12345-0@lo:13:osp-pre-0-1.0 Request processed in 45us (1747us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779868.446175:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:3.0:1787779868.446246:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0346d4d680 x1874622881542144/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779884 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779868.446287:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346d4d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881542144:0@lo:13:osp-pre-0-1.0 00010000:00080000:3.0:1787779868.446302:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0346d4f840 x1874622881542016/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779884 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779868.446313:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346d4f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881542016:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787779868.776992:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787779868.957022:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047796ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881542272:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787779868.957096:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779868.957254:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881542272 00000100:00100000:0.0:1787779868.957263:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881542272 00000100:00100000:0.0:1787779868.957316:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787779868.957325:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04812a9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874622881542272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787779868.957348:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787779868.957401:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04812a9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874622881542272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779868.957417:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:2.0:1787779868.959422:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c047796ed00 x1874622881542272/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779884 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787779868.959449:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047796ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881542272:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787779869.078326:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787779869.078498:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787779869.078525:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787779869.079547:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863647744 00000100:00100000:2.0:1787779869.079557:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863647744 00000100:00100000:2.0:1787779869.079603:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 280 00000100:00100000:2.0:1787779869.079611:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471770c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+10:2410:x1874622863647744:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1787779869.079686:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471770c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+10:2410:x1874622863647744:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 76us (1369us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779869.079695:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 280 00000100:00100000:0.0:1787779869.080342:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863648000 00000100:00100000:0.0:1787779869.080348:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863648000 00000100:00100000:0.0:1787779869.080383:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863647872 00000100:00100000:0.0:1787779869.080385:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863647872 00000100:00100000:0.0:1787779869.080403:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 95 00000100:00100000:0.0:1787779869.080410:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c047796e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:2410:x1874622863648000:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1787779869.080442:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c047796e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:2410:x1874622863648000:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 32us (1944us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779869.080448:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 95 00000100:00100000:0.0:1787779869.080462:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 96 00000100:00100000:0.0:1787779869.080467:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c047796f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+6:2410:x1874622863647872:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1787779869.080487:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c047796f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+6:2410:x1874622863647872:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 20us (1961us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779869.080499:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 96 00000100:00080000:3.0:1787779869.081076:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787779869.081082:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1787779869.788888:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787779869.981738:0:8423:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 781d29bb-23d2-48e3-b16d-c29e52cd5375 00000020:00000080:2.0:1787779869.981747:0:8423:0:(genops.c:885:class_export_put()) final put ffff9c0346f6f800/781d29bb-23d2-48e3-b16d-c29e52cd5375 00000020:00000080:0.0:1787779869.982119:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c0346f6f800/781d29bb-23d2-48e3-b16d-c29e52cd5375 for lustre-OST0000 00000020:00000080:0.0:1787779869.982182:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c0346f6d000 for lustre-OST0000 00000001:00100000:0.0:1787779869.994149:0:9508:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 781d29bb-23d2-48e3-b16d-c29e52cd5375 00000020:00000080:0.0:1787779869.994158:0:9508:0:(genops.c:885:class_export_put()) final put ffff9c0347ced000/781d29bb-23d2-48e3-b16d-c29e52cd5375 00000020:00000080:2.0:1787779869.994234:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c0347ced000/781d29bb-23d2-48e3-b16d-c29e52cd5375 for lustre-OST0001 00000020:00000080:2.0:1787779869.994279:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c0347cea000 for lustre-OST0001 00000100:00100000:0.0:1787779870.492165:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04812ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874622881542400:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787779870.492233:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779870.492582:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881542400 00000100:00100000:3.0:1787779870.492589:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881542400 00000100:00100000:3.0:1787779870.492651:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787779870.492660:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346d4c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1874622881542400:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787779870.492692:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787779870.492745:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346d4c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1874622881542400:12345-0@lo:41:osp-pre-0-1.0 Request processed in 87us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779870.492751:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787779870.492884:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04812ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874622881542400:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787779870.813642:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787779871.004324:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346d4cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881542528:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787779871.004398:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779871.006853:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881542528 00000100:00100000:1.0:1787779871.006866:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881542528 00000100:00100000:1.0:1787779871.006924:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787779871.007164:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046efcf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881542528:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787779871.007202:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787779871.007282:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046efcf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881542528:12345-0@lo:41:osp-pre-1-0.0 Request processed in 123us (2884us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779871.007290:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1787779871.007330:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346d4cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881542528:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787779871.836058:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787779872.860183:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787779873.052078:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346d4c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881542784:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787779873.052144:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779873.052206:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881542784 00000100:00100000:2.0:1787779873.052213:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881542784 00000100:00100000:2.0:1787779873.052265:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787779873.052273:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c047796c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881542784:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787779873.052297:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787779873.052399:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787779873.052409:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c046efcd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1f575176-36bc-4786-83ee-2fea064a12a9:3643:1874622881542656:0@lo:400:kworker.0 00000100:00100000:0.0:1787779873.052451:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779873.052481:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881542656 00000100:00100000:0.0:1787779873.052484:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881542656 00000100:00100000:0.0:1787779873.052505:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1787779873.052511:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471771c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+24:3643:x1874622881542656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787779873.052540:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471771c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+24:3643:x1874622881542656:12345-0@lo:400:kworker.0 Request processed in 29us (88us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779873.052546:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1787779873.052586:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c046efcd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1f575176-36bc-4786-83ee-2fea064a12a9:3643:1874622881542656:0@lo:400:kworker.0 00000100:00100000:0.0:1787779873.052623:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c046efccb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1874622881542912:0@lo:400:kworker.0 00000100:00100000:0.0:1787779873.052647:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779873.052671:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881542912 00000100:00100000:0.0:1787779873.052674:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881542912 00000100:00100000:0.0:1787779873.052697:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787779873.052702:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346d4e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1874622881542912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787779873.052736:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346d4e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1874622881542912:12345-0@lo:400:kworker.0 Request processed in 34us (88us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779873.052742:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787779873.052764:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c046efccb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1874622881542912:0@lo:400:kworker.0 00000100:00080000:0.0:1787779873.052784:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787779873.056125:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c047796c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881542784:12345-0@lo:13:osp-pre-1-1.0 Request processed in 3843us (3971us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779873.056138:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:1.0:1787779873.056238:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0346d4c780 x1874622881542784/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779889 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787779873.056275:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346d4c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881542784:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787779873.060602:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c046efce1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881543040:0@lo:400:kworker.0 00000100:00100000:1.0:1787779873.060669:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c046efccb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874622881543168:0@lo:400:kworker.0 00000100:00100000:0.0:1787779873.060681:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779873.060725:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881543040 00000100:00100000:0.0:1787779873.060725:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477942d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1874622881543552:0@lo:400:kworker.0 00000100:00100000:3.0:1787779873.060736:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881543040 00000100:00100000:0.0:1787779873.060754:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779873.060775:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477940000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1874622881544064:0@lo:400:kworker.0 00000100:00100000:3.0:1787779873.060794:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787779873.060806:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346d4da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881543040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787779873.060814:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779873.060834:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787779873.060859:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04779421c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881544192:0@lo:400:kworker.0 00000100:00100000:0.0:1787779873.060894:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779873.060902:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346d4da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881543040:12345-0@lo:400:kworker.0 Request processed in 98us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779873.060911:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787779873.060933:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c046efce1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881543040:0@lo:400:kworker.0 00000100:00100000:3.0:1787779873.060947:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477941680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1874622881543424:0@lo:400:kworker.0 00000100:00100000:0.0:1787779873.060965:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881543552 00000100:00100000:0.0:1787779873.060969:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881543552 00000100:00100000:3.0:1787779873.060981:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779873.061005:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477942940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1874622881543936:0@lo:400:kworker.0 00000100:00100000:0.0:1787779873.061020:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881544064 00000100:00100000:0.0:1787779873.061025:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881544064 00000100:00100000:0.0:1787779873.061040:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881543424 00000100:00100000:3.0:1787779873.061043:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779873.061044:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881543424 00000100:00100000:0.0:1787779873.061059:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881543936 00000100:00100000:0.0:1787779873.061062:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881543936 00000100:00100000:3.0:1787779873.061063:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787779873.061072:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c046efcd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881543296:0@lo:400:kworker.0 00000100:00100000:0.0:1787779873.061085:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787779873.061096:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346d4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1874622881543552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779873.061097:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779873.061130:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477942580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881543808:0@lo:400:kworker.0 00000100:00100000:0.0:1787779873.061141:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346d4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1874622881543552:12345-0@lo:400:kworker.0 Request processed in 47us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779873.061149:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787779873.061159:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779873.061166:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787779873.061175:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346d4fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1874622881544064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779873.061187:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881543296 00000100:00100000:3.0:1787779873.061192:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881543296 00000100:00100000:0.0:1787779873.061206:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346d4fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1874622881544064:12345-0@lo:400:kworker.0 Request processed in 32us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779873.061213:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787779873.061215:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787779873.061225:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0476442580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1874622881543296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787779873.061233:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1787779873.061241:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477943c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1874622881543424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779873.061271:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0476442580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1874622881543296:12345-0@lo:400:kworker.0 Request processed in 47us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779873.061279:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477943c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1874622881543424:12345-0@lo:400:kworker.0 Request processed in 38us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779873.061280:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787779873.061298:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787779873.061302:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881544192 00000100:00100000:3.0:1787779873.061307:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881544192 00000100:00100000:0.0:1787779873.061321:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787779873.061330:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0476440780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1874622881543936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779873.061336:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881543808 00000100:00100000:3.0:1787779873.061341:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881543808 00000100:00100000:0.0:1787779873.061364:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0476440780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1874622881543936:12345-0@lo:400:kworker.0 Request processed in 35us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779873.061366:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787779873.061375:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787779873.061379:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346d4de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881544192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787779873.061402:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787779873.061409:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0476441a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3642:x1874622881543808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787779873.061435:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0476441a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3642:x1874622881543808:12345-0@lo:400:kworker.0 Request processed in 27us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779873.061441:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:0.0:1787779873.061459:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787779873.061464:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787779873.061467:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787779873.061469:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1787779873.061495:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c04779421c0 x1874622881544192/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779889 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779873.061504:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346d4de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881544192:12345-0@lo:400:kworker.0 Request processed in 109us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779873.061510:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04779421c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881544192:0@lo:400:kworker.0 00000100:00100000:3.0:1787779873.061516:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:0.0:1787779873.061524:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0477942d00 x1874622881543552/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779889 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787779873.061534:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477942d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1874622881543552:0@lo:400:kworker.0 00010000:00080000:0.0:1787779873.061547:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0477940000 x1874622881544064/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779889 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787779873.061556:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477940000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1874622881544064:0@lo:400:kworker.0 00000100:00100000:3.0:1787779873.061559:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c046efcd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881543296:0@lo:400:kworker.0 00010000:00080000:3.0:1787779873.061596:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0477942580 x1874622881543808/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779889 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779873.061607:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477942580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881543808:0@lo:400:kworker.0 00000100:00100000:3.0:1787779873.061619:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477941680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1874622881543424:0@lo:400:kworker.0 00000100:00100000:3.0:1787779873.061630:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477942940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1874622881543936:0@lo:400:kworker.0 00000100:00100000:1.0:1787779873.063062:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779873.063103:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04779403c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881543680:0@lo:400:kworker.0 00000100:00100000:1.0:1787779873.063128:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779873.063209:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881543168 00000100:00100000:0.0:1787779873.063216:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881543168 00000100:00100000:3.0:1787779873.063244:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881543680 00000100:00100000:3.0:1787779873.063250:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881543680 00000100:00100000:3.0:1787779873.063311:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787779873.063311:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787779873.063326:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c047796ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1874622881543168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779873.063327:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c047796f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881543680:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787779873.063365:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787779873.063427:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c046efccb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874622881543168:0@lo:400:kworker.0 00010000:00080000:1.0:1787779873.063439:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c04779403c0 x1874622881543680/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779889 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787779873.063450:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04779403c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881543680:0@lo:400:kworker.0 00000100:00100000:0.0:1787779873.063509:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c047796ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1874622881543168:12345-0@lo:400:kworker.0 Request processed in 188us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779873.063516:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787779873.072904:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c047796f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881543680:12345-0@lo:400:kworker.0 Request processed in 9573us (9764us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779873.072920:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787779873.564312:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0476443480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881544320:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787779873.564379:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779873.564548:0:8529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881544320 00000100:00100000:1.0:1787779873.564555:0:8529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881544320 00000100:00100000:1.0:1787779873.564658:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787779873.564667:0:8529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04812a9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881544320:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787779873.564695:0:8529:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787779873.564999:0:8529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04812a9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881544320:12345-0@lo:13:osp-pre-0-1.0 Request processed in 332us (618us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779873.565061:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787779873.565268:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346d4c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881544448:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787779873.565301:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779873.565406:0:8529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881544448 00010000:00080000:2.0:1787779873.565608:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0476443480 x1874622881544320/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779889 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787779873.565646:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0476443480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881544320:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787779873.565698:0:8529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881544448 00000100:00100000:1.0:1787779873.565863:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787779873.565871:0:8529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0476443c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1874622881544448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787779873.565883:0:8529:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787779873.565930:0:8529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0476443c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1874622881544448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (628us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779873.565945:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:3.0:1787779873.565969:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0346d4c780 x1874622881544448/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779889 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779873.565984:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346d4c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881544448:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787779873.886460:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787779874.076209:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047796cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881544576:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787779874.076280:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779874.076367:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881544576 00000100:00100000:3.0:1787779874.076374:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881544576 00000100:00100000:3.0:1787779874.076425:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787779874.076435:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04812ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881544576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787779874.076457:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787779874.077428:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04812ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881544576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 992us (1145us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779874.077448:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:2.0:1787779874.080680:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c047796cf00 x1874622881544576/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779890 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787779874.080709:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047796cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881544576:0@lo:13:osp-pre-0-0.0 00000001:02000400:0.0:1787779874.130413:0:11115:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.57 00000100:00100000:2.0:1787779874.200292:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787779874.200331:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787779874.200360:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787779874.200390:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863648384 00000100:00100000:2.0:1787779874.200398:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863648384 00000100:00100000:2.0:1787779874.200448:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863648256 00000100:00100000:2.0:1787779874.200451:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863648256 00000100:00100000:2.0:1787779874.200472:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 103 00000100:00100000:2.0:1787779874.200481:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c047785e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:2411:x1874622863648384:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1787779874.200547:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c047785e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:2411:x1874622863648384:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 67us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779874.200554:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 103 00000100:00100000:2.0:1787779874.200570:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 104 00000100:00100000:2.0:1787779874.200576:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346dada40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+6:2411:x1874622863648256:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1787779874.200630:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346dada40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+6:2411:x1874622863648256:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 53us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779874.200636:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 104 00000100:00080000:2.0:1787779874.200661:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787779874.200665:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787779874.200983:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863648128 00000100:00100000:3.0:1787779874.200987:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863648128 00000100:00100000:3.0:1787779874.201016:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 282 00000100:00100000:3.0:1787779874.201025:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471770050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+10:2411:x1874622863648128:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1787779874.201048:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471770050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+10:2411:x1874622863648128:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 27us (768us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779874.201052:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 282 00010000:00010000:2.0:1787779874.911038:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787779875.615163:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787779875.615187:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346daed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881544704:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787779875.615253:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779875.615535:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881544704 00000100:00100000:3.0:1787779875.615542:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881544704 00000100:00100000:3.0:1787779875.615600:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787779875.615609:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346d4f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881544704:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787779875.615640:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787779875.615692:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346d4f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881544704:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779875.615700:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787779875.616135:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346daed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881544704:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787779875.939113:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787779876.126088:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787779876.126109:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0476441e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881544832:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787779876.126174:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779876.126235:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881544832 00000100:00100000:3.0:1787779876.126241:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881544832 00000100:00100000:3.0:1787779876.126303:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787779876.126312:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0476440000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1874622881544832:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787779876.126344:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787779876.126403:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0476440000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1874622881544832:12345-0@lo:41:osp-pre-1-0.0 Request processed in 82us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779876.126421:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787779876.126472:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0476441e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881544832:0@lo:41:osp-pre-1-0.0 00000001:02000400:0.0:1787779876.278084:0:11213:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.57 00010000:00010000:1.0:1787779876.956303:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787779877.982238:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787779878.172938:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787779878.172962:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346d4e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881544960:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787779878.173026:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779878.173090:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04764412c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881545344:0@lo:400:kworker.0 00000100:00100000:0.0:1787779878.173118:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779878.173136:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0476441680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1874622881545856:0@lo:400:kworker.0 00000100:00100000:3.0:1787779878.173161:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04764421c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1f575176-36bc-4786-83ee-2fea064a12a9:3643:1874622881545088:0@lo:400:kworker.0 00000100:00100000:0.0:1787779878.173175:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779878.173205:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779878.173213:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0476443480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1874622881546368:0@lo:400:kworker.0 00000100:00100000:3.0:1787779878.173241:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0476442940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881545600:0@lo:400:kworker.0 00000100:00100000:0.0:1787779878.173242:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779878.174022:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779878.174025:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1787779878.174034:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0476440b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874622881545472:0@lo:400:kworker.0 00000100:00100000:3.0:1787779878.174049:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0476440f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881546112:0@lo:400:kworker.0 00000100:00100000:0.0:1787779878.174068:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779878.174084:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779878.174094:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04764403c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881545984:0@lo:400:kworker.0 00000100:00100000:3.0:1787779878.174107:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1787779878.174117:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04764430c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1874622881545216:0@lo:400:kworker.0 00000100:00100000:0.0:1787779878.174124:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779878.174144:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779878.174164:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0476443840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1874622881545728:0@lo:400:kworker.0 00000100:00100000:3.0:1787779878.174179:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779878.174188:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0476441e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1874622881546240:0@lo:400:kworker.0 00000100:00100000:3.0:1787779878.174204:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779878.174222:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347ebed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881546496:0@lo:400:kworker.0 00000100:00100000:3.0:1787779878.174233:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881545344 00000100:00100000:3.0:1787779878.174240:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881545344 00000100:00100000:0.0:1787779878.174261:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779878.174274:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881545600 00000100:00100000:3.0:1787779878.174277:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881545600 00000100:00100000:3.0:1787779878.174293:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787779878.174301:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346d4d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881545344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779878.174344:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346d4d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881545344:12345-0@lo:400:kworker.0 Request processed in 44us (1227us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779878.174352:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787779878.174374:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04764412c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881545344:0@lo:400:kworker.0 00000100:00100000:3.0:1787779878.174379:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787779878.174388:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347ebe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881545600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787779878.174405:0:8529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881544960 00000100:00100000:0.0:1787779878.174409:0:8529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881544960 00000100:00100000:3.0:1787779878.174434:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347ebe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881545600:12345-0@lo:400:kworker.0 Request processed in 45us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779878.174441:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787779878.174445:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787779878.174452:0:8529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346d4cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881544960:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787779878.174467:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881545088 00000100:00100000:3.0:1787779878.174471:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881545088 00002000:00000024:0.0:1787779878.174472:0:8529:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787779878.174502:0:8529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346d4cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881544960:12345-0@lo:13:osp-pre-1-1.0 Request processed in 53us (1479us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779878.174509:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787779878.174512:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1787779878.174521:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471772450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+24:3643:x1874622881545088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787779878.174527:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881545856 00000100:00100000:0.0:1787779878.174531:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881545856 00000100:00100000:0.0:1787779878.174564:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881546368 00000100:00100000:0.0:1787779878.174567:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881546368 00000100:00100000:3.0:1787779878.174570:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471772450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+24:3643:x1874622881545088:12345-0@lo:400:kworker.0 Request processed in 49us (1365us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779878.174578:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1787779878.174591:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881545472 00000100:00100000:0.0:1787779878.174596:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881545472 00000100:00100000:2.0:1787779878.174601:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04764421c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1f575176-36bc-4786-83ee-2fea064a12a9:3643:1874622881545088:0@lo:400:kworker.0 00000100:00100000:0.0:1787779878.174613:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881545216 00000100:00100000:0.0:1787779878.174616:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881545216 00000100:00100000:2.0:1787779878.174620:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0476442940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881545600:0@lo:400:kworker.0 00000100:00100000:3.0:1787779878.174624:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881546112 00000100:00100000:3.0:1787779878.174629:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881546112 00000100:00100000:0.0:1787779878.174636:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881545728 00000100:00100000:0.0:1787779878.174641:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881545728 00000100:00100000:3.0:1787779878.174659:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881545984 00000100:00100000:0.0:1787779878.174661:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881546240 00000100:00100000:3.0:1787779878.174663:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881545984 00000100:00100000:0.0:1787779878.174673:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881546240 00000100:00100000:3.0:1787779878.174681:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881546496 00000100:00100000:3.0:1787779878.174685:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881546496 00000100:00100000:3.0:1787779878.174699:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787779878.174704:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347ebf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881546112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779878.174736:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347ebf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881546112:12345-0@lo:400:kworker.0 Request processed in 32us (653us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779878.174741:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787779878.174747:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787779878.174751:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346d4d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1874622881545856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779878.174766:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787779878.174774:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04779403c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881545984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787779878.174784:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346d4d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1874622881545856:12345-0@lo:400:kworker.0 Request processed in 35us (1609us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779878.174789:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787779878.174802:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787779878.174811:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04779403c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881545984:12345-0@lo:400:kworker.0 Request processed in 36us (685us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779878.174817:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346d4cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1874622881546368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779878.174830:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787779878.174865:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346d4cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1874622881546368:12345-0@lo:400:kworker.0 Request processed in 50us (1624us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779878.174871:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787779878.174876:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787779878.174882:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477942940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874622881546496:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1787779878.174888:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0476440f00 x1874622881546112/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779894 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787779878.174892:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787779878.174901:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346d4c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874622881545472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779878.174905:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0476440f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881546112:0@lo:400:kworker.0 00000100:00100000:3.0:1787779878.174940:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477942940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874622881546496:12345-0@lo:400:kworker.0 Request processed in 61us (687us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779878.174945:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346d4c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874622881545472:12345-0@lo:400:kworker.0 Request processed in 43us (875us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779878.174951:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787779878.174959:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787779878.174977:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787779878.174986:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787779878.174987:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347ebd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1874622881545216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779878.174997:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347ebcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1874622881545728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787779878.175040:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347ebd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1874622881545216:12345-0@lo:400:kworker.0 Request processed in 56us (896us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779878.175042:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347ebcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1874622881545728:12345-0@lo:400:kworker.0 Request processed in 47us (859us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779878.175056:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787779878.175099:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04764430c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1874622881545216:0@lo:400:kworker.0 00000100:00100000:2.0:1787779878.175110:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0476443840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1874622881545728:0@lo:400:kworker.0 00000100:00100000:3.0:1787779878.175153:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787779878.175166:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787779878.175176:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347ebe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1874622881546240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787779878.175213:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347ebe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1874622881546240:12345-0@lo:400:kworker.0 Request processed in 40us (1009us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779878.175219:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00080000:0.0:1787779878.175333:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787779878.175339:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787779878.175341:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787779878.175343:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787779878.175380:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0476440b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874622881545472:0@lo:400:kworker.0 00010000:00080000:0.0:1787779878.175394:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c04764403c0 x1874622881545984/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779894 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787779878.175419:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04764403c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881545984:0@lo:400:kworker.0 00010000:00080000:0.0:1787779878.175432:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0347ebed00 x1874622881546496/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779894 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787779878.175440:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347ebed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881546496:0@lo:400:kworker.0 00010000:00080000:0.0:1787779878.175451:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0476443480 x1874622881546368/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779894 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787779878.175458:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0476443480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1874622881546368:0@lo:400:kworker.0 00010000:00080000:0.0:1787779878.175468:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0476441680 x1874622881545856/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779894 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787779878.175475:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0476441680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1874622881545856:0@lo:400:kworker.0 00010000:00080000:0.0:1787779878.175497:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0346d4e940 x1874622881544960/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779894 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787779878.175510:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346d4e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881544960:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787779878.175962:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0476441e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1874622881546240:0@lo:400:kworker.0 00000001:02000400:0.0:1787779878.361619:0:11310:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.57 00000100:00100000:1.0:1787779878.684094:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787779878.684112:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347ebf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881546624:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787779878.684166:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779878.684333:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881546624 00000100:00100000:3.0:1787779878.684341:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881546624 00000100:00100000:3.0:1787779878.684392:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787779878.684402:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c047796f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881546624:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787779878.684429:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787779878.684490:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c047796f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881546624:12345-0@lo:13:osp-pre-0-1.0 Request processed in 91us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779878.684498:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:2.0:1787779878.684601:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0347ebf840 x1874622881546624/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779894 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787779878.684620:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347ebf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881546624:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787779878.684916:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477941680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881546752:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787779878.684956:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779878.685047:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881546752 00000100:00100000:0.0:1787779878.685052:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881546752 00000100:00100000:0.0:1787779878.685087:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787779878.685095:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346dae1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881546752:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787779878.685106:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787779878.685230:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346dae1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881546752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 135us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779878.685237:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:2.0:1787779878.685407:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0477941680 x1874622881546752/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779894 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787779878.685417:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477941680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881546752:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787779879.013061:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787779879.196152:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787779879.196174:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047796cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881546880:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787779879.196254:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779879.196448:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881546880 00000100:00100000:1.0:1787779879.196456:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881546880 00000100:00100000:1.0:1787779879.196509:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787779879.196518:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347ebd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1874622881546880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787779879.196537:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787779879.196595:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347ebd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1874622881546880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779879.196601:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:3.0:1787779879.196710:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c047796cb40 x1874622881546880/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779895 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779879.196747:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047796cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881546880:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787779879.326512:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787779879.326559:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787779879.326611:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787779879.327187:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863648768 00000100:00100000:0.0:1787779879.327196:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863648768 00000100:00100000:0.0:1787779879.327267:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863648640 00000100:00100000:0.0:1787779879.327271:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863648640 00000100:00100000:0.0:1787779879.327306:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 111 00000100:00100000:0.0:1787779879.327316:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346dafc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:2409:x1874622863648768:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1787779879.327391:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346dafc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:2409:x1874622863648768:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 76us (830us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779879.327399:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 111 00000100:00100000:1.0:1787779879.327417:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 112 00000100:00100000:3.0:1787779879.327464:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863648512 00000100:00100000:3.0:1787779879.327469:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863648512 00000100:00100000:3.0:1787779879.327502:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 284 00000100:00100000:3.0:1787779879.327511:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471771850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+10:2409:x1874622863648512:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1787779879.327541:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471771850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+10:2409:x1874622863648512:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 32us (1040us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779879.327560:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 284 00000100:00100000:1.0:1787779879.327627:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346daf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+6:2409:x1874622863648640:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1787779879.327667:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346daf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+6:2409:x1874622863648640:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 241us (1056us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779879.327674:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 112 00000100:00080000:2.0:1787779879.327814:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787779879.327818:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1787779880.030612:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787779880.054062:0:11358:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Wed Aug 26 17:31:19 EDT 2026 00000100:00100000:0.0:1787779880.735782:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787779880.735813:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477942580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881547008:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787779880.735931:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779880.736198:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881547008 00000100:00100000:3.0:1787779880.736207:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881547008 00000100:00100000:3.0:1787779880.736280:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787779880.736292:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477940000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881547008:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787779880.736335:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787779880.736398:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477940000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881547008:12345-0@lo:41:osp-pre-0-1.0 Request processed in 109us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779880.736406:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787779880.736460:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477942580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881547008:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1787779881.053068:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787779881.247399:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047796d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881547136:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787779881.247505:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779881.247927:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881547136 00000100:00100000:2.0:1787779881.247938:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881547136 00000100:00100000:2.0:1787779881.248003:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1787779881.248014:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347ebc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881547136:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787779881.248056:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787779881.254958:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347ebc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881547136:12345-0@lo:41:osp-pre-1-0.0 Request processed in 6927us (7434us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779881.254980:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787779881.261867:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047796d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881547136:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787779882.077033:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787779883.101589:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787779883.292033:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04779421c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881547264:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787779883.292137:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779883.292236:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881547264 00000100:00100000:0.0:1787779883.292246:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881547264 00000100:00100000:0.0:1787779883.292316:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787779883.292328:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477942d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881547264:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787779883.292367:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787779883.292418:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477942d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881547264:12345-0@lo:13:osp-pre-1-1.0 Request processed in 93us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779883.292426:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:0.0:1787779883.292453:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787779883.292490:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c04779421c0 x1874622881547264/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779899 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787779883.292550:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04779421c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881547264:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787779883.303082:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04779421c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1f575176-36bc-4786-83ee-2fea064a12a9:3641:1874622881547392:0@lo:400:kworker.0 00000100:00100000:0.0:1787779883.303179:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779883.303228:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0476442d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881547904:0@lo:400:kworker.0 00000100:00100000:0.0:1787779883.303260:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779883.303282:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04764403c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881548416:0@lo:400:kworker.0 00000100:00100000:0.0:1787779883.303307:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779883.303335:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1787779883.303340:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477942580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874622881547520:0@lo:400:kworker.0 00000100:00100000:0.0:1787779883.303367:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779883.303386:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0476441e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1874622881548032:0@lo:400:kworker.0 00000100:00100000:0.0:1787779883.303404:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779883.303420:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0476440b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1874622881548544:0@lo:400:kworker.0 00000100:00100000:0.0:1787779883.303439:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779883.303479:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881547392 00000100:00100000:0.0:1787779883.303487:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881547392 00000100:00100000:0.0:1787779883.303557:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1787779883.303567:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471771050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+24:3641:x1874622881547392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787779883.303628:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471771050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+24:3641:x1874622881547392:12345-0@lo:400:kworker.0 Request processed in 62us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779883.303635:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1787779883.303677:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881547904 00000100:00100000:0.0:1787779883.303681:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881547904 00000100:00100000:0.0:1787779883.303710:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1787779883.303737:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0476440f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874622881547904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787779883.303785:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0476440f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874622881547904:12345-0@lo:400:kworker.0 Request processed in 50us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779883.303791:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1787779883.303812:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881548416 00000100:00100000:0.0:1787779883.303815:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881548416 00000100:00100000:0.0:1787779883.303888:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787779883.303896:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0476442940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874622881548416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787779883.303930:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0476442940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874622881548416:12345-0@lo:400:kworker.0 Request processed in 35us (622us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779883.303936:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787779883.303956:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881547520 00000100:00100000:0.0:1787779883.303959:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881547520 00000100:00100000:0.0:1787779883.303985:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881548032 00000100:00100000:0.0:1787779883.303987:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881548032 00000100:00100000:0.0:1787779883.304002:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881548544 00000100:00100000:0.0:1787779883.304004:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881548544 00000100:00100000:0.0:1787779883.304019:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1787779883.304024:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04764421c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874622881547520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787779883.304057:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04764421c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874622881547520:12345-0@lo:400:kworker.0 Request processed in 32us (688us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779883.304063:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1787779883.304074:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1787779883.304080:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04764412c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874622881548032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787779883.304132:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04764412c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874622881548032:12345-0@lo:400:kworker.0 Request processed in 52us (725us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779883.304138:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1787779883.304157:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1787779883.304163:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046efccb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1874622881548544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787779883.304192:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046efccb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1874622881548544:12345-0@lo:400:kworker.0 Request processed in 30us (752us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779883.304198:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1787779883.304242:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477941680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881547648:0@lo:400:kworker.0 00000100:00100000:0.0:1787779883.304270:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779883.304288:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0476441680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1874622881548160:0@lo:400:kworker.0 00000100:00100000:0.0:1787779883.304307:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779883.304323:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0476443840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1874622881548672:0@lo:400:kworker.0 00000100:00100000:0.0:1787779883.304344:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779883.304362:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1787779883.304369:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346d4e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874622881547776:0@lo:400:kworker.0 00000100:00100000:0.0:1787779883.304390:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779883.304407:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0476443480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881548288:0@lo:400:kworker.0 00000100:00100000:0.0:1787779883.304430:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779883.304447:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04764430c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881548800:0@lo:400:kworker.0 00000100:00100000:0.0:1787779883.304469:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779883.304494:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881548288 00000100:00100000:0.0:1787779883.304498:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881548288 00000100:00100000:0.0:1787779883.304536:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881548800 00000100:00100000:0.0:1787779883.304539:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881548800 00000100:00100000:0.0:1787779883.304559:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787779883.304566:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477af1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881548288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787779883.304607:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477af1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881548288:12345-0@lo:400:kworker.0 Request processed in 41us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779883.304622:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787779883.304636:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787779883.304642:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046215e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881548800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787779883.304673:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046215e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881548800:12345-0@lo:400:kworker.0 Request processed in 32us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779883.304678:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787779883.304700:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881548160 00000100:00100000:0.0:1787779883.304703:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881548160 00000100:00100000:0.0:1787779883.304721:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881548672 00000100:00100000:0.0:1787779883.304724:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881548672 00000100:00100000:0.0:1787779883.304734:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881547776 00000100:00100000:0.0:1787779883.304736:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881547776 00000100:00100000:0.0:1787779883.304747:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1787779883.304753:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046efce1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1874622881548160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787779883.304786:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046efce1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1874622881548160:12345-0@lo:400:kworker.0 Request processed in 33us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779883.304793:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1787779883.304804:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1787779883.304810:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477af1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1874622881548672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787779883.304876:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477af1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1874622881548672:12345-0@lo:400:kworker.0 Request processed in 27us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779883.304882:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1787779883.304894:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1787779883.304899:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477af0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1874622881547776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787779883.304925:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477af0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1874622881547776:12345-0@lo:400:kworker.0 Request processed in 26us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779883.304940:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00080000:0.0:1787779883.304962:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787779883.304969:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787779883.304971:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787779883.304974:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787779883.304994:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881547648 00000100:00100000:0.0:1787779883.304997:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881547648 00000100:00100000:0.0:1787779883.305019:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1787779883.305026:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046efcd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881547648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787779883.305057:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046efcd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881547648:12345-0@lo:400:kworker.0 Request processed in 32us (786us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779883.305063:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1787779883.305110:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346d4e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874622881547776:0@lo:400:kworker.0 00010000:00080000:0.0:1787779883.305126:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0476443480 x1874622881548288/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779899 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787779883.305138:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0476443480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881548288:0@lo:400:kworker.0 00010000:00080000:0.0:1787779883.305148:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c04764430c0 x1874622881548800/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779899 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787779883.305156:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04764430c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881548800:0@lo:400:kworker.0 00000100:00100000:0.0:1787779883.305166:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477941680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881547648:0@lo:400:kworker.0 00010000:00080000:0.0:1787779883.305175:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0476441680 x1874622881548160/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779899 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787779883.305183:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0476441680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1874622881548160:0@lo:400:kworker.0 00010000:00080000:0.0:1787779883.305192:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0476443840 x1874622881548672/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779899 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787779883.305208:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0476443840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1874622881548672:0@lo:400:kworker.0 00000100:00100000:0.0:1787779883.305265:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477942580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874622881547520:0@lo:400:kworker.0 00000100:00100000:0.0:1787779883.305278:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0476441e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1874622881548032:0@lo:400:kworker.0 00000100:00100000:0.0:1787779883.305288:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0476440b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1874622881548544:0@lo:400:kworker.0 00000100:00100000:0.0:1787779883.305299:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04779421c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1f575176-36bc-4786-83ee-2fea064a12a9:3641:1874622881547392:0@lo:400:kworker.0 00000100:00100000:0.0:1787779883.305310:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0476442d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881547904:0@lo:400:kworker.0 00010000:00080000:0.0:1787779883.305322:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c04764403c0 x1874622881548416/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779899 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787779883.305329:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04764403c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881548416:0@lo:400:kworker.0 00000100:00100000:2.0:1787779883.804071:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346dad680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881548928:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787779883.804170:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779883.804273:0:8529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881548928 00000100:00100000:2.0:1787779883.804283:0:8529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881548928 00000100:00100000:2.0:1787779883.804345:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787779883.804356:0:8529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346dad2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874622881548928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787779883.804386:0:8529:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787779883.804451:0:8529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346dad2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874622881548928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779883.804460:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:2.0:1787779883.804520:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0346dad680 x1874622881548928/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779899 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787779883.804543:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346dad680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881548928:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787779883.805604:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787779883.805622:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047796cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881549056:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787779883.805683:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779883.805755:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881549056 00000100:00100000:1.0:1787779883.805761:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881549056 00000100:00100000:1.0:1787779883.805806:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787779883.805814:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c047796c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881549056:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787779883.805860:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787779883.805915:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c047796c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881549056:12345-0@lo:13:osp-pre-0-1.0 Request processed in 100us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779883.805922:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:1.0:1787779883.805962:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c047796cf00 x1874622881549056/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779899 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787779883.805979:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047796cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881549056:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1787779884.125369:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787779884.318157:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047796cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881549184:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787779884.318259:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779884.318532:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881549184 00000100:00100000:1.0:1787779884.318542:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881549184 00000100:00100000:1.0:1787779884.318619:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787779884.318630:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04779421c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881549184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787779884.318663:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787779884.318727:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04779421c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881549184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779884.318735:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:1.0:1787779884.318783:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c047796cf00 x1874622881549184/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779900 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787779884.318804:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047796cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881549184:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787779884.438948:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787779884.439010:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787779884.439042:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787779884.439074:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863648896 00000100:00100000:2.0:1787779884.439087:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863648896 00000100:00100000:2.0:1787779884.439148:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 286 00000100:00100000:2.0:1787779884.439160:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471773050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+10:2408:x1874622863648896:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1787779884.439252:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471773050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+10:2408:x1874622863648896:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 94us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779884.439261:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 286 00000100:00100000:2.0:1787779884.439304:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863649152 00000100:00100000:2.0:1787779884.439308:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863649152 00000100:00100000:2.0:1787779884.440050:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863649024 00000100:00100000:2.0:1787779884.440058:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863649024 00000100:00100000:2.0:1787779884.440088:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 119 00000100:00100000:2.0:1787779884.440097:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346dad680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:2408:x1874622863649152:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1787779884.440150:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346dad680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:2408:x1874622863649152:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 55us (1139us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779884.440158:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 119 00000100:00100000:2.0:1787779884.440173:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 120 00000100:00100000:2.0:1787779884.440179:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346dac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+6:2408:x1874622863649024:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1787779884.440205:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346dac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+6:2408:x1874622863649024:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 26us (1163us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779884.440212:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 120 00000100:00080000:3.0:1787779884.440498:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787779884.440504:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1787779885.148304:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787779885.853475:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346dade00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881549312:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787779885.854851:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779885.855079:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881549312 00000100:00100000:1.0:1787779885.855095:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881549312 00000100:00100000:1.0:1787779885.858884:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787779885.858936:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347ebe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881549312:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787779885.858997:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1787779885.859133:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347ebe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881549312:12345-0@lo:41:osp-pre-0-1.0 Request processed in 211us (4296us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779885.859141:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1787779885.859283:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346dade00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881549312:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787779886.173023:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787779886.364392:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787779886.364416:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047796cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881549440:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787779886.364482:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779886.368790:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881549440 00000100:00100000:3.0:1787779886.368805:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881549440 00000100:00100000:3.0:1787779886.369033:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1787779886.369097:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477942580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1874622881549440:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787779886.369133:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787779886.369770:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477942580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1874622881549440:12345-0@lo:41:osp-pre-1-0.0 Request processed in 674us (5286us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779886.369779:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1787779886.369930:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047796cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881549440:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787779887.203474:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787779888.226081:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787779888.417689:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347ebda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874622881549568:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787779888.417913:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779888.419411:0:8529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881549568 00000100:00100000:1.0:1787779888.419428:0:8529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881549568 00000100:00100000:1.0:1787779888.419527:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787779888.419540:0:8529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347ebf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1874622881549568:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787779888.419584:0:8529:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787779888.419685:0:8529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347ebf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1874622881549568:12345-0@lo:13:osp-pre-1-1.0 Request processed in 149us (1772us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779888.419694:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:3.0:1787779888.419707:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1787779888.419828:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0347ebda40 x1874622881549568/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779904 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779888.419874:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347ebda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874622881549568:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787779888.419901:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787779888.419915:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346daf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1874622881550080:0@lo:400:kworker.0 00000100:00100000:3.0:1787779888.419963:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779888.420013:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346dae940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1f575176-36bc-4786-83ee-2fea064a12a9:3643:1874622881549696:0@lo:400:kworker.0 00000100:00100000:2.0:1787779888.420056:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779888.420105:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346dade00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881550208:0@lo:400:kworker.0 00000100:00100000:2.0:1787779888.420135:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779888.420388:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346dacb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874622881549952:0@lo:400:kworker.0 00000100:00100000:3.0:1787779888.420578:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881550080 00000100:00100000:3.0:1787779888.420586:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881550080 00000100:00100000:3.0:1787779888.420875:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1787779888.420886:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347ebda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1874622881550080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779888.420943:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347ebda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1874622881550080:12345-0@lo:400:kworker.0 Request processed in 59us (980us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779888.420958:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1787779888.421518:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346da52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1874622881550464:0@lo:400:kworker.0 00000100:00100000:3.0:1787779888.421565:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779888.421598:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346da5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1874622881550976:0@lo:400:kworker.0 00000100:00100000:3.0:1787779888.421706:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779888.421892:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787779888.421900:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346da4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881550592:0@lo:400:kworker.0 00000100:00100000:3.0:1787779888.421936:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779888.421961:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346da43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881551104:0@lo:400:kworker.0 00000100:00100000:3.0:1787779888.422512:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779888.422566:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881550464 00000100:00100000:3.0:1787779888.422575:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881550464 00000100:00100000:3.0:1787779888.422824:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881550976 00000100:00100000:3.0:1787779888.422829:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881550976 00000100:00100000:3.0:1787779888.422882:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1787779888.422892:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347ebfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1874622881550464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779888.422961:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347ebfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1874622881550464:12345-0@lo:400:kworker.0 Request processed in 70us (1396us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779888.422969:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1787779888.423358:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346da6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881550720:0@lo:400:kworker.0 00000100:00100000:2.0:1787779888.423401:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779888.423429:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1787779888.423437:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346daed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1874622881549824:0@lo:400:kworker.0 00000100:00100000:2.0:1787779888.423465:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779888.423486:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346da70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1874622881550336:0@lo:400:kworker.0 00000100:00100000:3.0:1787779888.423510:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881549824 00000100:00100000:2.0:1787779888.423515:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779888.423517:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881549824 00000100:00100000:2.0:1787779888.423534:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346da7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1874622881550848:0@lo:400:kworker.0 00000100:00100000:3.0:1787779888.423537:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881550336 00000100:00100000:3.0:1787779888.423541:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881550336 00000100:00100000:2.0:1787779888.423563:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779888.423568:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1787779888.423578:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347ebde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1874622881550976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779888.423602:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881549696 00000100:00100000:2.0:1787779888.423608:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881549696 00000100:00100000:2.0:1787779888.423645:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1787779888.423652:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471770850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+24:3643:x1874622881549696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779888.423695:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471770850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+24:3643:x1874622881549696:12345-0@lo:400:kworker.0 Request processed in 43us (3638us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779888.423702:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1787779888.423752:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881550592 00000100:00100000:2.0:1787779888.423757:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881550592 00000100:00100000:2.0:1787779888.423784:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881551104 00000100:00100000:2.0:1787779888.423787:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881551104 00000100:00100000:2.0:1787779888.423804:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881550720 00000100:00100000:2.0:1787779888.423806:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881550720 00000100:00100000:2.0:1787779888.423820:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787779888.423827:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347ebc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881550592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779888.423885:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347ebde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1874622881550976:12345-0@lo:400:kworker.0 Request processed in 307us (2177us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779888.423891:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347ebc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881550592:12345-0@lo:400:kworker.0 Request processed in 63us (1954us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779888.423919:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1787779888.423920:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787779888.423939:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881550848 00000100:00100000:2.0:1787779888.423944:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787779888.423945:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881550848 00000100:00100000:2.0:1787779888.423953:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347ebc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874622881551104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779888.423971:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1787779888.423997:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347ebc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874622881551104:12345-0@lo:400:kworker.0 Request processed in 46us (1486us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779888.424003:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787779888.424015:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787779888.424020:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346da4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881550720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779888.424045:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346da4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881550720:12345-0@lo:400:kworker.0 Request processed in 25us (644us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779888.424050:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787779888.424095:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346dae940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1f575176-36bc-4786-83ee-2fea064a12a9:3643:1874622881549696:0@lo:400:kworker.0 00010000:00080000:2.0:1787779888.424113:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0346da6940 x1874622881550720/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779904 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787779888.424125:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346da6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881550720:0@lo:400:kworker.0 00000100:00100000:1.0:1787779888.424364:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881550208 00000100:00100000:1.0:1787779888.424370:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881550208 00000100:00100000:1.0:1787779888.424407:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787779888.424414:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346da4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881550208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787779888.424455:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346da4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881550208:12345-0@lo:400:kworker.0 Request processed in 42us (4319us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779888.424461:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787779888.424493:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346da6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1874622881549824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779888.424533:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346da6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1874622881549824:12345-0@lo:400:kworker.0 Request processed in 555us (1067us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779888.424540:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1787779888.424555:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1787779888.424561:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346da5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1874622881550336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779888.424593:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346da5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1874622881550336:12345-0@lo:400:kworker.0 Request processed in 31us (1078us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779888.424599:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1787779888.424617:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1787779888.424623:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346da7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1874622881550848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779888.424648:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346da7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1874622881550848:12345-0@lo:400:kworker.0 Request processed in 26us (1087us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779888.424653:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00080000:3.0:1787779888.424689:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787779888.424694:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787779888.424697:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787779888.424699:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1787779888.424921:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0346da4b40 x1874622881550592/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779904 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779888.424936:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346da4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881550592:0@lo:400:kworker.0 00010000:00080000:3.0:1787779888.424965:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0346da43c0 x1874622881551104/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779904 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779888.424974:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346da43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881551104:0@lo:400:kworker.0 00010000:00080000:3.0:1787779888.425500:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0346da52c0 x1874622881550464/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779904 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779888.425511:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346da52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1874622881550464:0@lo:400:kworker.0 00010000:00080000:3.0:1787779888.425526:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0346da5680 x1874622881550976/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779904 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779888.425534:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346da5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1874622881550976:0@lo:400:kworker.0 00000100:00100000:3.0:1787779888.425581:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779888.425635:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346daf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1874622881550080:0@lo:400:kworker.0 00000100:00100000:1.0:1787779888.426394:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881549952 00000100:00100000:1.0:1787779888.426404:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881549952 00000100:00100000:1.0:1787779888.426464:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787779888.426472:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046c82c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1874622881549952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779888.426628:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346dacb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874622881549952:0@lo:400:kworker.0 00000100:00100000:1.0:1787779888.426825:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046c82c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1874622881549952:12345-0@lo:400:kworker.0 Request processed in 118us (1008us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779888.426922:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1787779888.428315:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346daed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1874622881549824:0@lo:400:kworker.0 00000100:00100000:2.0:1787779888.428340:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346da70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1874622881550336:0@lo:400:kworker.0 00000100:00100000:2.0:1787779888.428354:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346da7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1874622881550848:0@lo:400:kworker.0 00000100:00100000:2.0:1787779888.428368:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346dade00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881550208:0@lo:400:kworker.0 00000100:00100000:0.0:1787779888.924092:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787779888.924128:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047796fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881551232:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787779888.924228:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779888.924518:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881551232 00000100:00100000:1.0:1787779888.924529:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881551232 00000100:00100000:1.0:1787779888.924613:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787779888.924624:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477941680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881551232:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787779888.924663:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787779888.924735:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477941680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881551232:12345-0@lo:13:osp-pre-0-1.0 Request processed in 113us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779888.924744:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:1.0:1787779888.924793:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c047796fc00 x1874622881551232/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779904 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787779888.924816:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047796fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881551232:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787779888.924971:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477943840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881551360:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787779888.925018:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779888.925084:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881551360 00000100:00100000:1.0:1787779888.925090:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881551360 00000100:00100000:1.0:1787779888.925127:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787779888.925134:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477943480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881551360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787779888.925148:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787779888.925184:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477943480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881551360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 49us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779888.925189:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:0.0:1787779888.925320:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0477943840 x1874622881551360/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779904 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787779888.925334:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477943840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881551360:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787779889.246724:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787779889.438162:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787779889.438207:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477943840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881551488:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787779889.438307:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779889.438651:0:8529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881551488 00000100:00100000:0.0:1787779889.438662:0:8529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881551488 00000100:00100000:0.0:1787779889.438733:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787779889.438745:0:8529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346da7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1874622881551488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787779889.438776:0:8529:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787779889.438873:0:8529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346da7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1874622881551488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 129us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779889.438882:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:3.0:1787779889.439052:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0477943840 x1874622881551488/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779905 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779889.439076:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477943840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881551488:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787779889.557806:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787779889.557891:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787779889.557922:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787779889.557958:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863649536 00000100:00100000:3.0:1787779889.557971:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863649536 00000100:00100000:3.0:1787779889.558047:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863649408 00000100:00100000:3.0:1787779889.558051:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863649408 00000100:00100000:3.0:1787779889.558091:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 127 00000100:00100000:3.0:1787779889.558112:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347ebf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:2409:x1874622863649536:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1787779889.558563:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347ebf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:2409:x1874622863649536:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 454us (670us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779889.558574:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 127 00000100:00100000:3.0:1787779889.558599:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 128 00000100:00100000:3.0:1787779889.558607:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347ebed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+6:2409:x1874622863649408:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1787779889.558635:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347ebed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+6:2409:x1874622863649408:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 29us (712us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779889.558641:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 128 00000100:00080000:3.0:1787779889.558667:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787779889.558672:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787779889.560248:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863649280 00000100:00100000:1.0:1787779889.560267:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863649280 00000100:00100000:1.0:1787779889.560357:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 288 00000100:00100000:1.0:1787779889.560387:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471773450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+10:2409:x1874622863649280:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1787779889.560463:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471773450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+10:2409:x1874622863649280:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 79us (2671us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779889.560484:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 288 00010000:00010000:1.0:1787779890.271108:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787779890.973101:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347ebcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874622881551616:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787779890.975090:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779890.975710:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881551616 00000100:00100000:3.0:1787779890.975722:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881551616 00000100:00100000:3.0:1787779890.975785:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1787779890.975798:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477942580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1874622881551616:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787779890.975865:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787779890.975941:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477942580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1874622881551616:12345-0@lo:41:osp-pre-0-1.0 Request processed in 148us (858us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779890.975950:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787779890.976084:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347ebcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874622881551616:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787779891.293139:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787779891.484097:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047796fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881551744:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787779891.484196:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779891.484327:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881551744 00000100:00100000:1.0:1787779891.484401:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881551744 00000100:00100000:1.0:1787779891.484476:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1787779891.484690:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477940000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881551744:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787779891.484801:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787779891.484895:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477940000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881551744:12345-0@lo:41:osp-pre-1-0.0 Request processed in 408us (698us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779891.484903:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787779891.485339:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047796fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881551744:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1787779892.317100:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787779893.342808:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787779893.532929:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047796fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881551872:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787779893.533026:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779893.533128:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881551872 00000100:00100000:1.0:1787779893.533138:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881551872 00000100:00100000:1.0:1787779893.533383:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787779893.533397:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c047796cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881551872:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787779893.533438:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787779893.533503:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c047796cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881551872:12345-0@lo:13:osp-pre-1-1.0 Request processed in 110us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779893.533511:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:1.0:1787779893.533537:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1787779893.533673:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c047796fc00 x1874622881551872/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779909 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787779893.533723:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047796fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881551872:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787779893.540136:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0476442580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1874622881552128:0@lo:400:kworker.0 00000100:00100000:0.0:1787779893.540491:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779893.540560:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0476442d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1874622881552640:0@lo:400:kworker.0 00000100:00100000:0.0:1787779893.540589:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779893.540613:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0476441680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1874622881553152:0@lo:400:kworker.0 00000100:00100000:0.0:1787779893.540637:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779893.540666:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1787779893.540673:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477943840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1f575176-36bc-4786-83ee-2fea064a12a9:3642:1874622881552000:0@lo:400:kworker.0 00000100:00100000:1.0:1787779893.541037:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881552128 00000100:00100000:1.0:1787779893.541047:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881552128 00000100:00100000:1.0:1787779893.541108:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881552640 00000100:00100000:1.0:1787779893.541112:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881552640 00000100:00100000:1.0:1787779893.541137:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881553152 00000100:00100000:1.0:1787779893.541140:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881553152 00000100:00100000:1.0:1787779893.541160:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1787779893.541171:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346d4f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1874622881552128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787779893.541254:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346d4f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1874622881552128:12345-0@lo:400:kworker.0 Request processed in 85us (765us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779893.541262:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1787779893.541282:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1787779893.541288:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346d4e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1874622881552640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787779893.541317:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346d4e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1874622881552640:12345-0@lo:400:kworker.0 Request processed in 30us (728us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779893.541322:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1787779893.541333:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1787779893.541339:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346d4c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1874622881553152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787779893.541367:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346d4c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1874622881553152:12345-0@lo:400:kworker.0 Request processed in 28us (729us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779893.541373:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00080000:1.0:1787779893.541392:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787779893.541581:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779893.541611:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04764403c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881552512:0@lo:400:kworker.0 00000100:00100000:0.0:1787779893.541641:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779893.541663:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0476443840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881553024:0@lo:400:kworker.0 00000100:00100000:0.0:1787779893.542273:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779893.543380:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0476442580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1874622881552128:0@lo:400:kworker.0 00000100:00100000:0.0:1787779893.543400:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0476442d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1874622881552640:0@lo:400:kworker.0 00000100:00100000:0.0:1787779893.543411:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0476441680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1874622881553152:0@lo:400:kworker.0 00000100:00100000:0.0:1787779893.543490:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0476440000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881552256:0@lo:400:kworker.0 00000100:00100000:0.0:1787779893.543555:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779893.543586:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0476440b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1874622881552768:0@lo:400:kworker.0 00000100:00100000:0.0:1787779893.543612:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779893.543633:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04764430c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1874622881553280:0@lo:400:kworker.0 00000100:00100000:0.0:1787779893.543656:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779893.543685:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1787779893.543693:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0476440f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874622881552384:0@lo:400:kworker.0 00000100:00100000:0.0:1787779893.543715:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779893.543727:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0476441e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881552896:0@lo:400:kworker.0 00000100:00100000:0.0:1787779893.543749:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779893.543870:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881552000 00000100:00100000:1.0:1787779893.543878:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881552000 00000100:00100000:1.0:1787779893.543936:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:1.0:1787779893.543962:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471772850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+24:3642:x1874622881552000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787779893.544023:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471772850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+24:3642:x1874622881552000:12345-0@lo:400:kworker.0 Request processed in 64us (2442us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779893.544031:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:1.0:1787779893.548092:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881552512 00000100:00100000:1.0:1787779893.548115:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881552512 00000100:00100000:1.0:1787779893.548264:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881552256 00000100:00100000:1.0:1787779893.548269:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881552256 00000100:00100000:1.0:1787779893.548293:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1787779893.548305:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346d4da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1874622881552512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787779893.548423:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346d4da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1874622881552512:12345-0@lo:400:kworker.0 Request processed in 120us (6781us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779893.548431:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1787779893.548461:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1787779893.548467:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346d4d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881552256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787779893.548496:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346d4d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881552256:12345-0@lo:400:kworker.0 Request processed in 29us (4942us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779893.548501:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1787779893.548521:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881552768 00000100:00100000:1.0:1787779893.548526:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881552768 00000100:00100000:1.0:1787779893.548556:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881553280 00000100:00100000:1.0:1787779893.548558:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881553280 00000100:00100000:1.0:1787779893.548571:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881552384 00000100:00100000:1.0:1787779893.548573:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881552384 00000100:00100000:1.0:1787779893.548585:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1787779893.548591:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346d4e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1874622881552768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787779893.548624:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346d4e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1874622881552768:12345-0@lo:400:kworker.0 Request processed in 34us (5011us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779893.548636:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1787779893.548647:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1787779893.548651:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0476441680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1874622881553280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787779893.548677:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0476441680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1874622881553280:12345-0@lo:400:kworker.0 Request processed in 26us (5021us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779893.550096:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1787779893.550137:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1787779893.550154:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0476442d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1874622881552384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787779893.550319:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0476442d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1874622881552384:12345-0@lo:400:kworker.0 Request processed in 173us (6602us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779893.550326:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00080000:1.0:1787779893.550371:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787779893.558286:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0476443480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881553408:0@lo:400:kworker.0 00000100:00100000:0.0:1787779893.558379:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779893.558520:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881553024 00000100:00100000:2.0:1787779893.558532:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881553024 00000100:00080000:2.0:1787779893.558666:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787779893.558735:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881552896 00000100:00100000:2.0:1787779893.558739:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881552896 00000100:00100000:2.0:1787779893.558768:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787779893.558779:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346d4f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3642:x1874622881553024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779893.558882:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346d4f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3642:x1874622881553024:12345-0@lo:400:kworker.0 Request processed in 105us (16610us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779893.558890:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787779893.558908:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787779893.558916:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0476442580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881552896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779893.558944:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0476442580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881552896:12345-0@lo:400:kworker.0 Request processed in 30us (15195us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779893.558949:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:2.0:1787779893.558962:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787779893.565965:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0476440000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881552256:0@lo:400:kworker.0 00010000:00080000:0.0:1787779893.566012:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0476440b40 x1874622881552768/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779909 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787779893.566026:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0476440b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1874622881552768:0@lo:400:kworker.0 00010000:00080000:0.0:1787779893.566041:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c04764430c0 x1874622881553280/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779909 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787779893.566051:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04764430c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1874622881553280:0@lo:400:kworker.0 00000100:00100000:0.0:1787779893.566105:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0476440f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874622881552384:0@lo:400:kworker.0 00010000:00080000:0.0:1787779893.566119:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0476441e00 x1874622881552896/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779909 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787779893.566129:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0476441e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881552896:0@lo:400:kworker.0 00000100:00100000:0.0:1787779893.566198:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477943840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1f575176-36bc-4786-83ee-2fea064a12a9:3642:1874622881552000:0@lo:400:kworker.0 00000100:00100000:0.0:1787779893.566213:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04764403c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881552512:0@lo:400:kworker.0 00010000:00080000:0.0:1787779893.566225:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0476443840 x1874622881553024/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779909 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787779893.566234:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0476443840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881553024:0@lo:400:kworker.0 00000100:00100000:3.0:1787779893.570914:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881553408 00000100:00100000:3.0:1787779893.570937:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881553408 00000100:00080000:0.0:1787779893.571041:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787779893.571044:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787779893.571056:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346efcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881553408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779893.571379:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346efcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881553408:12345-0@lo:400:kworker.0 Request processed in 324us (12999us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779893.571409:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:0.0:1787779893.571554:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0476443480 x1874622881553408/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779909 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787779893.571573:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0476443480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881553408:0@lo:400:kworker.0 00000100:00100000:1.0:1787779894.045538:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787779894.045576:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047796fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874622881553536:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787779894.045675:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779894.046289:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881553536 00000100:00100000:2.0:1787779894.046300:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881553536 00000100:00100000:2.0:1787779894.046361:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787779894.046372:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c047796e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1874622881553536:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787779894.046413:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787779894.046484:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c047796e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1874622881553536:12345-0@lo:13:osp-pre-0-1.0 Request processed in 114us (810us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779894.046492:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:1.0:1787779894.047068:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c047796fc00 x1874622881553536/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779910 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787779894.047101:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047796fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874622881553536:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787779894.047969:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346da7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881553664:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787779894.048058:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779894.048219:0:8529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881553664 00000100:00100000:2.0:1787779894.048229:0:8529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881553664 00000100:00100000:2.0:1787779894.048287:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787779894.048309:0:8529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c047796fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1874622881553664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787779894.048335:0:8529:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787779894.048390:0:8529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c047796fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1874622881553664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779894.048398:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00080000:1.0:1787779894.048490:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0346da7c00 x1874622881553664/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779910 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787779894.048507:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346da7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881553664:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787779894.370092:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787779894.565869:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346eff0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881553792:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787779894.565962:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779894.566097:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881553792 00000100:00100000:0.0:1787779894.566106:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881553792 00000100:00100000:0.0:1787779894.566192:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787779894.566202:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347ebe1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881553792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787779894.566233:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787779894.566454:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347ebe1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881553792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 253us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779894.566463:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:0.0:1787779894.566512:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0346eff0c0 x1874622881553792/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779910 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787779894.566534:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346eff0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881553792:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787779894.678157:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787779894.678212:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787779894.678351:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863649792 00000100:00100000:3.0:1787779894.678370:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863649792 00000100:00100000:0.0:1787779894.678551:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787779894.678592:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863649664 00000100:00100000:0.0:1787779894.678602:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863649664 00000100:00100000:0.0:1787779894.678653:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 290 00000100:00100000:0.0:1787779894.678663:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471773c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+10:2409:x1874622863649664:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1787779894.678885:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863649920 00000100:00100000:3.0:1787779894.678892:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863649920 00000100:00100000:3.0:1787779894.678936:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 135 00000100:00100000:3.0:1787779894.678947:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346eff0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+6:2409:x1874622863649792:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1787779894.679335:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346eff0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+6:2409:x1874622863649792:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 388us (1187us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779894.679345:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 135 00000100:00100000:3.0:1787779894.679370:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 136 00000100:00100000:3.0:1787779894.679378:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346efc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:2409:x1874622863649920:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1787779894.682132:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471773c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+10:2409:x1874622863649664:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 3457us (3905us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779894.682148:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 290 00000100:00100000:3.0:1787779894.691978:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346efc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:2409:x1874622863649920:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 12583us (13410us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779894.692000:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 136 00000100:00080000:3.0:1787779894.692075:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787779894.692082:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787779895.417026:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787779896.092608:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347ebc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881553920:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787779896.092698:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779896.093010:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881553920 00000100:00100000:3.0:1787779896.093017:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881553920 00000100:00100000:3.0:1787779896.093068:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787779896.093077:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c047796de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881553920:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787779896.093111:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787779896.093178:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c047796de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881553920:12345-0@lo:41:osp-pre-0-1.0 Request processed in 102us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779896.093193:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1787779896.093476:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347ebc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881553920:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1787779896.476873:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787779896.604134:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047796d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881554048:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787779896.604204:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779896.604462:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881554048 00000100:00100000:1.0:1787779896.604470:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881554048 00000100:00100000:1.0:1787779896.604519:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1787779896.604528:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347ebe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874622881554048:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787779896.604558:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787779896.604641:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347ebe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874622881554048:12345-0@lo:41:osp-pre-1-0.0 Request processed in 114us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779896.604649:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787779896.604706:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047796d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881554048:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787779897.503275:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787779898.524320:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787779898.654607:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347ebcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874622881554176:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787779898.654711:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779898.654826:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881554176 00000100:00100000:3.0:1787779898.654859:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881554176 00000100:00100000:3.0:1787779898.654928:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787779898.654953:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346dade00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1874622881554176:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787779898.654995:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787779898.655049:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346dade00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1874622881554176:12345-0@lo:13:osp-pre-1-1.0 Request processed in 100us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779898.655057:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:3.0:1787779898.655083:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1787779898.655124:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0347ebcf00 x1874622881554176/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779914 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779898.655146:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347ebcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874622881554176:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787779898.655770:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346da5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874622881554432:0@lo:400:kworker.0 00000100:00100000:2.0:1787779898.655882:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779898.655916:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346da7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1874622881554944:0@lo:400:kworker.0 00000100:00100000:2.0:1787779898.655954:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779898.655971:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346da52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1874622881555456:0@lo:400:kworker.0 00000100:00100000:2.0:1787779898.655992:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779898.656011:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1787779898.656017:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346da6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1f575176-36bc-4786-83ee-2fea064a12a9:3644:1874622881554304:0@lo:400:kworker.0 00000100:00100000:2.0:1787779898.656047:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779898.656075:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346da61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881554816:0@lo:400:kworker.0 00000100:00100000:2.0:1787779898.656102:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779898.656121:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346da5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881555328:0@lo:400:kworker.0 00000100:00100000:2.0:1787779898.656149:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779898.656184:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881554432 00000100:00100000:2.0:1787779898.656191:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881554432 00000100:00100000:2.0:1787779898.656231:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881554944 00000100:00100000:2.0:1787779898.656234:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881554944 00000100:00100000:2.0:1787779898.656256:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881555456 00000100:00100000:2.0:1787779898.656267:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881555456 00000100:00100000:2.0:1787779898.656290:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1787779898.656299:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347ee3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874622881554432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779898.656533:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347ee3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874622881554432:12345-0@lo:400:kworker.0 Request processed in 234us (650us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779898.656541:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1787779898.656559:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1787779898.656566:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347ee1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1874622881554944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779898.656595:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347ee1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1874622881554944:12345-0@lo:400:kworker.0 Request processed in 31us (641us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779898.656601:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1787779898.656614:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1787779898.656620:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347ee03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1874622881555456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779898.656649:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347ee03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1874622881555456:12345-0@lo:400:kworker.0 Request processed in 30us (655us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779898.656654:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1787779898.656677:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881554304 00000100:00100000:2.0:1787779898.656680:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881554304 00000100:00100000:2.0:1787779898.656711:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:2.0:1787779898.656718:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471772c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+24:3644:x1874622881554304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779898.656749:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471772c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+24:3644:x1874622881554304:12345-0@lo:400:kworker.0 Request processed in 31us (701us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779898.656755:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:2.0:1787779898.656784:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881554816 00000100:00100000:2.0:1787779898.656788:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881554816 00000100:00100000:2.0:1787779898.656825:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787779898.656832:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347ee0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881554816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779898.656902:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347ee0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881554816:12345-0@lo:400:kworker.0 Request processed in 71us (800us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779898.656908:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787779898.656928:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881555328 00000100:00100000:2.0:1787779898.656938:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881555328 00000100:00100000:2.0:1787779898.656967:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787779898.656973:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347ee0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881555328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779898.657005:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347ee0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881555328:12345-0@lo:400:kworker.0 Request processed in 33us (856us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779898.657011:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787779898.657051:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346da6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1f575176-36bc-4786-83ee-2fea064a12a9:3644:1874622881554304:0@lo:400:kworker.0 00000100:00100000:2.0:1787779898.657065:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346da61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881554816:0@lo:400:kworker.0 00010000:00080000:2.0:1787779898.657080:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0346da5680 x1874622881555328/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779914 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787779898.657092:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346da5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881555328:0@lo:400:kworker.0 00000100:00100000:2.0:1787779898.657104:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346da5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874622881554432:0@lo:400:kworker.0 00000100:00100000:2.0:1787779898.657115:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346da7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1874622881554944:0@lo:400:kworker.0 00000100:00100000:2.0:1787779898.657127:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346da52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1874622881555456:0@lo:400:kworker.0 00000100:00100000:3.0:1787779898.657665:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346da4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881554560:0@lo:400:kworker.0 00000100:00100000:3.0:1787779898.657725:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779898.657759:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346da70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1874622881555072:0@lo:400:kworker.0 00000100:00100000:3.0:1787779898.657787:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779898.657806:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346da43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1874622881555584:0@lo:400:kworker.0 00000100:00100000:3.0:1787779898.657880:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779898.657907:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1787779898.657914:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346da6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874622881554688:0@lo:400:kworker.0 00000100:00080000:2.0:1787779898.658243:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787779898.658251:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787779898.658266:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881554560 00000100:00100000:2.0:1787779898.658273:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881554560 00000100:00100000:3.0:1787779898.658575:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779898.658601:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346da4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881555200:0@lo:400:kworker.0 00000100:00100000:3.0:1787779898.658631:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779898.658650:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346da4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881555712:0@lo:400:kworker.0 00000100:00100000:3.0:1787779898.658673:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779898.658706:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881555200 00000100:00100000:3.0:1787779898.658710:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881555200 00000100:00100000:3.0:1787779898.658764:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881555712 00000100:00100000:3.0:1787779898.658767:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881555712 00000100:00100000:3.0:1787779898.658791:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787779898.658799:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346daf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881555200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779898.659116:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346daf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881555200:12345-0@lo:400:kworker.0 Request processed in 316us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779898.659125:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787779898.659143:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787779898.659149:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347ebcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1874622881555712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779898.659177:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347ebcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1874622881555712:12345-0@lo:400:kworker.0 Request processed in 29us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779898.659182:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787779898.659205:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881555072 00000100:00100000:3.0:1787779898.659209:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881555072 00000100:00100000:3.0:1787779898.659236:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881555584 00000100:00100000:3.0:1787779898.659239:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881555584 00000100:00100000:3.0:1787779898.659251:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881554688 00000100:00100000:3.0:1787779898.659265:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881554688 00000100:00100000:3.0:1787779898.659285:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1787779898.659292:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346dae940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1874622881555072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779898.659326:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346dae940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1874622881555072:12345-0@lo:400:kworker.0 Request processed in 35us (1538us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779898.662730:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787779898.662764:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346daed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881554560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779898.663958:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1787779898.664007:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1787779898.664023:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346daf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1874622881555584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779898.664145:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346daf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1874622881555584:12345-0@lo:400:kworker.0 Request processed in 130us (6264us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779898.664152:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1787779898.664165:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1787779898.664172:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346dacb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874622881554688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779898.664211:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346dacb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874622881554688:12345-0@lo:400:kworker.0 Request processed in 40us (5637us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779898.664218:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00080000:3.0:1787779898.664267:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787779898.664275:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787779898.664278:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787779898.664448:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346da6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874622881554688:0@lo:400:kworker.0 00010000:00080000:3.0:1787779898.664469:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0346da4f00 x1874622881555200/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779914 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779898.664482:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346da4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881555200:0@lo:400:kworker.0 00010000:00080000:3.0:1787779898.664496:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0346da4b40 x1874622881555712/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779914 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779898.664526:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346da4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881555712:0@lo:400:kworker.0 00010000:00080000:3.0:1787779898.664543:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0346da70c0 x1874622881555072/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779914 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779898.664551:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346da70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1874622881555072:0@lo:400:kworker.0 00010000:00080000:3.0:1787779898.664563:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0346da43c0 x1874622881555584/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779914 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779898.664572:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346da43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1874622881555584:0@lo:400:kworker.0 00000100:00100000:2.0:1787779898.664734:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346daed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881554560:12345-0@lo:400:kworker.0 Request processed in 1989us (7007us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779898.664743:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787779898.672059:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346da4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881554560:0@lo:400:kworker.0 00000001:02000400:0.0:1787779899.147209:0:11988:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 17:31:37 (1787779897) === 00000100:00100000:1.0:1787779899.164076:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787779899.164109:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047796cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881555840:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787779899.164207:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779899.164305:0:8529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881555840 00000100:00100000:1.0:1787779899.164315:0:8529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881555840 00000100:00100000:1.0:1787779899.164376:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787779899.164385:0:8529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c047796d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881555840:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787779899.164437:0:8529:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787779899.164488:0:8529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c047796d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881555840:12345-0@lo:13:osp-pre-0-1.0 Request processed in 104us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779899.164496:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:1.0:1787779899.164548:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c047796cf00 x1874622881555840/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779915 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787779899.164570:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047796cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881555840:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787779899.165809:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787779899.165867:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347ee2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881555968:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787779899.165944:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779899.166459:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881555968 00000100:00100000:2.0:1787779899.166469:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881555968 00000100:00100000:2.0:1787779899.166532:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787779899.166544:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347e57c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881555968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787779899.166572:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787779899.166628:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347e57c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881555968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (684us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779899.166635:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00080000:3.0:1787779899.166717:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0347ee2580 x1874622881555968/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779915 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779899.166740:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347ee2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881555968:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787779899.548878:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787779899.676251:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346efe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881556096:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787779899.676345:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779899.676538:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881556096 00000100:00100000:1.0:1787779899.676549:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881556096 00000100:00100000:1.0:1787779899.676650:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787779899.676672:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347e55e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874622881556096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787779899.676709:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787779899.676791:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347e55e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874622881556096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 130us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779899.676800:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00080000:0.0:1787779899.677362:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0346efe1c0 x1874622881556096/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779915 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787779899.677388:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346efe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881556096:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787779899.799936:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787779899.800184:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787779899.800230:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787779899.800270:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863650176 00000100:00100000:3.0:1787779899.800283:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863650176 00000100:00100000:3.0:1787779899.800361:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863650304 00000100:00100000:3.0:1787779899.800365:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863650304 00000100:00100000:3.0:1787779899.800425:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 143 00000100:00100000:3.0:1787779899.800436:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347e54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+6:2409:x1874622863650176:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1787779899.801118:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863650048 00000100:00100000:0.0:1787779899.801127:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863650048 00000100:00100000:0.0:1787779899.801170:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 292 00000100:00100000:0.0:1787779899.801179:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471773850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+10:8761:x1874622863650048:12345-192.168.203.31@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787779899.801194:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787779899.801217:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0477869e00/0xc8fc0a5179960757 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xf757128131ea1ce2 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779899.801250:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0477869e00/0xc8fc0a5179960757 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1ce2 expref: 11 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779899.801263:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0477869e00/0xc8fc0a5179960757 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1ce2 expref: 11 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779899.801274:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0477869e00, rc 0) 00000100:00100000:3.0:1787779899.801346:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347e54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+6:2409:x1874622863650176:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 910us (1161us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779899.801355:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 143 00000100:00100000:3.0:1787779899.801378:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 144 00000100:00100000:3.0:1787779899.801385:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347e56d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:2409:x1874622863650304:12345-192.168.203.31@tcp:400:kworker.0 00000100:00080000:2.0:1787779899.803712:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787779899.803726:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787779899.807721:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471773850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+11:8761:x1874622863650048:12345-192.168.203.31@tcp:101:mount.lustre.0 Request processed in 6521us (7782us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779899.807739:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 292 00000100:00100000:2.0:1787779899.825363:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347e56d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:2409:x1874622863650304:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 23947us (25101us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779899.825383:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 144 00000100:00100000:0.0:1787779899.849520:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787779899.849666:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863650432 00000100:00100000:2.0:1787779899.849680:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863650432 00000100:00100000:2.0:1787779899.849761:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 293 00000100:00100000:2.0:1787779899.849773:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046098c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+11:8761:x1874622863650432:12345-192.168.203.31@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787779899.850037:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046098c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+11:8761:x1874622863650432:12345-192.168.203.31@tcp:501:mount.lustre.0 Request processed in 264us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779899.850047:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 293 00000100:00100000:0.0:1787779899.861560:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787779899.862214:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863650560 00000100:00100000:1.0:1787779899.862229:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863650560 00000100:00100000:1.0:1787779899.862313:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 294 00000100:00100000:1.0:1787779899.862324:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046098e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+11:8761:x1874622863650560:12345-192.168.203.31@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787779899.862539:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046098e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+11:8761:x1874622863650560:12345-192.168.203.31@tcp:503:mount.lustre.0 Request processed in 215us (995us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779899.862547:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 294 00000100:00100000:3.0:1787779899.869499:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787779899.874815:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863650688 00000100:00100000:0.0:1787779899.874889:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863650688 00000100:00100000:0.0:1787779899.874984:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 295 00000100:00100000:0.0:1787779899.875000:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046098d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+11:8765:x1874622863650688:12345-192.168.203.31@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787779899.875272:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046098d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+11:8765:x1874622863650688:12345-192.168.203.31@tcp:502:llog_process_th.0 Request processed in 276us (5789us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779899.875281:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 295 00000100:00100000:0.0:1787779899.919374:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787779899.919501:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863650816 00000100:00100000:1.0:1787779899.919515:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863650816 00000100:00100000:1.0:1787779899.919585:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 296 00000100:00100000:1.0:1787779899.919599:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046098d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+11:8765:x1874622863650816:12345-192.168.203.31@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787779899.919835:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046098d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+11:8765:x1874622863650816:12345-192.168.203.31@tcp:502:llog_process_th.0 Request processed in 239us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779899.919885:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 296 00000100:00100000:2.0:1787779899.931945:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787779899.932701:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863650944 00000100:00100000:1.0:1787779899.932717:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863650944 00000100:00100000:1.0:1787779899.932822:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 297 00000100:00100000:1.0:1787779899.932835:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046098f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+11:8765:x1874622863650944:12345-192.168.203.31@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787779899.933370:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046098f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+11:8765:x1874622863650944:12345-192.168.203.31@tcp:502:llog_process_th.0 Request processed in 535us (1443us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779899.933388:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 297 00000100:00100000:3.0:1787779899.944486:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787779899.944766:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863651072 00000100:00100000:0.0:1787779899.944797:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863651072 00000100:00100000:0.0:1787779899.944928:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 298 00000100:00100000:0.0:1787779899.944943:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046098c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+11:8761:x1874622863651072:12345-192.168.203.31@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787779899.944969:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787779899.944996:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0477868600/0xc8fc0a517996075e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf757128131ea1d13 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779899.945431:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0477868600/0xc8fc0a517996075e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1d13 expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779899.945451:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0477868600/0xc8fc0a517996075e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1d13 expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779899.945462:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0477868600, rc 0) 00000100:00100000:0.0:1787779899.945557:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046098c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+12:8761:x1874622863651072:12345-192.168.203.31@tcp:101:mount.lustre.0 Request processed in 618us (1092us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779899.945566:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 298 00000100:00100000:0.0:1787779899.952802:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787779899.953258:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863651200 00000100:00100000:1.0:1787779899.953273:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863651200 00000100:00100000:1.0:1787779899.953350:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 299 00000100:00100000:1.0:1787779899.953362:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046098f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+12:8761:x1874622863651200:12345-192.168.203.31@tcp:256:mount.lustre.0 20000000:01000000:1.0:1787779899.953411:0:6506:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1787779899.953449:0:6506:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1787779899.953454:0:6506:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1787779899.953458:0:6506:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1787779899.953462:0:6506:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1787779899.953464:0:6506:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:1.0:1787779899.956947:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046098f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+12:8761:x1874622863651200:12345-192.168.203.31@tcp:256:mount.lustre.0 Request processed in 3569us (4151us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779899.956966:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 299 00000100:00100000:2.0:1787779899.971925:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787779899.972091:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863651328 00000100:00100000:0.0:1787779899.972105:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863651328 00000100:00100000:0.0:1787779899.972172:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 300 00000100:00100000:0.0:1787779899.972184:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046098e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+12:8761:x1874622863651328:12345-192.168.203.31@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787779899.972205:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787779899.972228:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0477868a00/0xc8fc0a5179960765 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xf757128131ea1d1a expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779899.972278:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0477868a00/0xc8fc0a5179960765 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1d1a expref: 13 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779899.972291:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0477868a00/0xc8fc0a5179960765 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1d1a expref: 13 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779899.972302:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0477868a00, rc 0) 00000100:00100000:0.0:1787779899.972391:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046098e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+13:8761:x1874622863651328:12345-192.168.203.31@tcp:101:mount.lustre.0 Request processed in 209us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779899.972414:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 300 00000100:00100000:0.0:1787779899.989211:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787779899.989325:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863651456 00000100:00100000:1.0:1787779899.989339:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863651456 00000100:00100000:1.0:1787779899.989418:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 301 00000100:00100000:1.0:1787779899.989429:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046098fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+13:8761:x1874622863651456:12345-192.168.203.31@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787779899.993663:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046098fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+13:8761:x1874622863651456:12345-192.168.203.31@tcp:501:mount.lustre.0 Request processed in 4202us (4434us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779899.993689:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 301 00000100:00100000:3.0:1787779900.008109:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787779900.008246:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863651584 00000100:00100000:2.0:1787779900.008262:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863651584 00000100:00100000:2.0:1787779900.008340:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 302 00000100:00100000:2.0:1787779900.008351:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046098ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+13:8761:x1874622863651584:12345-192.168.203.31@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787779900.008583:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046098ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+13:8761:x1874622863651584:12345-192.168.203.31@tcp:503:mount.lustre.0 Request processed in 233us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779900.008592:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 302 00000100:00100000:0.0:1787779900.019712:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787779900.020051:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863651712 00000100:00100000:1.0:1787779900.020065:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863651712 00000100:00100000:1.0:1787779900.020143:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 303 00000100:00100000:1.0:1787779900.020157:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046098f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+13:8769:x1874622863651712:12345-192.168.203.31@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787779900.020412:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046098f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+13:8769:x1874622863651712:12345-192.168.203.31@tcp:502:llog_process_th.0 Request processed in 258us (716us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779900.020420:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 303 00000100:00100000:3.0:1787779900.023032:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787779900.023820:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863651840 00000100:00100000:0.0:1787779900.023834:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863651840 00000100:00100000:0.0:1787779900.023951:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 304 00000100:00100000:0.0:1787779900.023964:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046098e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+13:8769:x1874622863651840:12345-192.168.203.31@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787779900.027538:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046098e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+13:8769:x1874622863651840:12345-192.168.203.31@tcp:502:llog_process_th.0 Request processed in 3558us (4506us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779900.027557:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 304 00000100:00100000:3.0:1787779900.044957:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787779900.045008:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787779900.045180:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863651968 00000100:00100000:2.0:1787779900.045194:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863651968 00000100:00100000:2.0:1787779900.045246:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863652224 00000100:00100000:2.0:1787779900.045249:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863652224 00000100:00100000:2.0:1787779900.045280:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 16 00000100:00100000:2.0:1787779900.045290:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347e561c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2407:x1874622863651968:12345-192.168.203.31@tcp:38:mount.lustre.0 00010000:00080000:2.0:1787779900.045334:0:6513:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 25f2eabf-81ed-4798-a9a9-6e0f6dda29ab@192.168.203.31@tcp t0 exp 0000000000000000 cur 308 last 0 00000020:00000080:2.0:1787779900.045380:0:6513:0:(genops.c:1385:class_connect()) connect: client 25f2eabf-81ed-4798-a9a9-6e0f6dda29ab, cookie 0xc8fc0a517996076c 00000004:00100000:2.0:1787779900.045432:0:6513:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1787779900.045590:0:6513:0:(import.c:65:import_set_state_nolock()) ffff9c0347d2e000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787779900.045696:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347e561c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+6:2407:x1874622863651968:12345-192.168.203.31@tcp:38:mount.lustre.0 Request processed in 405us (755us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779900.045706:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 16 00000100:00100000:2.0:1787779900.045727:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 17 00000100:00100000:2.0:1787779900.045732:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347e570c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2407:x1874622863652224:12345-192.168.203.31@tcp:38:mount.lustre.0 00010000:00080000:2.0:1787779900.045750:0:6513:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 25f2eabf-81ed-4798-a9a9-6e0f6dda29ab@192.168.203.31@tcp t0 exp 0000000000000000 cur 308 last 0 00000020:00000080:2.0:1787779900.045776:0:6513:0:(genops.c:1385:class_connect()) connect: client 25f2eabf-81ed-4798-a9a9-6e0f6dda29ab, cookie 0xc8fc0a5179960773 00000004:00100000:2.0:1787779900.045791:0:6513:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1787779900.045909:0:6513:0:(import.c:65:import_set_state_nolock()) ffff9c0347d2d000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787779900.045935:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347e570c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+6:2407:x1874622863652224:12345-192.168.203.31@tcp:38:mount.lustre.0 Request processed in 201us (925us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779900.045943:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 17 00000100:00100000:0.0:1787779900.049222:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787779900.049267:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787779900.049412:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787779900.066095:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863652480 00000100:00100000:1.0:1787779900.066115:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863652480 00000100:00100000:1.0:1787779900.066233:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863652352 00000100:00100000:1.0:1787779900.066238:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863652352 00000100:00100000:1.0:1787779900.066273:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863652096 00000100:00100000:1.0:1787779900.066276:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863652096 00000100:00100000:1.0:1787779900.066300:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 18 00000100:00100000:1.0:1787779900.066311:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346efe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+7:8761:x1874622863652480:12345-192.168.203.31@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787779900.066367:0:7821:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1787779900.066504:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346efe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+7:8761:x1874622863652480:12345-192.168.203.31@tcp:41:mount.lustre.0 Request processed in 194us (17300us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779900.066514:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 18 00000100:00100000:1.0:1787779900.066536:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 19 00000100:00100000:1.0:1787779900.066542:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346efed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+6:0:x1874622863652352:12345-192.168.203.31@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787779900.066564:0:7821:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787779900.066602:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346efed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+6:0:x1874622863652352:12345-192.168.203.31@tcp:41:mount.lustre.0 Request processed in 60us (17335us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779900.066609:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 19 00000100:00100000:1.0:1787779900.066623:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 20 00000100:00100000:1.0:1787779900.066629:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346efc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+6:0:x1874622863652096:12345-192.168.203.31@tcp:41:mount.lustre.0 00000100:00080000:0.0:1787779900.066802:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787779900.066808:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000024:1.0:1787779900.067174:0:7821:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1787779900.067211:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346efc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+6:0:x1874622863652096:12345-192.168.203.31@tcp:41:mount.lustre.0 Request processed in 581us (17797us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779900.067236:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 20 00000100:00100000:2.0:1787779900.072661:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787779900.072873:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863652608 00000100:00100000:1.0:1787779900.072887:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863652608 00000100:00100000:1.0:1787779900.072967:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 21 00000100:00100000:1.0:1787779900.072979:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347ee1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+6:8761:x1874622863652608:12345-192.168.203.31@tcp:40:mount.lustre.0 00000100:00100000:1.0:1787779900.073101:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347ee1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+6:8761:x1874622863652608:12345-192.168.203.31@tcp:40:mount.lustre.0 Request processed in 124us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779900.073110:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 21 00000100:00100000:2.0:1787779900.081750:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787779900.082027:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863652992 00000100:00100000:3.0:1787779900.082040:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863652992 00000100:00100000:3.0:1787779900.082114:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 5 00000100:00100000:3.0:1787779900.082127:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347ee3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+6:8761:x1874622863652992:12345-192.168.203.31@tcp:900:mount.lustre.0 00000100:00100000:3.0:1787779900.082246:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347ee3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+6:8761:x1874622863652992:12345-192.168.203.31@tcp:900:mount.lustre.0 Request processed in 122us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779900.082265:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 5 00000100:00100000:1.0:1787779900.082697:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787779900.082806:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787779900.085025:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863652736 00000100:00100000:0.0:1787779900.085047:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863652736 00000100:00100000:0.0:1787779900.085164:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863652864 00000100:00100000:0.0:1787779900.085169:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863652864 00000100:00100000:0.0:1787779900.085198:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 20 00000100:00100000:0.0:1787779900.085208:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c047796cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2407:x1874622863652736:12345-192.168.203.31@tcp:8:mount.lustre.0 00010000:00080000:0.0:1787779900.085253:0:8427:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 25f2eabf-81ed-4798-a9a9-6e0f6dda29ab@192.168.203.31@tcp t0 exp 0000000000000000 cur 308 last 0 00000020:00000080:0.0:1787779900.085301:0:8427:0:(genops.c:1385:class_connect()) connect: client 25f2eabf-81ed-4798-a9a9-6e0f6dda29ab, cookie 0xc8fc0a517996077a 00002000:00100000:0.0:1787779900.085317:0:8427:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 25f2eabf-81ed-4798-a9a9-6e0f6dda29ab/ffff9c0481211000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113939 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787779900.085332:0:8427:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787779900.085463:0:8427:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787779900.085508:0:8427:0:(import.c:65:import_set_state_nolock()) ffff9c0481215800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787779900.085599:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c047796cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+6:2407:x1874622863652736:12345-192.168.203.31@tcp:8:mount.lustre.0 Request processed in 390us (2902us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779900.085607:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 20 00000100:00100000:0.0:1787779900.085632:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 21 00000100:00100000:0.0:1787779900.085646:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0461957c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2407:x1874622863652864:12345-192.168.203.31@tcp:8:mount.lustre.0 00010000:00080000:0.0:1787779900.085664:0:8427:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 25f2eabf-81ed-4798-a9a9-6e0f6dda29ab@192.168.203.31@tcp t0 exp 0000000000000000 cur 308 last 0 00000020:00000080:0.0:1787779900.085682:0:8427:0:(genops.c:1385:class_connect()) connect: client 25f2eabf-81ed-4798-a9a9-6e0f6dda29ab, cookie 0xc8fc0a5179960781 00002000:00100000:0.0:1787779900.085688:0:8427:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 25f2eabf-81ed-4798-a9a9-6e0f6dda29ab/ffff9c0481214000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113939 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787779900.085703:0:8427:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787779900.085743:0:8427:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787779900.085757:0:8427:0:(import.c:65:import_set_state_nolock()) ffff9c0481210800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787779900.085781:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0461957c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+6:2407:x1874622863652864:12345-192.168.203.31@tcp:8:mount.lustre.0 Request processed in 134us (2975us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779900.085788:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 21 00000100:00100000:0.0:1787779900.090950:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787779900.094170:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863653120 00000100:00100000:1.0:1787779900.094189:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863653120 00000100:00100000:1.0:1787779900.094320:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 1 00000100:00100000:1.0:1787779900.094331:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346efe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+6:8761:x1874622863653120:12345-192.168.203.31@tcp:33:mount.lustre.0 00000004:00200000:1.0:1787779900.094455:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1787779900.094573:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346efe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+6:8761:x1874622863653120:12345-192.168.203.31@tcp:33:mount.lustre.0 Request processed in 242us (3639us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779900.094582:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 1 00010000:00010000:1.0:1787779900.574603:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787779901.227874:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787779901.227906:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347e552c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881556224:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787779901.228003:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779901.228087:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881556224 00000100:00100000:3.0:1787779901.228096:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881556224 00000100:00100000:3.0:1787779901.228155:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787779901.228175:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347e54b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881556224:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787779901.228219:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787779901.228272:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347e54b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881556224:12345-0@lo:41:osp-pre-0-1.0 Request processed in 98us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779901.228278:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787779901.228331:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347e552c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881556224:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787779901.596096:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787779901.724267:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347ebc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881556352:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787779901.724362:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779901.724505:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881556352 00000100:00100000:0.0:1787779901.724515:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881556352 00000100:00100000:0.0:1787779901.724583:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787779901.724594:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347e552c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881556352:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787779901.724642:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787779901.724700:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347e552c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881556352:12345-0@lo:41:osp-pre-1-0.0 Request processed in 107us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779901.724707:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787779901.724881:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347ebc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881556352:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787779902.620984:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787779903.644709:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787779903.773343:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347ee30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874622881556864:0@lo:400:kworker.0 00000100:00100000:2.0:1787779903.773454:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779903.773536:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347ee1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881557376:0@lo:400:kworker.0 00000100:00100000:2.0:1787779903.773568:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779903.773586:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346da43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881557888:0@lo:400:kworker.0 00000100:00100000:2.0:1787779903.773609:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779903.773785:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:2.0:1787779903.773791:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347ee0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1f575176-36bc-4786-83ee-2fea064a12a9:3643:1874622881556480:0@lo:400:kworker.0 00000100:00100000:2.0:1787779903.773826:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779903.773872:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347ee12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881556992:0@lo:400:kworker.0 00000100:00100000:2.0:1787779903.773900:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779903.773915:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347ee3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881557504:0@lo:400:kworker.0 00000100:00100000:2.0:1787779903.773933:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779903.773950:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346da70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881558016:0@lo:400:kworker.0 00000100:00100000:2.0:1787779903.773969:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779903.773997:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347ee2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874622881556608:0@lo:400:kworker.0 00000100:00100000:2.0:1787779903.774022:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779903.774041:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347ee0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1874622881557120:0@lo:400:kworker.0 00000100:00100000:2.0:1787779903.774082:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779903.774101:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347ee2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1874622881557632:0@lo:400:kworker.0 00000100:00100000:2.0:1787779903.774122:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779903.774140:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1787779903.774146:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347ee21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881556736:0@lo:400:kworker.0 00000100:00100000:2.0:1787779903.774183:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779903.774203:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347ee2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1874622881557248:0@lo:400:kworker.0 00000100:00100000:2.0:1787779903.774224:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779903.774233:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346da4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1874622881557760:0@lo:400:kworker.0 00000100:00100000:2.0:1787779903.774249:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779903.774279:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881556864 00000100:00100000:2.0:1787779903.774289:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881556864 00000100:00100000:2.0:1787779903.774337:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881556608 00000100:00100000:2.0:1787779903.774339:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881556608 00000100:00100000:2.0:1787779903.774349:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881557120 00000100:00100000:2.0:1787779903.774350:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881557120 00000100:00100000:2.0:1787779903.774385:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881557632 00000100:00100000:2.0:1787779903.774388:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881557632 00000100:00100000:2.0:1787779903.774402:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881557248 00000100:00100000:2.0:1787779903.774404:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881557248 00000100:00100000:2.0:1787779903.774417:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881557760 00000100:00100000:2.0:1787779903.774419:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881557760 00000100:00100000:2.0:1787779903.774436:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1787779903.774444:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346da4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1874622881556864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787779903.774734:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881557376 00000100:00100000:0.0:1787779903.774740:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881557376 00000100:00100000:0.0:1787779903.774768:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881557888 00000100:00100000:0.0:1787779903.774771:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881557888 00000100:00100000:0.0:1787779903.774786:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881557504 00000100:00100000:0.0:1787779903.774789:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881557504 00000100:00100000:0.0:1787779903.774802:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881558016 00000100:00100000:0.0:1787779903.774805:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881558016 00000100:00100000:0.0:1787779903.774819:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787779903.774826:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346da4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881557376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787779903.774917:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346da4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881557376:12345-0@lo:400:kworker.0 Request processed in 91us (1348us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779903.774925:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787779903.774945:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787779903.774952:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346da6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881557888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787779903.774983:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346da6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881557888:12345-0@lo:400:kworker.0 Request processed in 32us (1373us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779903.774989:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787779903.775011:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787779903.775017:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346da7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881557504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787779903.775047:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346da7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881557504:12345-0@lo:400:kworker.0 Request processed in 31us (1113us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779903.775055:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787779903.775067:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787779903.775073:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346da5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881558016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787779903.775099:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346da5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881558016:12345-0@lo:400:kworker.0 Request processed in 26us (1129us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779903.775105:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787779903.775125:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881556992 00000100:00100000:0.0:1787779903.775128:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881556992 00000100:00100000:0.0:1787779903.775147:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881556736 00000100:00100000:0.0:1787779903.775149:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881556736 00000100:00100000:0.0:1787779903.775161:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787779903.775167:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346da52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881556992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787779903.775199:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346da52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881556992:12345-0@lo:400:kworker.0 Request processed in 33us (1298us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779903.775205:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787779903.775216:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787779903.775222:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346cff0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881556736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787779903.775259:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346cff0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881556736:12345-0@lo:400:kworker.0 Request processed in 37us (1075us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779903.775264:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00080000:0.0:1787779903.775279:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787779903.775284:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787779903.775287:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787779903.775297:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787779903.775332:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347ee21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881556736:0@lo:400:kworker.0 00000100:00100000:1.0:1787779903.775519:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347ee12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881556992:0@lo:400:kworker.0 00010000:00080000:1.0:1787779903.775534:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0347ee3c00 x1874622881557504/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779919 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787779903.775546:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347ee3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881557504:0@lo:400:kworker.0 00010000:00080000:1.0:1787779903.775558:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0346da70c0 x1874622881558016/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779919 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787779903.775574:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346da70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881558016:0@lo:400:kworker.0 00010000:00080000:1.0:1787779903.775590:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0347ee1e00 x1874622881557376/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779919 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787779903.775598:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347ee1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881557376:0@lo:400:kworker.0 00010000:00080000:1.0:1787779903.775609:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0346da43c0 x1874622881557888/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779919 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787779903.775628:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346da43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881557888:0@lo:400:kworker.0 00000100:00100000:2.0:1787779903.776185:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346da4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1874622881556864:12345-0@lo:400:kworker.0 Request processed in 1738us (2728us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779903.776197:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1787779903.776221:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1787779903.776240:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346da5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874622881556608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779903.776286:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346da5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874622881556608:12345-0@lo:400:kworker.0 Request processed in 49us (2263us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779903.776292:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1787779903.776305:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1787779903.776313:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346da61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874622881557120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779903.776343:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346da61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874622881557120:12345-0@lo:400:kworker.0 Request processed in 32us (2260us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779903.776349:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1787779903.776362:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1787779903.776380:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346da6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1874622881557632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779903.776412:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346da6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1874622881557632:12345-0@lo:400:kworker.0 Request processed in 44us (2289us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779903.776418:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1787779903.776431:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1787779903.776438:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346cfd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1874622881557248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779903.776467:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346cfd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1874622881557248:12345-0@lo:400:kworker.0 Request processed in 30us (2242us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779903.776603:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347ee30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874622881556864:0@lo:400:kworker.0 00010000:00080000:0.0:1787779903.776767:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0347ee2940 x1874622881557248/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779919 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787779903.776781:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347ee2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1874622881557248:0@lo:400:kworker.0 00000100:00100000:0.0:1787779903.776796:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347ee2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874622881556608:0@lo:400:kworker.0 00000100:00100000:0.0:1787779903.776809:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347ee0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1874622881557120:0@lo:400:kworker.0 00000100:00100000:0.0:1787779903.776821:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347ee2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1874622881557632:0@lo:400:kworker.0 00000100:00100000:0.0:1787779903.777781:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0461954f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881558144:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787779903.777889:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779903.778045:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1787779903.778074:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1787779903.778088:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346cfcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1874622881557760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779903.778153:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346cfcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1874622881557760:12345-0@lo:400:kworker.0 Request processed in 70us (3901us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779903.778159:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1787779903.778189:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881556480 00000100:00100000:2.0:1787779903.778206:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881556480 00000100:00100000:2.0:1787779903.778247:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:2.0:1787779903.778253:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046098c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+24:3643:x1874622881556480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779903.778289:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046098c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+24:3643:x1874622881556480:12345-0@lo:400:kworker.0 Request processed in 36us (4462us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779903.778294:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:1.0:1787779903.778411:0:8529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881558144 00000100:00100000:1.0:1787779903.778416:0:8529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881558144 00000100:00100000:1.0:1787779903.778455:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787779903.778462:0:8529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046f3d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881558144:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787779903.778499:0:8529:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787779903.778538:0:8529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046f3d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881558144:12345-0@lo:13:osp-pre-1-1.0 Request processed in 76us (650us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779903.778545:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787779903.779111:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347ee0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1f575176-36bc-4786-83ee-2fea064a12a9:3643:1874622881556480:0@lo:400:kworker.0 00010000:00080000:0.0:1787779903.779599:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0461954f00 x1874622881558144/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779919 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787779903.779634:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0461954f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881558144:0@lo:13:osp-pre-1-1.0 00010000:00080000:0.0:1787779903.779650:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0346da4000 x1874622881557760/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779919 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787779903.779659:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346da4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1874622881557760:0@lo:400:kworker.0 00000100:00100000:1.0:1787779904.287081:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787779904.287123:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0461956940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881558272:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787779904.287215:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779904.288952:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881558272 00000100:00100000:2.0:1787779904.288970:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881558272 00000100:00100000:2.0:1787779904.289058:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787779904.289071:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04619561c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881558272:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787779904.289128:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787779904.289236:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04619561c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881558272:12345-0@lo:13:osp-pre-0-1.0 Request processed in 168us (2021us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779904.289244:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00010000:00080000:2.0:1787779904.289298:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0461956940 x1874622881558272/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779920 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787779904.289322:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0461956940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881558272:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787779904.295000:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787779904.295042:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347ebd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881558400:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787779904.295153:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779904.300775:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881558400 00000100:00100000:3.0:1787779904.300798:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881558400 00000100:00100000:3.0:1787779904.300915:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787779904.300929:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347ebf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881558400:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787779904.300971:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787779904.301123:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347ebf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881558400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 186us (5960us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779904.301131:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00010000:00080000:3.0:1787779904.301197:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0347ebd680 x1874622881558400/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779920 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779904.301226:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347ebd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881558400:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787779904.668202:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787779904.796100:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347ebe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881558528:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787779904.796210:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779904.797654:0:8529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881558528 00000100:00100000:0.0:1787779904.797673:0:8529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881558528 00000100:00100000:0.0:1787779904.797764:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787779904.797785:0:8529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0461957480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881558528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787779904.797857:0:8529:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787779904.797965:0:8529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0461957480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881558528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 191us (1755us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779904.797974:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00010000:00080000:0.0:1787779904.798035:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0347ebe1c0 x1874622881558528/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779920 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787779904.798060:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347ebe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881558528:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787779905.430031:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787779905.430080:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787779905.430119:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787779905.430174:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787779905.430204:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787779905.430225:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787779905.430248:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787779905.430282:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863653248 00000100:00100000:0.0:1787779905.430294:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863653248 00000100:00100000:0.0:1787779905.430371:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 306 00000100:00100000:0.0:1787779905.430383:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046098d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+13:2408:x1874622863653248:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1787779905.430493:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046098d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+13:2408:x1874622863653248:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 112us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779905.430502:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 306 00000100:00100000:2.0:1787779905.431038:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863653376 00000100:00100000:2.0:1787779905.431045:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863653376 00000100:00100000:2.0:1787779905.431100:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863653632 00000100:00100000:2.0:1787779905.431104:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863653632 00000100:00100000:2.0:1787779905.431121:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863653504 00000100:00100000:2.0:1787779905.431124:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863653504 00000100:00100000:2.0:1787779905.431136:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863653760 00000100:00100000:2.0:1787779905.431139:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863653760 00000100:00100000:2.0:1787779905.431167:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 151 00000100:00100000:2.0:1787779905.431175:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347ebe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+6:2408:x1874622863653376:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1787779905.431251:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347ebe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+6:2408:x1874622863653376:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 77us (1237us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779905.431259:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 151 00000100:00100000:2.0:1787779905.431273:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 152 00000100:00100000:2.0:1787779905.431279:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347ebc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+6:2408:x1874622863653632:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1787779905.431303:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347ebc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+6:2408:x1874622863653632:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 25us (1223us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779905.431308:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 152 00000100:00100000:2.0:1787779905.431319:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 153 00000100:00100000:2.0:1787779905.431324:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347ee0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:2408:x1874622863653504:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1787779905.431348:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347ee0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:2408:x1874622863653504:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 24us (1144us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779905.431354:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 153 00000100:00100000:2.0:1787779905.431376:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 154 00000100:00100000:2.0:1787779905.431383:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347ee2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+6:2408:x1874622863653760:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1787779905.431407:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347ee2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+6:2408:x1874622863653760:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 25us (1181us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779905.431412:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 154 00000100:00100000:2.0:1787779905.431440:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863653888 00000100:00100000:2.0:1787779905.431444:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863653888 00000100:00100000:2.0:1787779905.431485:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863654016 00000100:00100000:2.0:1787779905.431489:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863654016 00000100:00100000:2.0:1787779905.431509:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 65 00000100:00100000:2.0:1787779905.431515:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347ebd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+6:2408:x1874622863653888:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1787779905.431548:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347ebd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+6:2408:x1874622863653888:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 33us (1429us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779905.431555:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 65 00000100:00100000:2.0:1787779905.431566:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 66 00000100:00100000:2.0:1787779905.431572:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347ee0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+6:2408:x1874622863654016:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1787779905.431597:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347ee0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+6:2408:x1874622863654016:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 25us (1348us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779905.431603:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 66 00000100:00080000:0.0:1787779905.431869:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787779905.431875:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787779905.431888:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787779905.431891:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787779905.694288:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787779905.824578:0:7442:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 25f2eabf-81ed-4798-a9a9-6e0f6dda29ab 00000001:00100000:0.0:1787779905.824657:0:6491:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 25f2eabf-81ed-4798-a9a9-6e0f6dda29ab 00000001:00100000:2.0:1787779905.825352:0:9508:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 25f2eabf-81ed-4798-a9a9-6e0f6dda29ab 00000001:00100000:0.0:1787779905.825433:0:8423:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 25f2eabf-81ed-4798-a9a9-6e0f6dda29ab 00000100:00100000:2.0:1787779906.332698:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347e55680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881558656:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787779906.332768:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779906.333013:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881558656 00000100:00100000:3.0:1787779906.333021:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881558656 00000100:00100000:3.0:1787779906.333075:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787779906.333083:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346cfe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881558656:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787779906.333129:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787779906.333188:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346cfe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881558656:12345-0@lo:41:osp-pre-0-1.0 Request processed in 105us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779906.333196:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787779906.333243:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347e55680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881558656:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1787779906.716283:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787779906.844059:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787779906.844081:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347ee2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881558784:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787779906.844146:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779906.844371:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881558784 00000100:00100000:3.0:1787779906.844379:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881558784 00000100:00100000:3.0:1787779906.844425:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787779906.844435:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347ee2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874622881558784:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787779906.844466:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787779906.844516:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347ee2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874622881558784:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779906.844522:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787779906.844738:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347ee2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881558784:0@lo:41:osp-pre-1-0.0 00000001:02000400:3.0:1787779907.390795:0:12181:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg331-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:1.0:1787779907.740202:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787779908.764374:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787779908.892194:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347ee2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881558912:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787779908.892295:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779908.892712:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881558912 00000100:00100000:0.0:1787779908.892724:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881558912 00000100:00100000:0.0:1787779908.892808:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787779908.892822:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347e54f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881558912:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787779908.892887:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:3.0:1787779908.892993:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787779908.894273:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0461956940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1f575176-36bc-4786-83ee-2fea064a12a9:3644:1874622881559040:0@lo:400:kworker.0 00000100:00100000:1.0:1787779908.895400:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0461954f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874622881559168:0@lo:400:kworker.0 00000100:00100000:0.0:1787779908.899502:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347e54f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881558912:12345-0@lo:13:osp-pre-1-1.0 Request processed in 6670us (7194us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779908.899521:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787779908.899786:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04619570c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874622881559296:0@lo:400:kworker.0 00000100:00100000:2.0:1787779908.899891:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779908.900086:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346dac780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1874622881559808:0@lo:400:kworker.0 00000100:00100000:2.0:1787779908.900122:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779908.900151:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047796e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1874622881560320:0@lo:400:kworker.0 00000100:00100000:2.0:1787779908.900175:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779908.900220:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881559808 00000100:00100000:2.0:1787779908.900229:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881559808 00000100:00100000:2.0:1787779908.900289:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881560320 00000100:00100000:2.0:1787779908.900292:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881560320 00000100:00100000:2.0:1787779908.900311:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1787779908.900318:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346cfcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1874622881559808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779908.900384:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346cfcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1874622881559808:12345-0@lo:400:kworker.0 Request processed in 66us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779908.900407:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1787779908.900422:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1787779908.900490:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346cfc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1874622881560320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779908.900517:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346cfc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1874622881560320:12345-0@lo:400:kworker.0 Request processed in 30us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779908.900522:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1787779908.900553:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0461955e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874622881559424:0@lo:400:kworker.0 00000100:00100000:2.0:1787779908.900714:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779908.900735:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346dae1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881559936:0@lo:400:kworker.0 00000100:00100000:2.0:1787779908.900761:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779908.900776:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047796c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881560448:0@lo:400:kworker.0 00000100:00100000:2.0:1787779908.900793:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1787779908.900827:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0347ee2d00 x1874622881558912/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779924 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787779908.900873:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347ee2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881558912:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787779908.900905:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881559936 00000100:00100000:2.0:1787779908.900907:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881559936 00000100:00100000:0.0:1787779908.901121:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881559296 00000100:00100000:0.0:1787779908.901127:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881559296 00000100:00100000:0.0:1787779908.901161:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787779908.901168:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346cfc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1874622881559296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787779908.901213:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346cfc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1874622881559296:12345-0@lo:400:kworker.0 Request processed in 46us (1323us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779908.901220:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00080000:3.0:1787779908.901367:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787779908.901374:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787779908.901386:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881559424 00000100:00100000:3.0:1787779908.901390:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881559424 00000100:00100000:3.0:1787779908.901417:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1787779908.901423:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346cfe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1874622881559424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779908.901607:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346cfe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1874622881559424:12345-0@lo:400:kworker.0 Request processed in 184us (1031us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779908.901627:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1787779908.901658:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0461955e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874622881559424:0@lo:400:kworker.0 00000100:00100000:3.0:1787779908.901743:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779908.901768:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881559040 00000100:00100000:3.0:1787779908.901771:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881559040 00000100:00100000:3.0:1787779908.901793:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:3.0:1787779908.901798:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046098cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+24:3644:x1874622881559040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779908.901825:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046098cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+24:3644:x1874622881559040:12345-0@lo:400:kworker.0 Request processed in 27us (83us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779908.901831:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:3.0:1787779908.901894:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0461956940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1f575176-36bc-4786-83ee-2fea064a12a9:3644:1874622881559040:0@lo:400:kworker.0 00000100:00100000:3.0:1787779908.901904:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346d4cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881559552:0@lo:400:kworker.0 00000100:00100000:2.0:1787779908.902158:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881560448 00000100:00100000:2.0:1787779908.902163:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881560448 00000100:00100000:3.0:1787779908.902210:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787779908.902232:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787779908.902243:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346dad2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881560064:0@lo:400:kworker.0 00000100:00100000:3.0:1787779908.902270:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779908.905104:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881559552 00000100:00100000:1.0:1787779908.905127:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881559552 00000100:00100000:1.0:1787779908.905191:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787779908.905203:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347e54780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881559552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787779908.905307:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347e54780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881559552:12345-0@lo:400:kworker.0 Request processed in 106us (3378us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779908.905315:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787779908.905373:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779908.905407:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881559168 00000100:00100000:1.0:1787779908.905411:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881559168 00000100:00100000:1.0:1787779908.905451:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1787779908.905458:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c047796da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874622881559168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787779908.905496:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c047796da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874622881559168:12345-0@lo:400:kworker.0 Request processed in 38us (123us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779908.905502:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1787779908.905547:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0461954f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874622881559168:0@lo:400:kworker.0 00000100:00100000:1.0:1787779908.905564:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346dae580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1874622881559680:0@lo:400:kworker.0 00000100:00100000:1.0:1787779908.905610:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779908.905655:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346dade00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1874622881560192:0@lo:400:kworker.0 00000100:00100000:1.0:1787779908.905680:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779908.905698:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881559680 00000100:00100000:1.0:1787779908.905701:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881559680 00000100:00100000:1.0:1787779908.905732:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881560192 00000100:00100000:1.0:1787779908.905735:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881560192 00000100:00100000:1.0:1787779908.905752:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1787779908.905758:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c047796c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874622881559680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787779908.905786:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c047796c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874622881559680:12345-0@lo:400:kworker.0 Request processed in 28us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779908.905791:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1787779908.905802:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1787779908.905808:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c047796f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1874622881560192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787779908.905834:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c047796f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1874622881560192:12345-0@lo:400:kworker.0 Request processed in 26us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779908.905909:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1787779908.905938:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346dade00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1874622881560192:0@lo:400:kworker.0 00000100:00100000:1.0:1787779908.905973:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346dae580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1874622881559680:0@lo:400:kworker.0 00000100:00080000:3.0:1787779908.907494:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787779908.907555:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346d4cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881559552:0@lo:400:kworker.0 00000100:00100000:0.0:1787779908.907732:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881560064 00000100:00100000:0.0:1787779908.907741:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881560064 00000100:00100000:0.0:1787779908.907801:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787779908.907811:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346cfda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881559936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787779908.907910:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346cfda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881559936:12345-0@lo:400:kworker.0 Request processed in 100us (7147us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779908.907954:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787779908.908237:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787779908.908247:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346cff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881560448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787779908.908286:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346cff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881560448:12345-0@lo:400:kworker.0 Request processed in 42us (7492us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779908.908293:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787779908.908306:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787779908.908313:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347e56580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881560064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787779908.908362:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347e56580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881560064:12345-0@lo:400:kworker.0 Request processed in 49us (6091us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779908.908368:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:3.0:1787779908.908545:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787779908.908742:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04619570c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874622881559296:0@lo:400:kworker.0 00010000:00080000:0.0:1787779908.908765:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0346dac780 x1874622881559808/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779924 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787779908.908778:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346dac780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1874622881559808:0@lo:400:kworker.0 00010000:00080000:0.0:1787779908.908791:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c047796e940 x1874622881560320/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779924 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787779908.908800:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047796e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1874622881560320:0@lo:400:kworker.0 00010000:00080000:3.0:1787779908.908882:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0346dae1c0 x1874622881559936/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779924 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779908.908894:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346dae1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881559936:0@lo:400:kworker.0 00010000:00080000:3.0:1787779908.908909:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c047796c3c0 x1874622881560448/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779924 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779908.909115:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047796c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881560448:0@lo:400:kworker.0 00010000:00080000:3.0:1787779908.909147:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0346dad2c0 x1874622881560064/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779924 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779908.909156:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346dad2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881560064:0@lo:400:kworker.0 00000100:00100000:1.0:1787779909.404966:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347e55a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881560576:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787779909.405065:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779909.409602:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787779909.409644:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347e543c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874622881560704:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787779909.409738:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779909.410169:0:8529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881560576 00000100:00100000:1.0:1787779909.410181:0:8529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881560576 00000100:00100000:1.0:1787779909.411099:0:8529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881560704 00000100:00100000:1.0:1787779909.411109:0:8529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881560704 00000100:00100000:1.0:1787779909.411144:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787779909.411156:0:8529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c047796c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881560576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787779909.411210:0:8529:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787779909.411475:0:8529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c047796c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881560576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 320us (6409us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779909.411484:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787779909.411683:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787779909.411691:0:8529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347e55680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1874622881560704:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787779909.411715:0:8529:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787779909.411758:0:8529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347e55680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1874622881560704:12345-0@lo:13:osp-pre-0-1.0 Request processed in 68us (2021us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779909.411764:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00080000:1.0:1787779909.411826:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0347e55a40 x1874622881560576/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779925 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00010000:00080000:3.0:1787779909.412556:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0347e543c0 x1874622881560704/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779925 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779909.412597:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347e543c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874622881560704:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787779909.414265:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347e55a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881560576:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787779909.791889:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787779909.916368:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346cffc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881560832:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787779909.916469:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779909.916567:0:8529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881560832 00000100:00100000:2.0:1787779909.916576:0:8529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881560832 00000100:00100000:2.0:1787779909.916642:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787779909.916654:0:8529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346cfde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1874622881560832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787779909.916706:0:8529:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787779909.916763:0:8529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346cfde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1874622881560832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779909.916772:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00080000:2.0:1787779909.916822:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0346cffc00 x1874622881560832/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779925 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787779909.916866:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346cffc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881560832:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787779910.567358:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787779910.567398:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787779910.567432:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787779910.567458:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787779910.567479:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787779910.567511:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787779910.567539:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787779910.567574:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863654400 00000100:00100000:0.0:1787779910.567587:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863654400 00000100:00100000:0.0:1787779910.567657:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863654656 00000100:00100000:0.0:1787779910.567661:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863654656 00000100:00100000:0.0:1787779910.567678:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863654272 00000100:00100000:0.0:1787779910.567680:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863654272 00000100:00100000:0.0:1787779910.567695:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863654528 00000100:00100000:0.0:1787779910.567698:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863654528 00000100:00100000:0.0:1787779910.567940:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 161 00000100:00100000:0.0:1787779910.567955:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347ee30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:2410:x1874622863654400:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1787779910.568052:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347ee30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:2410:x1874622863654400:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 101us (652us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779910.568060:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 161 00000100:00100000:0.0:1787779910.568081:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 162 00000100:00100000:0.0:1787779910.568088:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347ee1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+5:2410:x1874622863654656:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1787779910.568116:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347ee1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+5:2410:x1874622863654656:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 29us (684us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779910.568123:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 162 00000100:00100000:0.0:1787779910.568145:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 163 00000100:00100000:0.0:1787779910.568154:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347ee12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+6:2410:x1874622863654272:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1787779910.568185:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347ee12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+6:2410:x1874622863654272:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 33us (705us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779910.568192:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 163 00000100:00100000:0.0:1787779910.568218:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 164 00000100:00100000:0.0:1787779910.568244:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347ee21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+5:2410:x1874622863654528:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1787779910.568339:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863654912 00000100:00100000:1.0:1787779910.568347:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863654912 00000100:00100000:1.0:1787779910.568385:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863654784 00000100:00100000:1.0:1787779910.568388:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863654784 00000100:00100000:1.0:1787779910.568413:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 70 00000100:00100000:1.0:1787779910.568423:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347ee3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+5:2410:x1874622863654912:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1787779910.568485:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347ee3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+5:2410:x1874622863654912:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 64us (1026us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779910.568493:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 70 00000100:00100000:1.0:1787779910.568511:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 71 00000100:00100000:1.0:1787779910.568518:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347ee2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+5:2410:x1874622863654784:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1787779910.568555:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347ee2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+5:2410:x1874622863654784:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 37us (1015us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779910.568581:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 71 00000100:00080000:1.0:1787779910.568776:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787779910.568782:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787779910.568785:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787779910.568788:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787779910.570051:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863654144 00000100:00100000:2.0:1787779910.570066:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863654144 00000100:00100000:2.0:1787779910.570145:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 308 00000100:00100000:0.0:1787779910.570148:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347ee21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+5:2410:x1874622863654528:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 1897us (2623us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779910.570160:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046098dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+13:2410:x1874622863654144:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1787779910.570169:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 164 00000100:00100000:2.0:1787779910.570234:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046098dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+13:2410:x1874622863654144:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 66us (2879us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779910.570243:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 308 00010000:00010000:2.0:1787779910.814106:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787779911.453212:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787779911.461130:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347e56940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881560960:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787779911.461234:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779911.465191:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881560960 00000100:00100000:1.0:1787779911.465206:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881560960 00000100:00100000:1.0:1787779911.465272:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1787779911.465282:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477940b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881560960:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787779911.465327:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1787779911.465420:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477940b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881560960:12345-0@lo:41:osp-pre-0-1.0 Request processed in 140us (4186us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779911.465427:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1787779911.465551:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347e56940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881560960:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787779911.836208:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787779911.965037:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477942d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881561088:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787779911.965109:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779911.965274:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881561088 00000100:00100000:1.0:1787779911.965282:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881561088 00000100:00100000:1.0:1787779911.965347:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1787779911.965357:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346cffc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881561088:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787779911.965392:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787779911.965454:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346cffc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881561088:12345-0@lo:41:osp-pre-1-0.0 Request processed in 98us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779911.965461:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1787779911.965640:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477942d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881561088:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1787779912.860918:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787779913.888398:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787779914.012334:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477943840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881561472:0@lo:400:kworker.0 00000100:00100000:0.0:1787779914.012403:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779914.012460:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0476443480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1874622881561984:0@lo:400:kworker.0 00000100:00100000:0.0:1787779914.012510:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779914.012534:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0476440f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1874622881562496:0@lo:400:kworker.0 00000100:00100000:0.0:1787779914.012556:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779914.012580:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1787779914.012586:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477942d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874622881561600:0@lo:400:kworker.0 00000100:00100000:0.0:1787779914.012607:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779914.012626:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0476443840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881562112:0@lo:400:kworker.0 00000100:00100000:0.0:1787779914.012647:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779914.012660:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04764430c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881562624:0@lo:400:kworker.0 00000100:00100000:0.0:1787779914.012678:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779914.012706:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881561984 00000100:00100000:0.0:1787779914.012712:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881561984 00000100:00100000:0.0:1787779914.012755:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881562496 00000100:00100000:0.0:1787779914.012757:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881562496 00000100:00100000:0.0:1787779914.012768:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881561600 00000100:00100000:0.0:1787779914.012770:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881561600 00000100:00100000:0.0:1787779914.012798:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1787779914.012805:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347a861c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1874622881561984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787779914.012875:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347a861c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1874622881561984:12345-0@lo:400:kworker.0 Request processed in 71us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779914.012882:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1787779914.012897:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1787779914.013157:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477941680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1f575176-36bc-4786-83ee-2fea064a12a9:3641:1874622881561216:0@lo:400:kworker.0 00000100:00100000:1.0:1787779914.013291:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477943480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1874622881561344:0@lo:400:kworker.0 00000100:00100000:1.0:1787779914.013332:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779914.013344:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0476443c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1874622881561856:0@lo:400:kworker.0 00000100:00100000:2.0:1787779914.013374:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779914.013531:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04779430c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881561728:0@lo:400:kworker.0 00000100:00100000:2.0:1787779914.013574:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779914.013591:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04764403c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881562240:0@lo:400:kworker.0 00000100:00100000:2.0:1787779914.013610:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779914.013626:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0476440b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881562752:0@lo:400:kworker.0 00000100:00100000:2.0:1787779914.013645:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779914.013663:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779914.013675:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881562112 00000100:00100000:2.0:1787779914.013679:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881562112 00000100:00100000:1.0:1787779914.013680:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0476441e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1874622881562368:0@lo:400:kworker.0 00000100:00100000:1.0:1787779914.013699:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779914.013700:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881562624 00000100:00100000:2.0:1787779914.013703:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881562624 00000100:00100000:2.0:1787779914.013713:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881562240 00000100:00100000:2.0:1787779914.013716:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881562240 00000100:00100000:1.0:1787779914.013721:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881561472 00000100:00100000:1.0:1787779914.013723:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881561472 00000100:00100000:2.0:1787779914.013728:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881562752 00000100:00100000:2.0:1787779914.013730:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881562752 00000100:00100000:1.0:1787779914.013740:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881561728 00000100:00100000:2.0:1787779914.013742:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787779914.013742:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881561728 00000100:00100000:2.0:1787779914.013747:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347a87c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881562112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787779914.013753:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1787779914.013757:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0476440000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881561472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779914.013780:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347a87c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881562112:12345-0@lo:400:kworker.0 Request processed in 32us (1131us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779914.013781:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0476440000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881561472:12345-0@lo:400:kworker.0 Request processed in 24us (1379us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779914.013786:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787779914.013787:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1787779914.013799:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787779914.013799:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1787779914.013805:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347a86580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881562624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787779914.013805:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346cfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874622881561728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779914.013829:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347a86580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881562624:12345-0@lo:400:kworker.0 Request processed in 25us (1150us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779914.013832:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346cfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874622881561728:12345-0@lo:400:kworker.0 Request processed in 29us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779914.013835:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787779914.013864:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787779914.013866:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1787779914.013870:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346cfed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874622881562240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787779914.013883:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881561344 00000100:00100000:1.0:1787779914.013886:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881561344 00000100:00100000:2.0:1787779914.013895:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346cfed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874622881562240:12345-0@lo:400:kworker.0 Request processed in 26us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779914.013899:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881561856 00000100:00100000:2.0:1787779914.013909:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787779914.013920:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787779914.013925:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346cfe1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874622881562752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779914.013950:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346cfe1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874622881562752:12345-0@lo:400:kworker.0 Request processed in 25us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779914.013956:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787779914.014204:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881561856 00000100:00100000:1.0:1787779914.014224:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881562368 00000100:00100000:1.0:1787779914.014226:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881562368 00000100:00100000:1.0:1787779914.014239:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1787779914.014245:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347a85e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1874622881561600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787779914.014278:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347a85e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1874622881561600:12345-0@lo:400:kworker.0 Request processed in 32us (1669us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779914.014283:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1787779914.014296:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1787779914.014317:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c047796d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1874622881561344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787779914.014428:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347a85680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1874622881562496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787779914.014463:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347a85680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1874622881562496:12345-0@lo:400:kworker.0 Request processed in 1560us (1906us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779914.014469:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1787779914.014483:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1787779914.014489:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c047796fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1874622881561856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787779914.014531:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c047796d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1874622881561344:12345-0@lo:400:kworker.0 Request processed in 214us (1199us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779914.014537:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1787779914.014549:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1787779914.014555:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c047796e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1874622881562368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787779914.014655:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c047796fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1874622881561856:12345-0@lo:400:kworker.0 Request processed in 166us (990us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779914.014660:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881561216 00000100:00100000:0.0:1787779914.014661:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1787779914.014664:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881561216 00000100:00100000:3.0:1787779914.014692:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:3.0:1787779914.014698:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046082b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+24:3641:x1874622881561216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779914.014728:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046082b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+24:3641:x1874622881561216:12345-0@lo:400:kworker.0 Request processed in 31us (1354us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779914.014730:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477942d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874622881561600:0@lo:400:kworker.0 00000100:00100000:3.0:1787779914.014734:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00010000:00080000:0.0:1787779914.014745:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0476443840 x1874622881562112/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779930 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787779914.014756:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0476443840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881562112:0@lo:400:kworker.0 00010000:00080000:0.0:1787779914.014766:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c04764430c0 x1874622881562624/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779930 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787779914.014775:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04764430c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881562624:0@lo:400:kworker.0 00000100:00100000:0.0:1787779914.014788:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477943840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881561472:0@lo:400:kworker.0 00010000:00080000:0.0:1787779914.014807:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0476443480 x1874622881561984/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779930 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787779914.014812:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0476443480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1874622881561984:0@lo:400:kworker.0 00010000:00080000:0.0:1787779914.014818:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0476440f00 x1874622881562496/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779930 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787779914.014823:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0476440f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1874622881562496:0@lo:400:kworker.0 00000100:00100000:1.0:1787779914.015010:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c047796e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1874622881562368:12345-0@lo:400:kworker.0 Request processed in 456us (1310us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779914.015015:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00080000:1.0:1787779914.015036:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787779914.015039:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787779914.015040:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787779914.015042:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787779914.015053:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477941680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1f575176-36bc-4786-83ee-2fea064a12a9:3641:1874622881561216:0@lo:400:kworker.0 00000100:00100000:1.0:1787779914.015059:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04779430c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881561728:0@lo:400:kworker.0 00010000:00080000:1.0:1787779914.015066:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c04764403c0 x1874622881562240/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779930 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787779914.015071:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04764403c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881562240:0@lo:400:kworker.0 00010000:00080000:1.0:1787779914.015076:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0476440b40 x1874622881562752/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779930 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787779914.015081:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0476440b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881562752:0@lo:400:kworker.0 00000100:00100000:1.0:1787779914.015131:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787779914.015138:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347a87840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881562880:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787779914.015157:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779914.015286:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881562880 00000100:00100000:0.0:1787779914.015290:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881562880 00000100:00100000:0.0:1787779914.015327:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787779914.015334:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c047796cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881562880:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787779914.015355:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787779914.015401:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c047796cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881562880:12345-0@lo:13:osp-pre-1-1.0 Request processed in 68us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779914.015404:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477943480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1874622881561344:0@lo:400:kworker.0 00000100:00100000:0.0:1787779914.015408:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00010000:00080000:3.0:1787779914.015508:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0347a87840 x1874622881562880/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779930 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779914.015521:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347a87840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881562880:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787779914.015586:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0476443c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1874622881561856:0@lo:400:kworker.0 00000100:00100000:2.0:1787779914.015596:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0476441e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1874622881562368:0@lo:400:kworker.0 00000100:00100000:3.0:1787779914.524072:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347e57c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881563008:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787779914.524148:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779914.524293:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047796c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881563136:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787779914.524327:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779914.524409:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881563008 00000100:00100000:1.0:1787779914.524417:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881563008 00000100:00100000:1.0:1787779914.524461:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881563136 00000100:00100000:1.0:1787779914.524464:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881563136 00000100:00100000:1.0:1787779914.524481:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787779914.524490:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347e55e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881563008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787779914.524513:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787779914.524569:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347e55e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881563008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779914.524577:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787779914.524593:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787779914.524599:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347e57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881563136:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787779914.524617:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787779914.524643:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347e57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881563136:12345-0@lo:13:osp-pre-0-1.0 Request processed in 45us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779914.524660:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00010000:00080000:3.0:1787779914.524923:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c047796c3c0 x1874622881563136/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779930 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779914.524940:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047796c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881563136:0@lo:13:osp-pre-0-1.0 00010000:00080000:3.0:1787779914.524967:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0347e57c00 x1874622881563008/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779930 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779914.524979:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347e57c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881563008:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787779914.908012:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787779915.040614:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346cff840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881563264:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787779915.040682:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779915.041070:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881563264 00000100:00100000:0.0:1787779915.041079:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881563264 00000100:00100000:0.0:1787779915.041175:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787779915.041185:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347e57c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874622881563264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787779915.041208:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787779915.041264:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347e57c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874622881563264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779915.041272:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00010000:00080000:1.0:1787779915.041348:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0346cff840 x1874622881563264/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779931 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787779915.041369:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346cff840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881563264:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787779915.670381:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787779915.670430:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787779915.670465:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787779915.670502:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863655296 00000100:00100000:0.0:1787779915.670509:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787779915.670512:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863655296 00000100:00100000:0.0:1787779915.670550:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787779915.670565:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863655040 00000100:00100000:3.0:1787779915.670571:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863655040 00000100:00100000:0.0:1787779915.670582:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787779915.670583:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863655552 00000100:00100000:2.0:1787779915.670589:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863655552 00000100:00100000:3.0:1787779915.670612:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 310 00000100:00100000:2.0:1787779915.670614:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863655168 00000100:00100000:0.0:1787779915.670619:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787779915.670620:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863655168 00000100:00100000:3.0:1787779915.670628:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0460828850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+13:2411:x1874622863655040:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1787779915.670640:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863655424 00000100:00100000:2.0:1787779915.670644:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863655424 00000100:00100000:0.0:1787779915.670654:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 171 00000100:00100000:0.0:1787779915.670667:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347a84f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:2411:x1874622863655296:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1787779915.670670:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 172 00000100:00100000:2.0:1787779915.670682:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347a87840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+5:2411:x1874622863655552:12345-192.168.203.31@tcp:400:kworker.0 00000100:00080000:1.0:1787779915.670712:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787779915.670718:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787779915.670731:0:6514:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1787779915.670741:0:6514:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:0.0:1787779915.670743:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347a84f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:2411:x1874622863655296:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 79us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779915.670751:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 171 00000100:00100000:0.0:1787779915.670772:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 173 00000100:00100000:0.0:1787779915.670779:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0476443c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+6:2411:x1874622863655168:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1787779915.671420:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347a87840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+5:2411:x1874622863655552:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 674us (888us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779915.671429:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 172 00000100:00100000:2.0:1787779915.671445:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 174 00000100:00100000:2.0:1787779915.671453:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0476440b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+5:2411:x1874622863655424:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1787779915.671492:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0476440b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+5:2411:x1874622863655424:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 40us (912us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779915.671499:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 174 00000100:00100000:1.0:1787779915.673928:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863655808 00000100:00100000:1.0:1787779915.673939:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863655808 00000100:00100000:1.0:1787779915.674001:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863655680 00000100:00100000:1.0:1787779915.674005:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863655680 00000100:00100000:1.0:1787779915.674041:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 76 00000100:00100000:1.0:1787779915.674050:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0476441e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+5:2411:x1874622863655808:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1787779915.674113:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0476441e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+5:2411:x1874622863655808:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 64us (3606us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779915.674121:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 76 00000100:00100000:1.0:1787779915.674137:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 77 00000100:00100000:1.0:1787779915.674144:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04764403c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+5:2411:x1874622863655680:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1787779915.674169:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04764403c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+5:2411:x1874622863655680:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 26us (3555us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779915.674175:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 77 00000100:00080000:2.0:1787779915.674920:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787779915.674926:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787779915.674943:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0460828850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+13:2411:x1874622863655040:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 4252us (4505us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779915.674955:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 310 00000100:00100000:0.0:1787779915.676444:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0476443c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+6:2411:x1874622863655168:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 5658us (5887us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779915.676457:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 173 00000020:00000004:0.0:1787779915.742716:0:12498:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787779915.742957:0:12498:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787779915.932160:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787779916.573022:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346cfd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874622881563392:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787779916.573124:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779916.573238:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881563392 00000100:00100000:2.0:1787779916.573245:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881563392 00000100:00100000:2.0:1787779916.573300:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1787779916.573309:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c047796e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1874622881563392:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787779916.573355:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787779916.573400:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c047796e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1874622881563392:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779916.573407:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1787779916.573479:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346cfd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874622881563392:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1787779916.956140:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787779917.084051:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787779917.084075:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346cfd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881563520:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787779917.084163:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779917.084364:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881563520 00000100:00100000:2.0:1787779917.084372:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881563520 00000100:00100000:2.0:1787779917.084424:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1787779917.084433:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c047796c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881563520:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787779917.084464:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787779917.084508:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c047796c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881563520:12345-0@lo:41:osp-pre-1-0.0 Request processed in 77us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779917.084515:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1787779917.084653:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346cfd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881563520:0@lo:41:osp-pre-1-0.0 00000020:00000004:1.0:1787779917.843762:0:12596:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787779917.845392:0:12596:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787779917.982613:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787779919.006432:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787779919.132219:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346dac780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874622881563904:0@lo:400:kworker.0 00000100:00100000:1.0:1787779919.132298:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779919.132348:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346da7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1874622881564416:0@lo:400:kworker.0 00000100:00100000:1.0:1787779919.132373:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779919.132395:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477af3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1874622881564928:0@lo:400:kworker.0 00000100:00100000:1.0:1787779919.132434:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779919.132464:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1787779919.132470:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346dae1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1874622881563776:0@lo:400:kworker.0 00000100:00100000:1.0:1787779919.132492:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779919.132598:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346dad2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1f575176-36bc-4786-83ee-2fea064a12a9:3644:1874622881563648:0@lo:400:kworker.0 00000100:00100000:2.0:1787779919.132633:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779919.132671:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346dade00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881564160:0@lo:400:kworker.0 00000100:00100000:2.0:1787779919.132694:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779919.132721:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346da70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881564672:0@lo:400:kworker.0 00000100:00100000:2.0:1787779919.132746:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779919.132763:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477af2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881565184:0@lo:400:kworker.0 00000100:00100000:2.0:1787779919.132785:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779919.132804:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1787779919.132810:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346dae580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874622881564032:0@lo:400:kworker.0 00000100:00100000:2.0:1787779919.132831:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779919.132885:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346da43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881564544:0@lo:400:kworker.0 00000100:00100000:2.0:1787779919.132908:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779919.132926:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477af30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881565056:0@lo:400:kworker.0 00000100:00100000:2.0:1787779919.132946:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779919.132976:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881563904 00000100:00100000:2.0:1787779919.132983:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881563904 00000100:00100000:2.0:1787779919.133017:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881564160 00000100:00100000:2.0:1787779919.133020:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881564160 00000100:00100000:2.0:1787779919.133036:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1787779919.133043:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477af03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1874622881563904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779919.133091:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477af03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1874622881563904:12345-0@lo:400:kworker.0 Request processed in 49us (794us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779919.133098:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1787779919.133113:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1787779919.133119:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346cfd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881564160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779919.133147:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346cfd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881564160:12345-0@lo:400:kworker.0 Request processed in 28us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779919.133152:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1787779919.133166:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881564416 00000100:00100000:2.0:1787779919.133175:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881564416 00000100:00100000:2.0:1787779919.133205:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881564928 00000100:00100000:2.0:1787779919.133208:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881564928 00000100:00100000:2.0:1787779919.133220:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881563776 00000100:00100000:2.0:1787779919.133222:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881563776 00000100:00100000:2.0:1787779919.133231:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881564032 00000100:00100000:2.0:1787779919.133233:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881564032 00000100:00100000:2.0:1787779919.133245:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1787779919.133250:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477af21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1874622881564416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779919.133290:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477af21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1874622881564416:12345-0@lo:400:kworker.0 Request processed in 40us (916us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779919.133296:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1787779919.133307:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1787779919.133313:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0458b89680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1874622881564928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779919.133338:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0458b89680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1874622881564928:12345-0@lo:400:kworker.0 Request processed in 26us (904us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779919.133344:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1787779919.133354:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1787779919.133359:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477988000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1874622881563776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779919.133385:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477988000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1874622881563776:12345-0@lo:400:kworker.0 Request processed in 26us (893us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779919.133390:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1787779919.133399:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1787779919.133405:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046215ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1874622881564032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779919.133429:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046215ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1874622881564032:12345-0@lo:400:kworker.0 Request processed in 25us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779919.133435:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1787779919.133463:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881564672 00000100:00100000:2.0:1787779919.133467:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881564672 00000100:00100000:2.0:1787779919.133484:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881565184 00000100:00100000:2.0:1787779919.133486:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881565184 00000100:00100000:2.0:1787779919.133496:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881564544 00000100:00100000:2.0:1787779919.133498:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881564544 00000100:00100000:2.0:1787779919.133522:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881565056 00000100:00100000:2.0:1787779919.133525:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881565056 00000100:00100000:2.0:1787779919.133536:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787779919.133542:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346cff840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881564672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779919.133573:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346cff840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881564672:12345-0@lo:400:kworker.0 Request processed in 32us (827us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779919.133579:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787779919.133590:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787779919.133596:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046215fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881565184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779919.133621:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046215fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881565184:12345-0@lo:400:kworker.0 Request processed in 26us (836us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779919.133627:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787779919.133636:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787779919.133641:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046215d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881564544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779919.133665:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046215d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881564544:12345-0@lo:400:kworker.0 Request processed in 24us (756us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779919.133670:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787779919.133678:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787779919.133683:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046215c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881565056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779919.133704:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046215c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881565056:12345-0@lo:400:kworker.0 Request processed in 21us (757us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779919.133718:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:2.0:1787779919.133744:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787779919.133748:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787779919.133750:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787779919.133777:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346dae580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874622881564032:0@lo:400:kworker.0 00010000:00080000:2.0:1787779919.133790:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0346da43c0 x1874622881564544/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779935 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787779919.133800:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346da43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881564544:0@lo:400:kworker.0 00010000:00080000:2.0:1787779919.133810:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0477af30c0 x1874622881565056/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779935 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787779919.133817:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477af30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881565056:0@lo:400:kworker.0 00000100:00100000:2.0:1787779919.133827:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346dade00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881564160:0@lo:400:kworker.0 00010000:00080000:2.0:1787779919.133835:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0346da70c0 x1874622881564672/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779935 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787779919.133865:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346da70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881564672:0@lo:400:kworker.0 00010000:00080000:2.0:1787779919.133876:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0477af2940 x1874622881565184/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779935 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787779919.133884:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477af2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881565184:0@lo:400:kworker.0 00000100:00100000:1.0:1787779919.134350:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346dae1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1874622881563776:0@lo:400:kworker.0 00000100:00100000:1.0:1787779919.134359:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346da4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1874622881564288:0@lo:400:kworker.0 00000100:00100000:1.0:1787779919.134386:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779919.134404:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477af2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1874622881564800:0@lo:400:kworker.0 00000100:00100000:1.0:1787779919.134424:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779919.134446:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346dac780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874622881563904:0@lo:400:kworker.0 00010000:00080000:1.0:1787779919.134457:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0346da7840 x1874622881564416/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779935 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787779919.134465:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346da7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1874622881564416:0@lo:400:kworker.0 00010000:00080000:1.0:1787779919.134475:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0477af3480 x1874622881564928/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779935 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787779919.134483:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477af3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1874622881564928:0@lo:400:kworker.0 00000100:00100000:1.0:1787779919.134619:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881564288 00000100:00100000:1.0:1787779919.134623:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881564288 00000100:00100000:1.0:1787779919.134663:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881564800 00000100:00100000:1.0:1787779919.134667:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881564800 00000100:00100000:1.0:1787779919.134682:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1787779919.134688:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c047798a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1874622881564288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787779919.134726:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c047798a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1874622881564288:12345-0@lo:400:kworker.0 Request processed in 37us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779919.134741:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1787779919.134754:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1787779919.134759:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477988f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1874622881564800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787779919.134784:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477988f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1874622881564800:12345-0@lo:400:kworker.0 Request processed in 25us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779919.134789:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1787779919.134818:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346da4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1874622881564288:0@lo:400:kworker.0 00000100:00100000:1.0:1787779919.134827:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477af2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1874622881564800:0@lo:400:kworker.0 00000100:00080000:0.0:1787779919.135055:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787779919.135135:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881563648 00000100:00100000:3.0:1787779919.135139:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881563648 00000100:00100000:3.0:1787779919.135167:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:3.0:1787779919.135189:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0448bf3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+24:3644:x1874622881563648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779919.135237:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0448bf3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+24:3644:x1874622881563648:12345-0@lo:400:kworker.0 Request processed in 49us (2603us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779919.135245:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:3.0:1787779919.135297:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346dad2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1f575176-36bc-4786-83ee-2fea064a12a9:3644:1874622881563648:0@lo:400:kworker.0 00000100:00100000:1.0:1787779919.135832:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787779919.136168:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0476443480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874622881565312:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787779919.136305:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779919.136363:0:8529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881565312 00000100:00100000:2.0:1787779919.136368:0:8529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881565312 00000100:00100000:2.0:1787779919.136440:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787779919.136448:0:8529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477989e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1874622881565312:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787779919.136470:0:8529:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787779919.136532:0:8529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477989e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1874622881565312:12345-0@lo:13:osp-pre-1-1.0 Request processed in 85us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779919.136539:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00010000:00080000:1.0:1787779919.136589:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0476443480 x1874622881565312/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779935 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787779919.136605:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0476443480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874622881565312:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787779919.645197:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04764430c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881565440:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787779919.645311:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779919.645408:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881565440 00000100:00100000:0.0:1787779919.645415:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881565440 00000100:00100000:0.0:1787779919.645461:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787779919.645470:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0476443840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1874622881565440:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787779919.645492:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787779919.645537:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0476443840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1874622881565440:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779919.645555:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00010000:00080000:0.0:1787779919.645598:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c04764430c0 x1874622881565440/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779935 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787779919.645617:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04764430c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881565440:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787779919.645752:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787779919.645762:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c046215da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881565568:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787779919.645795:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779919.645824:0:8529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881565568 00000100:00100000:2.0:1787779919.645828:0:8529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881565568 00000100:00100000:2.0:1787779919.645878:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787779919.645885:0:8529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046215de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881565568:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787779919.645902:0:8529:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787779919.645935:0:8529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046215de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881565568:12345-0@lo:13:osp-pre-0-1.0 Request processed in 50us (140us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779919.645942:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00010000:00080000:2.0:1787779919.645968:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c046215da40 x1874622881565568/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779935 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787779919.645981:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c046215da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881565568:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1787779920.039622:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1787779920.148782:0:12693:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787779920.149033:0:12693:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1787779920.158958:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477af2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881565696:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787779920.159028:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779920.159118:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881565696 00000100:00100000:2.0:1787779920.159124:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881565696 00000100:00100000:2.0:1787779920.159170:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787779920.159177:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477af3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881565696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787779920.159198:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787779920.159241:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477af3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881565696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 64us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779920.159265:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00080000:2.0:1787779920.159305:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0477af2580 x1874622881565696/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779936 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787779920.159323:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477af2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881565696:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787779920.790065:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787779920.790096:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787779920.790125:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787779920.790146:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787779920.795955:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863655936 00000100:00100000:2.0:1787779920.795969:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863655936 00000100:00100000:2.0:1787779920.798462:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 312 00000100:00100000:2.0:1787779920.798483:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c045ab81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+13:2411:x1874622863655936:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1787779920.798568:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c045ab81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+13:2411:x1874622863655936:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 94us (8441us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779920.798575:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 312 00000100:00100000:1.0:1787779920.798797:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863656064 00000100:00100000:1.0:1787779920.798805:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863656064 00000100:00100000:1.0:1787779920.798890:0:12488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863656320 00000100:00100000:1.0:1787779920.798893:0:12488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863656320 00000100:00100000:1.0:1787779920.798917:0:12488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 181 00000100:00100000:1.0:1787779920.798924:0:12488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347e543c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:781d29bb-23d2-48e3-b16d-c29e52cd5375+6:2411:x1874622863656064:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1787779920.798958:0:12488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347e543c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:781d29bb-23d2-48e3-b16d-c29e52cd5375+6:2411:x1874622863656064:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 35us (8902us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779920.798980:0:12488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 181 00000100:00100000:1.0:1787779920.798994:0:12488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 182 00000100:00100000:1.0:1787779920.799000:0:12488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347e55a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+5:2411:x1874622863656320:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1787779920.799023:0:12488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347e55a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+5:2411:x1874622863656320:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 23us (8926us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779920.799029:0:12488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 182 00000100:00080000:0.0:1787779920.801982:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787779920.806016:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863656192 00000100:00100000:2.0:1787779920.806029:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863656192 00000100:00080000:1.0:1787779920.806074:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787779920.806178:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 183 00000100:00100000:2.0:1787779920.806190:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347e56940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:2411:x1874622863656192:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1787779920.806271:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347e56940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:2411:x1874622863656192:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 84us (16124us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779920.806280:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 183 00000100:00100000:3.0:1787779920.806668:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787779920.806709:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787779920.806725:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863656448 00000100:00100000:1.0:1787779920.806729:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863656448 00000100:00100000:3.0:1787779920.806741:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787779920.806758:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863656576 00000100:00100000:1.0:1787779920.806760:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 184 00000100:00100000:3.0:1787779920.806761:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863656576 00000100:00100000:1.0:1787779920.806767:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347e57840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+5:2411:x1874622863656448:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1787779920.806785:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863656704 00000100:00100000:3.0:1787779920.806788:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863656704 00000100:00100000:1.0:1787779920.806801:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347e57840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+5:2411:x1874622863656448:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 34us (904us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779920.806806:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 22 00000100:00100000:1.0:1787779920.806808:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 184 00000100:00100000:3.0:1787779920.806813:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347a843c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+5:2407:x1874622863656576:12345-192.168.203.31@tcp:9:kworker.0 00000100:00080000:1.0:1787779920.806822:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787779920.806825:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787779920.806826:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000080:3.0:1787779920.806830:0:9899:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc8fc0a517996077a 00000100:00080000:3.0:1787779920.806856:0:9899:0:(import.c:65:import_set_state_nolock()) ffff9c0481215800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787779920.808032:0:9899:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1787779920.808184:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347a843c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+2:2407:x1874622863656576:12345-192.168.203.31@tcp:9:kworker.0 Request processed in 1368us (1471us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779920.808193:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 22 00000100:00100000:3.0:1787779920.808211:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 23 00000100:00100000:3.0:1787779920.808220:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346d4cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+5:2407:x1874622863656704:12345-192.168.203.31@tcp:9:kworker.0 00000020:00000080:3.0:1787779920.808235:0:9899:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc8fc0a5179960781 00000100:00080000:3.0:1787779920.808247:0:9899:0:(import.c:65:import_set_state_nolock()) ffff9c0481210800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787779920.808288:0:9899:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1787779920.808358:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346d4cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+2:2407:x1874622863656704:12345-192.168.203.31@tcp:9:kworker.0 Request processed in 139us (1616us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779920.808365:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 23 00010000:00010000:3.0:1787779920.808387:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787779920.808393:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787779921.052758:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787779921.692377:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477af2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881565824:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787779921.692661:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779921.693241:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881565824 00000100:00100000:2.0:1787779921.694051:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881565824 00000100:00100000:2.0:1787779921.694229:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1787779921.694242:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04764430c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881565824:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787779921.694302:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787779921.694385:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04764430c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881565824:12345-0@lo:41:osp-pre-0-1.0 Request processed in 147us (1725us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779921.694407:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1787779921.695639:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477af2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881565824:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1787779922.078183:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787779922.206556:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787779922.206588:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477af2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881565952:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787779922.206686:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779922.206959:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881565952 00000100:00100000:2.0:1787779922.206970:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881565952 00000100:00100000:2.0:1787779922.207033:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1787779922.207044:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0476443480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874622881565952:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787779922.207088:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787779922.207153:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0476443480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874622881565952:12345-0@lo:41:osp-pre-1-0.0 Request processed in 111us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779922.207161:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1787779922.207376:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477af2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881565952:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1787779923.100361:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787779923.471953:0:12790:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787779923.472208:0:12790:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787779924.124375:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787779924.252602:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047798ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881566080:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787779924.252693:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779924.252790:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881566080 00000100:00100000:1.0:1787779924.252799:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881566080 00000100:00100000:1.0:1787779924.252880:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787779924.252892:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c047798b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881566080:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787779924.252929:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787779924.252995:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c047798b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881566080:12345-0@lo:13:osp-pre-1-1.0 Request processed in 106us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779924.253003:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:1.0:1787779924.253027:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1787779924.253060:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c047798ad00 x1874622881566080/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779940 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787779924.253081:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047798ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881566080:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787779924.256055:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0461955e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874622881566336:0@lo:400:kworker.0 00000100:00100000:3.0:1787779924.256153:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779924.256202:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0476497840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1874622881566848:0@lo:400:kworker.0 00000100:00100000:3.0:1787779924.256239:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779924.256272:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0476494f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1874622881567360:0@lo:400:kworker.0 00000100:00100000:3.0:1787779924.256295:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779924.256323:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1787779924.256329:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04619570c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881566464:0@lo:400:kworker.0 00000100:00100000:3.0:1787779924.256356:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779924.256374:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0476494780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1874622881566976:0@lo:400:kworker.0 00000100:00100000:3.0:1787779924.256394:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779924.256414:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04764961c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1874622881567488:0@lo:400:kworker.0 00000100:00100000:3.0:1787779924.256435:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779924.256480:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881566336 00000100:00100000:3.0:1787779924.256490:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881566336 00000100:00100000:3.0:1787779924.256544:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881566848 00000100:00100000:3.0:1787779924.256565:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881566848 00000100:00100000:3.0:1787779924.256793:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881567360 00000100:00100000:3.0:1787779924.256797:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881567360 00000100:00100000:3.0:1787779924.256811:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881566976 00000100:00100000:3.0:1787779924.256814:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881566976 00000100:00100000:3.0:1787779924.256826:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881567488 00000100:00100000:3.0:1787779924.256828:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881567488 00000100:00100000:3.0:1787779924.256882:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1787779924.256892:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0461bec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874622881566336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779924.258379:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0461bec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874622881566336:12345-0@lo:400:kworker.0 Request processed in 1479us (2217us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779924.258395:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1787779924.258437:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1787779924.258453:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0461bede00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874622881566848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779924.258517:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0461bede00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874622881566848:12345-0@lo:400:kworker.0 Request processed in 71us (2289us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779924.258524:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1787779924.258538:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1787779924.258545:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0461bee940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1874622881567360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779924.263533:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0461bee940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1874622881567360:12345-0@lo:400:kworker.0 Request processed in 4969us (7216us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779924.263553:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1787779924.263757:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0461954f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1f575176-36bc-4786-83ee-2fea064a12a9:3644:1874622881566208:0@lo:400:kworker.0 00000100:00100000:1.0:1787779924.263883:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779924.263946:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0476494b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881566720:0@lo:400:kworker.0 00000100:00100000:1.0:1787779924.263973:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779924.263993:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0476495e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881567232:0@lo:400:kworker.0 00000100:00100000:1.0:1787779924.264014:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779924.264043:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1787779924.264050:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0461956940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874622881566592:0@lo:400:kworker.0 00000100:00100000:1.0:1787779924.264076:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779924.264086:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04764970c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881567104:0@lo:400:kworker.0 00000100:00100000:1.0:1787779924.264107:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779924.264127:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0461becb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881567616:0@lo:400:kworker.0 00000100:00100000:1.0:1787779924.264147:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779924.267192:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881566592 00000100:00100000:3.0:1787779924.267212:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881566592 00000100:00100000:3.0:1787779924.267288:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1787779924.267304:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0461becf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1874622881566976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779924.267435:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0461becf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1874622881566976:12345-0@lo:400:kworker.0 Request processed in 136us (11039us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779924.267463:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1787779924.267485:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1787779924.267492:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0461bed680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1874622881567488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779924.267532:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0461bed680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1874622881567488:12345-0@lo:400:kworker.0 Request processed in 41us (11096us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779924.267539:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1787779924.267551:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1787779924.267557:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04812a92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1874622881566592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779924.267614:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04812a92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1874622881566592:12345-0@lo:400:kworker.0 Request processed in 57us (3536us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779924.267620:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1787779924.267666:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881566464 00000100:00100000:3.0:1787779924.267672:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881566464 00000100:00100000:3.0:1787779924.267694:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881566720 00000100:00100000:3.0:1787779924.267697:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881566720 00000100:00100000:3.0:1787779924.267710:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1787779924.267716:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0461bed2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881566464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779924.267755:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0461bed2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881566464:12345-0@lo:400:kworker.0 Request processed in 40us (11398us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779924.267761:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1787779924.267772:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1787779924.267778:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c047798ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881566720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779924.267808:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c047798ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881566720:12345-0@lo:400:kworker.0 Request processed in 31us (3833us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779924.267813:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1787779924.267875:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881566208 00000100:00100000:3.0:1787779924.267879:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881566208 00000100:00100000:3.0:1787779924.267917:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:3.0:1787779924.267924:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c045ab83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+24:3644:x1874622881566208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779924.267960:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c045ab83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+24:3644:x1874622881566208:12345-0@lo:400:kworker.0 Request processed in 37us (4077us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779924.267967:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:3.0:1787779924.268011:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881567232 00000100:00100000:3.0:1787779924.268015:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881567232 00000100:00100000:3.0:1787779924.268053:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881567104 00000100:00100000:3.0:1787779924.268057:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881567104 00000100:00100000:3.0:1787779924.268070:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881567616 00000100:00100000:3.0:1787779924.268073:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881567616 00000100:00100000:3.0:1787779924.268086:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787779924.268092:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c047798a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881567232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779924.268125:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c047798a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881567232:12345-0@lo:400:kworker.0 Request processed in 34us (4110us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779924.268132:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787779924.268143:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787779924.268149:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04812aa580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881567104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779924.268182:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04812aa580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881567104:12345-0@lo:400:kworker.0 Request processed in 33us (4074us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779924.268188:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787779924.268198:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787779924.268204:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04812a8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881567616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779924.268268:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04812a8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881567616:12345-0@lo:400:kworker.0 Request processed in 64us (4120us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779924.268284:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:3.0:1787779924.268314:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787779924.268319:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787779924.268322:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787779924.268326:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787779924.268378:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04619570c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881566464:0@lo:400:kworker.0 00010000:00080000:3.0:1787779924.268398:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0476494780 x1874622881566976/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779940 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779924.268410:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0476494780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1874622881566976:0@lo:400:kworker.0 00010000:00080000:3.0:1787779924.268422:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c04764961c0 x1874622881567488/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779940 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779924.268432:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04764961c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1874622881567488:0@lo:400:kworker.0 00000100:00100000:3.0:1787779924.268446:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0461955e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874622881566336:0@lo:400:kworker.0 00000100:00100000:3.0:1787779924.268458:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0476497840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1874622881566848:0@lo:400:kworker.0 00000100:00100000:3.0:1787779924.268471:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0476494f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1874622881567360:0@lo:400:kworker.0 00000100:00100000:1.0:1787779924.270203:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0461956940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874622881566592:0@lo:400:kworker.0 00010000:00080000:1.0:1787779924.270241:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c04764970c0 x1874622881567104/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779940 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787779924.270253:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04764970c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881567104:0@lo:400:kworker.0 00010000:00080000:1.0:1787779924.270294:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0461becb40 x1874622881567616/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779940 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787779924.270302:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0461becb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881567616:0@lo:400:kworker.0 00000100:00100000:1.0:1787779924.270312:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0461954f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1f575176-36bc-4786-83ee-2fea064a12a9:3644:1874622881566208:0@lo:400:kworker.0 00000100:00100000:1.0:1787779924.270324:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0476494b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881566720:0@lo:400:kworker.0 00010000:00080000:1.0:1787779924.270336:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0476495e00 x1874622881567232/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779940 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787779924.270343:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0476495e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881567232:0@lo:400:kworker.0 00000100:00100000:2.0:1787779924.764100:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787779924.764131:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477af30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881567744:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787779924.764240:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779924.764322:0:8529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881567744 00000100:00100000:2.0:1787779924.764344:0:8529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881567744 00000100:00100000:2.0:1787779924.764406:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787779924.764417:0:8529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477af2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881567744:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787779924.764631:0:8529:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787779924.764697:0:8529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477af2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881567744:12345-0@lo:13:osp-pre-0-1.0 Request processed in 282us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779924.764705:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00010000:00080000:0.0:1787779924.764945:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0477af30c0 x1874622881567744/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779940 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787779924.764967:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477af30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881567744:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787779924.765127:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477af2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881567872:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787779924.765166:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779924.765388:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881567872 00000100:00100000:1.0:1787779924.765394:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881567872 00000100:00100000:1.0:1787779924.765436:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787779924.765444:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04779421c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874622881567872:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787779924.765459:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787779924.774549:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04779421c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874622881567872:12345-0@lo:13:osp-pre-1-0.0 Request processed in 9089us (9366us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779924.774568:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00010000:00080000:0.0:1787779924.777738:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0477af2580 x1874622881567872/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779940 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787779924.777774:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477af2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881567872:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787779925.159898:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787779925.277265:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477af2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881568000:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787779925.277367:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779925.277820:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881568000 00000100:00100000:2.0:1787779925.277869:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881568000 00000100:00100000:2.0:1787779925.277952:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787779925.277966:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477943480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1874622881568000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787779925.277999:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787779925.278069:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477943480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1874622881568000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (702us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779925.278077:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00010000:00080000:0.0:1787779925.278258:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0477af2580 x1874622881568000/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779941 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787779925.278283:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477af2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881568000:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787779925.914046:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787779925.914101:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787779925.914134:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787779925.914168:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787779925.914223:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787779925.914266:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863657088 00000100:00100000:0.0:1787779925.914279:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863657088 00000100:00100000:0.0:1787779925.914354:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863657344 00000100:00100000:0.0:1787779925.914358:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863657344 00000100:00100000:0.0:1787779925.914376:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863656960 00000100:00100000:0.0:1787779925.914379:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863656960 00000100:00100000:0.0:1787779925.914392:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863657216 00000100:00100000:0.0:1787779925.914395:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863657216 00000100:00100000:0.0:1787779925.914413:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 191 00000100:00100000:0.0:1787779925.914423:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04779430c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:2408:x1874622863657088:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1787779925.914558:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04779430c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:2408:x1874622863657088:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 136us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779925.914567:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 191 00000100:00100000:0.0:1787779925.914591:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 192 00000100:00100000:2.0:1787779925.914938:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863656832 00000100:00100000:2.0:1787779925.914943:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863656832 00000100:00100000:2.0:1787779925.914986:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 314 00000100:00100000:2.0:1787779925.914995:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0478612050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+13:2408:x1874622863656832:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1787779925.915031:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0478612050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+13:2408:x1874622863656832:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 38us (1001us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779925.915038:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 314 00000100:00100000:0.0:1787779925.916046:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477941680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+5:2408:x1874622863657344:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1787779925.916110:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477941680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+5:2408:x1874622863657344:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 76us (1974us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779925.916119:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 192 00000100:00100000:0.0:1787779925.916337:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 193 00000100:00100000:0.0:1787779925.916364:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477943840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+6:2408:x1874622863656960:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1787779925.916399:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477943840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+6:2408:x1874622863656960:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 38us (2231us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779925.916406:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 193 00000100:00100000:0.0:1787779925.916420:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 194 00000100:00100000:0.0:1787779925.916427:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477942d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+5:2408:x1874622863657216:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1787779925.916455:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477942d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+5:2408:x1874622863657216:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 28us (2241us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779925.916461:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 194 00000100:00080000:0.0:1787779925.916500:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787779925.916506:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1787779926.175622:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787779926.815530:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477af30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881568128:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787779926.815622:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779926.815725:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881568128 00000100:00100000:2.0:1787779926.815745:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881568128 00000100:00100000:2.0:1787779926.815800:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1787779926.815810:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477af2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881568128:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787779926.815884:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787779926.815954:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477af2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881568128:12345-0@lo:41:osp-pre-0-1.0 Request processed in 146us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779926.815962:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1787779926.816019:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477af30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881568128:0@lo:41:osp-pre-0-1.0 00000001:00100000:2.0:1787779926.821001:0:8423:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 25f2eabf-81ed-4798-a9a9-6e0f6dda29ab 00000020:00000080:2.0:1787779926.821015:0:8423:0:(genops.c:885:class_export_put()) final put ffff9c0481211000/25f2eabf-81ed-4798-a9a9-6e0f6dda29ab 00000020:00000080:0.0:1787779926.821993:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c0481211000/25f2eabf-81ed-4798-a9a9-6e0f6dda29ab for lustre-OST0000 00000020:00000080:0.0:1787779926.822063:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c0481215800 for lustre-OST0000 00000001:00100000:2.0:1787779926.825019:0:9508:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 25f2eabf-81ed-4798-a9a9-6e0f6dda29ab 00000020:00000080:2.0:1787779926.825031:0:9508:0:(genops.c:885:class_export_put()) final put ffff9c0481214000/25f2eabf-81ed-4798-a9a9-6e0f6dda29ab 00000020:00000080:3.0:1787779926.825459:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c0481214000/25f2eabf-81ed-4798-a9a9-6e0f6dda29ab for lustre-OST0001 00000020:00000080:3.0:1787779926.825521:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c0481210800 for lustre-OST0001 00000020:00000004:2.0:1787779927.067763:0:12888:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787779927.069135:0:12888:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787779927.198267:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787779927.324517:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787779927.329121:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347bced00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881568256:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787779927.329251:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779927.330142:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881568256 00000100:00100000:3.0:1787779927.330153:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881568256 00000100:00100000:3.0:1787779927.330273:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1787779927.330286:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477af30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881568256:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787779927.330334:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787779927.330437:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477af30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881568256:12345-0@lo:41:osp-pre-1-0.0 Request processed in 153us (1186us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779927.330446:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1787779927.330541:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347bced00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881568256:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1787779928.220309:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787779929.244562:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787779929.372771:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787779929.372806:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04812a8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874622881568384:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787779929.372930:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779929.373124:0:8529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881568384 00000100:00100000:1.0:1787779929.373133:0:8529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881568384 00000100:00100000:1.0:1787779929.373224:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1787779929.373237:0:8529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0461bec780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1874622881568384:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787779929.373279:0:8529:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787779929.373338:0:8529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0461bec780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1874622881568384:12345-0@lo:13:osp-pre-1-1.0 Request processed in 104us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779929.373368:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1787779929.373550:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04812a9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1874622881568640:0@lo:400:kworker.0 00000100:00100000:1.0:1787779929.373586:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779929.373608:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04812ab840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1874622881569152:0@lo:400:kworker.0 00000100:00100000:1.0:1787779929.373631:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779929.373647:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047785e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1874622881569664:0@lo:400:kworker.0 00000100:00100000:1.0:1787779929.373666:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779929.373687:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1787779929.373693:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04812ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881568768:0@lo:400:kworker.0 00000100:00100000:1.0:1787779929.373719:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779929.373984:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0476440f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1874622881569280:0@lo:400:kworker.0 00000100:00100000:1.0:1787779929.374013:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779929.374041:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047785f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1874622881569792:0@lo:400:kworker.0 00000100:00100000:1.0:1787779929.374064:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779929.374104:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881568640 00000100:00100000:1.0:1787779929.374108:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881568640 00000100:00100000:1.0:1787779929.374137:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881569152 00000100:00100000:1.0:1787779929.374141:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881569152 00000100:00100000:1.0:1787779929.374155:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881569664 00000100:00100000:1.0:1787779929.374157:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881569664 00000100:00100000:1.0:1787779929.374169:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881569280 00000100:00100000:1.0:1787779929.374171:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881569280 00000100:00100000:1.0:1787779929.374181:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881569792 00000100:00100000:1.0:1787779929.374183:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881569792 00000100:00100000:1.0:1787779929.374211:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1787779929.374219:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346de21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1874622881568640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787779929.374276:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346de21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1874622881568640:12345-0@lo:400:kworker.0 Request processed in 57us (689us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779929.374284:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1787779929.374301:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1787779929.374307:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346de30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1874622881569152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787779929.374336:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346de30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1874622881569152:12345-0@lo:400:kworker.0 Request processed in 30us (704us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779929.374341:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1787779929.374352:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1787779929.374357:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346de0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1874622881569664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787779929.374383:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346de0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1874622881569664:12345-0@lo:400:kworker.0 Request processed in 26us (717us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779929.374389:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1787779929.374401:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1787779929.374407:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346de1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1874622881569280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779929.375675:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04812aad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874622881568896:0@lo:400:kworker.0 00000100:00100000:2.0:1787779929.375751:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779929.375775:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047785e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881569408:0@lo:400:kworker.0 00000100:00100000:2.0:1787779929.375805:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779929.375827:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047785fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881569920:0@lo:400:kworker.0 00000100:00100000:2.0:1787779929.375890:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779929.375914:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1787779929.375921:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04812a9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1f575176-36bc-4786-83ee-2fea064a12a9:3641:1874622881568512:0@lo:400:kworker.0 00000100:00100000:2.0:1787779929.375949:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779929.375996:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04812a8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881569024:0@lo:400:kworker.0 00000100:00100000:2.0:1787779929.376022:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779929.376041:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047785ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881569536:0@lo:400:kworker.0 00000100:00100000:2.0:1787779929.376062:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779929.376094:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881568512 00000100:00100000:2.0:1787779929.376102:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881568512 00000100:00100000:2.0:1787779929.376151:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:2.0:1787779929.376159:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0478610450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+24:3641:x1874622881568512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779929.376219:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0478610450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+24:3641:x1874622881568512:12345-0@lo:400:kworker.0 Request processed in 60us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779929.376226:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:2.0:1787779929.376282:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04812a9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1f575176-36bc-4786-83ee-2fea064a12a9:3641:1874622881568512:0@lo:400:kworker.0 00000100:00100000:2.0:1787779929.376342:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881568896 00000100:00100000:2.0:1787779929.376356:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881568896 00000100:00100000:2.0:1787779929.376380:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1787779929.376389:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346de1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1874622881569792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779929.376425:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346de1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1874622881569792:12345-0@lo:400:kworker.0 Request processed in 38us (2360us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779929.376430:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1787779929.376444:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1787779929.376449:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046215da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874622881568896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779929.376494:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046215da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874622881568896:12345-0@lo:400:kworker.0 Request processed in 45us (755us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779929.376500:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1787779929.376516:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881568768 00000100:00100000:2.0:1787779929.376521:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881568768 00000100:00100000:2.0:1787779929.376551:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881569024 00000100:00100000:2.0:1787779929.376554:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881569024 00000100:00100000:2.0:1787779929.376568:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1787779929.376574:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346de3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881568768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779929.376608:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346de3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881568768:12345-0@lo:400:kworker.0 Request processed in 34us (2888us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779929.376615:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1787779929.376626:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1787779929.376631:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346da70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874622881569024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779929.376656:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346da70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874622881569024:12345-0@lo:400:kworker.0 Request processed in 25us (634us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779929.376661:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1787779929.376697:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04812a8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881569024:0@lo:400:kworker.0 00000100:00100000:2.0:1787779929.376721:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04812aad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874622881568896:0@lo:400:kworker.0 00000100:00100000:2.0:1787779929.376769:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04812ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881568768:0@lo:400:kworker.0 00010000:00080000:2.0:1787779929.376784:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c047785f840 x1874622881569792/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779945 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787779929.376796:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047785f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1874622881569792:0@lo:400:kworker.0 00000100:00100000:2.0:1787779929.376809:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04812a9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1874622881568640:0@lo:400:kworker.0 00000100:00100000:2.0:1787779929.376821:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04812ab840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1874622881569152:0@lo:400:kworker.0 00000100:00100000:2.0:1787779929.376834:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047785e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1874622881569664:0@lo:400:kworker.0 00000100:00080000:3.0:1787779929.377993:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787779929.378002:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787779929.378005:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787779929.378026:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881569408 00000100:00100000:3.0:1787779929.378034:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881569408 00000100:00100000:3.0:1787779929.378098:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881569920 00000100:00100000:3.0:1787779929.378102:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881569920 00000100:00100000:3.0:1787779929.378120:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881569536 00000100:00100000:3.0:1787779929.378123:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881569536 00000100:00100000:3.0:1787779929.378137:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787779929.378146:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346da4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881569408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779929.378233:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346da4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881569408:12345-0@lo:400:kworker.0 Request processed in 87us (2426us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779929.378241:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787779929.378257:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787779929.378262:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346da7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1874622881569920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779929.378288:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346da7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1874622881569920:12345-0@lo:400:kworker.0 Request processed in 26us (2399us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779929.378293:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787779929.378304:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787779929.378311:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346da43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1874622881569536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779929.378353:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346da43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1874622881569536:12345-0@lo:400:kworker.0 Request processed in 43us (2291us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779929.378359:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00010000:00080000:3.0:1787779929.378419:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c04812a8f00 x1874622881568384/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779945 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779929.378443:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04812a8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874622881568384:0@lo:13:osp-pre-1-1.0 00010000:00080000:3.0:1787779929.378496:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c047785ed00 x1874622881569536/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779945 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779929.378506:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047785ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881569536:0@lo:400:kworker.0 00010000:00080000:3.0:1787779929.378516:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c047785e940 x1874622881569408/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779945 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779929.378525:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047785e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881569408:0@lo:400:kworker.0 00010000:00080000:3.0:1787779929.378537:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c047785fc00 x1874622881569920/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779945 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779929.378557:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047785fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881569920:0@lo:400:kworker.0 00000100:00100000:1.0:1787779929.378934:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346de1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1874622881569280:12345-0@lo:400:kworker.0 Request processed in 4525us (4918us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779929.378944:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00010000:00080000:3.0:1787779929.379695:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0476440f00 x1874622881569280/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779945 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779929.379710:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0476440f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1874622881569280:0@lo:400:kworker.0 00000100:00080000:2.0:1787779929.382080:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787779929.382091:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787779929.887464:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787779929.887496:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0461beed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881570048:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787779929.887593:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779929.887676:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881570048 00000100:00100000:3.0:1787779929.887686:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881570048 00000100:00100000:3.0:1787779929.887909:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787779929.887919:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0461becb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874622881570048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787779929.887948:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787779929.887999:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0461becb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874622881570048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779929.888007:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00010000:00080000:3.0:1787779929.888057:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0461beed00 x1874622881570048/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779945 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779929.888078:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0461beed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881570048:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787779929.891330:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787779929.891360:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047785fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881570176:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787779929.891462:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779929.891533:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881570176 00000100:00100000:2.0:1787779929.891543:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881570176 00000100:00100000:2.0:1787779929.891601:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787779929.891611:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c047785e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881570176:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787779929.891648:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787779929.891700:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c047785e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881570176:12345-0@lo:13:osp-pre-0-1.0 Request processed in 91us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779929.891952:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00010000:00080000:2.0:1787779929.891997:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c047785fc00 x1874622881570176/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779945 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787779929.892037:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047785fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881570176:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1787779930.270807:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787779930.402666:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346de2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881570304:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787779930.402756:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779930.402907:0:8529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881570304 00000100:00100000:1.0:1787779930.402916:0:8529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881570304 00000100:00100000:1.0:1787779930.402975:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787779930.402985:0:8529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347bce580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881570304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787779930.403013:0:8529:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787779930.403061:0:8529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347bce580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881570304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779930.403076:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00010000:00080000:0.0:1787779930.403251:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0346de2d00 x1874622881570304/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779946 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787779930.403274:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346de2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881570304:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787779931.032419:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787779931.032484:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787779931.032525:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787779931.032558:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787779931.032608:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787779931.032698:0:12488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863657728 00000100:00100000:1.0:1787779931.032711:0:12488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863657728 00000100:00100000:1.0:1787779931.032798:0:12488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863657984 00000100:00100000:1.0:1787779931.032802:0:12488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863657984 00000100:00100000:1.0:1787779931.032819:0:12488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863657600 00000100:00100000:1.0:1787779931.032822:0:12488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863657600 00000100:00100000:1.0:1787779931.032835:0:12488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863657856 00000100:00100000:1.0:1787779931.032878:0:12488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863657856 00000100:00100000:1.0:1787779931.032901:0:12488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 201 00000100:00100000:1.0:1787779931.032912:0:12488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347bcfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:2409:x1874622863657728:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1787779931.033008:0:12488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347bcfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:2409:x1874622863657728:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 98us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779931.033016:0:12488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 201 00000100:00100000:1.0:1787779931.033038:0:12488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 202 00000100:00100000:1.0:1787779931.033045:0:12488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347bcf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+5:2409:x1874622863657984:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1787779931.033069:0:12488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347bcf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+5:2409:x1874622863657984:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 25us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779931.033076:0:12488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 202 00000100:00100000:1.0:1787779931.033086:0:12488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 203 00000100:00100000:1.0:1787779931.033092:0:12488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347bce1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:781d29bb-23d2-48e3-b16d-c29e52cd5375+6:2409:x1874622863657600:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1787779931.033117:0:12488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347bce1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:781d29bb-23d2-48e3-b16d-c29e52cd5375+6:2409:x1874622863657600:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 24us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779931.033123:0:12488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 203 00000100:00100000:1.0:1787779931.033135:0:12488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 204 00000100:00100000:1.0:1787779931.033149:0:12488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347bcf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+5:2409:x1874622863657856:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1787779931.033187:0:12488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347bcf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+5:2409:x1874622863657856:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 29us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779931.033194:0:12488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 204 00000100:00080000:0.0:1787779931.033605:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787779931.033611:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787779931.036468:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863657472 00000100:00100000:2.0:1787779931.036487:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863657472 00000100:00100000:2.0:1787779931.036581:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 316 00000100:00100000:2.0:1787779931.036594:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0478611450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+13:2409:x1874622863657472:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1787779931.037029:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0478611450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+13:2409:x1874622863657472:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 435us (4623us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779931.037039:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 316 00010000:00010000:3.0:1787779931.293547:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787779931.933872:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787779931.934156:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047785fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874622881570432:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787779931.934235:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779931.934327:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881570432 00000100:00100000:1.0:1787779931.934334:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881570432 00000100:00100000:1.0:1787779931.934384:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1787779931.934392:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c047785ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1874622881570432:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787779931.934432:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1787779931.934479:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c047785ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1874622881570432:12345-0@lo:41:osp-pre-0-1.0 Request processed in 87us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779931.934485:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1787779931.934544:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047785fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874622881570432:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787779932.322030:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787779932.454067:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346de2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881570560:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787779932.454133:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779932.454500:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881570560 00000100:00100000:1.0:1787779932.454518:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881570560 00000100:00100000:1.0:1787779932.454568:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1787779932.454576:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c047785e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1874622881570560:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787779932.454607:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787779932.454662:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c047785e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1874622881570560:12345-0@lo:41:osp-pre-1-0.0 Request processed in 86us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779932.454668:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1787779932.454759:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346de2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881570560:0@lo:41:osp-pre-1-0.0 00000001:02000400:1.0:1787779932.728393:0:13033:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1787779933.340092:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787779934.364180:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787779934.492443:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04812a8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881570944:0@lo:400:kworker.0 00000100:00100000:1.0:1787779934.492547:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779934.492637:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04812aad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1874622881571456:0@lo:400:kworker.0 00000100:00100000:1.0:1787779934.492671:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779934.492698:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346dac780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1874622881571968:0@lo:400:kworker.0 00000100:00100000:1.0:1787779934.492716:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779934.492744:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1787779934.492750:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04812ab840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874622881571072:0@lo:400:kworker.0 00000100:00100000:1.0:1787779934.492772:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779934.492790:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04812a8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881571584:0@lo:400:kworker.0 00000100:00100000:1.0:1787779934.492816:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779934.492834:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346dae1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881572096:0@lo:400:kworker.0 00000100:00100000:1.0:1787779934.492879:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779934.492914:0:12488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881571456 00000100:00100000:1.0:1787779934.492923:0:12488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881571456 00000100:00100000:1.0:1787779934.492986:0:12488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881571968 00000100:00100000:1.0:1787779934.492990:0:12488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881571968 00000100:00100000:1.0:1787779934.493010:0:12488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881571072 00000100:00100000:1.0:1787779934.493012:0:12488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881571072 00000100:00100000:1.0:1787779934.493193:0:12488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1787779934.493205:0:12488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046efcf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1874622881571456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787779934.493269:0:12488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046efcf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1874622881571456:12345-0@lo:400:kworker.0 Request processed in 67us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779934.493277:0:12488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1787779934.493298:0:12488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1787779934.493304:0:12488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046efcda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1874622881571968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787779934.493331:0:12488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046efcda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1874622881571968:12345-0@lo:400:kworker.0 Request processed in 28us (614us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779934.493338:0:12488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1787779934.493358:0:12488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1787779934.493364:0:12488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046efcc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874622881571072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779934.493574:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047785fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874622881570816:0@lo:400:kworker.0 00000100:00100000:2.0:1787779934.493659:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881570944 00000100:00100000:2.0:1787779934.493664:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881570944 00000100:00100000:2.0:1787779934.493699:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1787779934.493707:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346de2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881570944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787779934.493785:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047785f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1f575176-36bc-4786-83ee-2fea064a12a9:3643:1874622881570688:0@lo:400:kworker.0 00000100:00100000:3.0:1787779934.504350:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779934.504430:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04812ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1874622881571328:0@lo:400:kworker.0 00000100:00100000:3.0:1787779934.504481:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779934.504500:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346dad2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1874622881571840:0@lo:400:kworker.0 00000100:00100000:3.0:1787779934.504524:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779934.505009:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881570816 00000100:00100000:3.0:1787779934.505020:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881570816 00000100:00100000:3.0:1787779934.505207:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881571328 00000100:00100000:3.0:1787779934.505211:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881571328 00000100:00100000:3.0:1787779934.505230:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881571840 00000100:00100000:3.0:1787779934.505233:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881571840 00000100:00100000:3.0:1787779934.505252:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1787779934.505262:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0476440f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874622881570816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779934.505350:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0476440f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874622881570816:12345-0@lo:400:kworker.0 Request processed in 88us (1011us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779934.505358:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1787779934.505383:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1787779934.505390:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0476495e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1874622881571328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779934.505601:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0476495e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1874622881571328:12345-0@lo:400:kworker.0 Request processed in 152us (1059us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779934.505608:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1787779934.505622:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1787779934.505629:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0476494b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1874622881571840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779934.505661:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0476494b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1874622881571840:12345-0@lo:400:kworker.0 Request processed in 33us (1137us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779934.505667:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00080000:3.0:1787779934.505685:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787779934.505690:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787779934.505704:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881571584 00000100:00100000:3.0:1787779934.505709:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881571584 00000100:00100000:3.0:1787779934.505740:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881572096 00000100:00100000:3.0:1787779934.505744:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881572096 00000100:00100000:3.0:1787779934.505762:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787779934.505769:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046efcde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881571584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779934.505806:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046efcde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881571584:12345-0@lo:400:kworker.0 Request processed in 38us (12989us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779934.505812:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787779934.505824:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787779934.505831:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046efcc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881572096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779934.505890:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046efcc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881572096:12345-0@lo:400:kworker.0 Request processed in 61us (13010us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779934.505896:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787779934.505950:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047785fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874622881570816:0@lo:400:kworker.0 00000100:00100000:3.0:1787779934.505961:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04812ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1874622881571328:0@lo:400:kworker.0 00000100:00100000:3.0:1787779934.505970:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346dad2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1874622881571840:0@lo:400:kworker.0 00000100:00080000:3.0:1787779934.505996:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787779934.505999:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787779934.512612:0:12488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046efcc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874622881571072:12345-0@lo:400:kworker.0 Request processed in 19231us (19823us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779934.512633:0:12488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1787779934.512807:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04812ab840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874622881571072:0@lo:400:kworker.0 00010000:00080000:1.0:1787779934.512828:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c04812a8b40 x1874622881571584/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779950 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787779934.512865:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04812a8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881571584:0@lo:400:kworker.0 00010000:00080000:1.0:1787779934.512880:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0346dae1c0 x1874622881572096/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779950 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787779934.512889:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346dae1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881572096:0@lo:400:kworker.0 00010000:00080000:1.0:1787779934.512903:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c04812aad00 x1874622881571456/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779950 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787779934.512912:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04812aad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1874622881571456:0@lo:400:kworker.0 00010000:00080000:1.0:1787779934.512924:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0346dac780 x1874622881571968/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779950 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787779934.512932:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346dac780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1874622881571968:0@lo:400:kworker.0 00000100:00100000:3.0:1787779934.513520:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c046efcf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881572352:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787779934.513613:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779934.516536:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881572352 00000100:00100000:1.0:1787779934.516563:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881572352 00000100:00100000:1.0:1787779934.516645:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787779934.516657:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04764970c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881572352:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787779934.516721:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787779934.516869:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04764970c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881572352:12345-0@lo:13:osp-pre-1-1.0 Request processed in 203us (3245us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779934.516878:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00010000:00080000:1.0:1787779934.516936:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c046efcf0c0 x1874622881572352/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779950 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787779934.516961:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c046efcf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881572352:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787779934.517523:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346de2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881570944:12345-0@lo:400:kworker.0 Request processed in 23813us (24981us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779934.517534:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1787779934.522074:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04812a8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881570944:0@lo:400:kworker.0 00000100:00100000:0.0:1787779934.525875:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779934.526059:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881570688 00000100:00100000:2.0:1787779934.526071:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881570688 00000100:00100000:2.0:1787779934.526137:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:2.0:1787779934.526148:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0478610c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+24:3643:x1874622881570688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779934.526255:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0478610c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+24:3643:x1874622881570688:12345-0@lo:400:kworker.0 Request processed in 109us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779934.526264:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:0.0:1787779934.527011:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047785f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1f575176-36bc-4786-83ee-2fea064a12a9:3643:1874622881570688:0@lo:400:kworker.0 00000100:00100000:0.0:1787779934.527037:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04812a9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881571200:0@lo:400:kworker.0 00000100:00100000:0.0:1787779934.527089:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779934.527110:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04812a9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881571712:0@lo:400:kworker.0 00000100:00100000:0.0:1787779934.527135:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779934.527164:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346dade00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881572224:0@lo:400:kworker.0 00000100:00100000:0.0:1787779934.527187:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779934.527443:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881571200 00000100:00100000:3.0:1787779934.527449:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881571200 00000100:00100000:3.0:1787779934.527503:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1787779934.527512:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347bccf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881571200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779934.529667:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347bccf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881571200:12345-0@lo:400:kworker.0 Request processed in 2147us (2568us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779934.529682:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1787779934.535085:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04812a9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881571200:0@lo:400:kworker.0 00000100:00100000:0.0:1787779934.536042:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881571712 00000100:00100000:0.0:1787779934.536063:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881571712 00000100:00100000:0.0:1787779934.536134:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881572224 00000100:00100000:0.0:1787779934.536138:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881572224 00000100:00100000:0.0:1787779934.536176:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1787779934.536187:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347bcc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881571712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787779934.536298:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347bcc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881571712:12345-0@lo:400:kworker.0 Request processed in 113us (9161us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779934.536306:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1787779934.536328:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1787779934.536335:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347bcde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881572224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787779934.536366:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347bcde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881572224:12345-0@lo:400:kworker.0 Request processed in 32us (9178us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779934.536372:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00080000:0.0:1787779934.536512:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787779934.536517:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787779934.536563:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c04812a9680 x1874622881571712/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779950 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787779934.536578:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04812a9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881571712:0@lo:400:kworker.0 00010000:00080000:0.0:1787779934.536591:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0346dade00 x1874622881572224/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779950 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787779934.536601:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346dade00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881572224:0@lo:400:kworker.0 00000100:00100000:2.0:1787779935.005965:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787779935.005995:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346dae580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874622881572480:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787779935.006147:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779935.006201:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787779935.006214:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0476494f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881572608:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787779935.006240:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881572480 00000100:00100000:2.0:1787779935.006249:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881572480 00000100:00100000:3.0:1787779935.006253:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779935.006301:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881572608 00000100:00100000:2.0:1787779935.006304:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881572608 00000100:00100000:2.0:1787779935.006320:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787779935.006328:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346dade00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1874622881572480:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787779935.006376:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787779935.006438:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346dade00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1874622881572480:12345-0@lo:13:osp-pre-0-1.0 Request processed in 110us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779935.006446:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787779935.006467:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1787779935.006475:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0476497840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874622881572608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787779935.006486:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00010000:00080000:3.0:1787779935.006490:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0346dae580 x1874622881572480/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779951 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787779935.006517:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0476497840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874622881572608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 44us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779935.006526:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346dae580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874622881572480:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787779935.006526:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00010000:00080000:2.0:1787779935.006558:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0476494f00 x1874622881572608/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779951 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787779935.006573:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0476494f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881572608:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787779935.404103:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787779935.519101:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787779935.519130:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c046efcf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881572736:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787779935.519486:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779935.519599:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881572736 00000100:00100000:2.0:1787779935.519617:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881572736 00000100:00100000:2.0:1787779935.519689:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1787779935.519701:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046efcd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881572736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787779935.519731:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787779935.519790:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046efcd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881572736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779935.519798:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00010000:00080000:2.0:1787779935.519867:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c046efcf0c0 x1874622881572736/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779951 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787779935.519890:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c046efcf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881572736:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787779936.150677:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787779936.150721:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787779936.150742:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787779936.150759:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787779936.150780:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787779936.150985:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863658368 00000100:00100000:2.0:1787779936.150994:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863658368 00000100:00100000:2.0:1787779936.151043:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863658624 00000100:00100000:2.0:1787779936.151046:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863658624 00000100:00100000:2.0:1787779936.151057:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863658240 00000100:00100000:2.0:1787779936.151059:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863658240 00000100:00100000:2.0:1787779936.151068:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863658496 00000100:00100000:2.0:1787779936.151070:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863658496 00000100:00100000:2.0:1787779936.151083:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 211 00000100:00100000:2.0:1787779936.151091:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346dae1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:2408:x1874622863658368:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1787779936.151165:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346dae1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:2408:x1874622863658368:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 75us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779936.151188:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 211 00000100:00100000:2.0:1787779936.151203:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 212 00000100:00100000:2.0:1787779936.151209:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346dad2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+5:2408:x1874622863658624:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1787779936.151233:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346dad2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+5:2408:x1874622863658624:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 25us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779936.151239:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 212 00000100:00100000:2.0:1787779936.151249:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 213 00000100:00100000:2.0:1787779936.151255:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346dae580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+6:2408:x1874622863658240:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1787779936.151276:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346dae580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+6:2408:x1874622863658240:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 22us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779936.151281:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 213 00000100:00100000:2.0:1787779936.151291:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 214 00000100:00100000:2.0:1787779936.151297:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04779803c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+5:2408:x1874622863658496:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1787779936.151324:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04779803c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+5:2408:x1874622863658496:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 27us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779936.151329:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 214 00000100:00080000:2.0:1787779936.151344:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787779936.151348:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787779936.151400:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863658112 00000100:00100000:3.0:1787779936.151404:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863658112 00000100:00100000:3.0:1787779936.151438:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 318 00000100:00100000:3.0:1787779936.151446:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0478611c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+13:2408:x1874622863658112:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1787779936.151470:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0478611c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+13:2408:x1874622863658112:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 25us (804us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779936.151476:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 318 00010000:00010000:3.0:1787779936.421968:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787779937.052248:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477981e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881572864:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787779937.052329:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779937.052462:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881572864 00000100:00100000:3.0:1787779937.052469:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881572864 00000100:00100000:3.0:1787779937.052523:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1787779937.052534:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046efcf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881572864:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787779937.052565:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787779937.052614:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046efcf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881572864:12345-0@lo:41:osp-pre-0-1.0 Request processed in 83us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779937.052621:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1787779937.052663:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477981e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881572864:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1787779937.436067:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787779937.564909:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0461beed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881572992:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787779937.564974:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779937.567431:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881572992 00000100:00100000:1.0:1787779937.567445:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881572992 00000100:00100000:1.0:1787779937.567519:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1787779937.567529:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347bcc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874622881572992:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787779937.567566:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787779937.567648:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347bcc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874622881572992:12345-0@lo:41:osp-pre-1-0.0 Request processed in 121us (2673us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779937.567655:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1787779937.567751:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0461beed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881572992:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1787779938.462767:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787779938.562750:0:13180:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe272f15a0 20000000:00000080:0.0:1787779938.562768:0:13180:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9c0347f13000 uarg=0000000000000000 20000000:01000000:0.0:1787779938.562812:0:13180:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1787779938.562817:0:13180:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1787779938.562823:0:13180:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1787779938.570916:0:13181:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:2.0:1787779938.571387:0:13180:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1787779938.598576:0:13180:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787779938.606960:0:13180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c04766dd600/0xc8fc0a5179960788 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779938.606987:0:13180:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c0477869600/0xc8fc0a5179960718 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1cdb expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779938.606996:0:13180:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c0477a70600/0xc8fc0a5179960726 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a517996071f expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779938.607467:0:13180:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c0477a70a00/0xc8fc0a5179960734 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a517996072d expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779938.607474:0:13180:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c0477a71a00/0xc8fc0a5179960742 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a517996073b expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779938.607491:0:13180:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c0477a71600/0xc8fc0a5179960750 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a5179960749 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779938.607499:0:13180:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c0477868a00/0xc8fc0a5179960765 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1d1a expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779938.607507:0:13180:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c04766dd600/0xc8fc0a5179960788 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779938.607550:0:13180:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c0477868a00/0xc8fc0a5179960765 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1d1a expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779938.607567:0:13180:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c0477868a00/0xc8fc0a5179960765 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1d1a expref: 12 pid: 6505 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779938.607582:0:13180:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0476494780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13180:1874622881573120:192.168.203.31@tcp:104: 00010000:00010000:3.0:1787779938.607701:0:13180:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c0477a71600/0xc8fc0a5179960750 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc8fc0a5179960749 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779938.607710:0:13180:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c0477a71600/0xc8fc0a5179960750 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc8fc0a5179960749 expref: 23 pid: 6506 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779938.607720:0:13180:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04764961c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13180:1874622881573248:0@lo:104: 00000100:00100000:3.0:1787779938.607768:0:13180:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787779938.607818:0:13180:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c0477a71a00/0xc8fc0a5179960742 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc8fc0a517996073b expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779938.607827:0:13180:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c0477a71a00/0xc8fc0a5179960742 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc8fc0a517996073b expref: 23 pid: 6505 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779938.607857:0:13180:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04812a9680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13180:1874622881573376:0@lo:104: 00000100:00100000:3.0:1787779938.607882:0:13180:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787779938.607904:0:13180:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c0477a70a00/0xc8fc0a5179960734 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc8fc0a517996072d expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779938.607913:0:13180:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c0477a70a00/0xc8fc0a5179960734 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc8fc0a517996072d expref: 23 pid: 6506 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779938.607921:0:13180:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04812a8f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13180:1874622881573504:0@lo:104: 00000100:00100000:1.0:1787779938.608555:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881573248 00000100:00100000:1.0:1787779938.608563:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881573248 00000100:00100000:1.0:1787779938.608610:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881573376 00000100:00100000:1.0:1787779938.608613:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881573376 00000100:00100000:1.0:1787779938.608629:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787779938.608648:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0476494f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1f575176-36bc-4786-83ee-2fea064a12a9+4:13180:x1874622881573248:12345-0@lo:104: 00010000:00010000:1.0:1787779938.608661:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff9c0477a71e00/0xc8fc0a5179960749 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc8fc0a5179960750 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779938.608712:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787779938.608718:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0476494f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1f575176-36bc-4786-83ee-2fea064a12a9+4:13180:x1874622881573248:12345-0@lo:104: Request processed in 74us (951us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779938.608725:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787779938.608743:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787779938.608751:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04812a9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1f575176-36bc-4786-83ee-2fea064a12a9+3:13180:x1874622881573376:12345-0@lo:104: 00010000:00010000:1.0:1787779938.608758:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff9c0477a71400/0xc8fc0a517996073b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc8fc0a5179960742 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779938.608791:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787779938.608797:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04812a9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1f575176-36bc-4786-83ee-2fea064a12a9+3:13180:x1874622881573376:12345-0@lo:104: Request processed in 48us (915us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779938.608803:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00010000:1.0:1787779938.608823:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787779938.608829:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff9c0477a71e00/0xc8fc0a5179960749 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc8fc0a5179960750 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779938.608836:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0477a71e00 already unused, calling callback (ffffffffc139ac20) 10000000:00010000:1.0:1787779938.608869:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff9c0477a71e00/0xc8fc0a5179960749 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xc8fc0a5179960750 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779938.608879:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff9c0477a71e00/0xc8fc0a5179960749 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xc8fc0a5179960750 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787779938.608887:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff9c0477a71e00/0xc8fc0a5179960749 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xc8fc0a5179960750 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787779938.608900:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787779938.608930:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff9c0477a71e00/0xc8fc0a5179960749 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a5179960750 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779938.608951:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787779938.608979:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff9c0477a71e00/0xc8fc0a5179960749 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a5179960750 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779938.608988:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff9c0477a71e00/0xc8fc0a5179960749 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a5179960750 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779938.609001:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787779938.609005:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff9c0477a71400/0xc8fc0a517996073b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc8fc0a5179960742 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779938.609010:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0477a71400 already unused, calling callback (ffffffffc139ac20) 10000000:00010000:1.0:1787779938.609025:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff9c0477a71400/0xc8fc0a517996073b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc8fc0a5179960742 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779938.609033:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff9c0477a71400/0xc8fc0a517996073b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc8fc0a5179960742 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787779938.609039:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff9c0477a71400/0xc8fc0a517996073b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc8fc0a5179960742 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787779938.609045:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787779938.609060:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff9c0477a71400/0xc8fc0a517996073b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a5179960742 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779938.612859:0:13180:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787779938.614874:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787779938.614930:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff9c0477a71400/0xc8fc0a517996073b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a5179960742 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779938.614939:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff9c0477a71400/0xc8fc0a517996073b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a5179960742 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779938.616729:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881573504 00000100:00100000:1.0:1787779938.616740:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881573504 00000100:00100000:1.0:1787779938.616790:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787779938.616799:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04812aad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1f575176-36bc-4786-83ee-2fea064a12a9+3:13180:x1874622881573504:12345-0@lo:104: 00010000:00010000:1.0:1787779938.616814:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff9c0477a71800/0xc8fc0a517996072d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc8fc0a5179960734 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779938.616895:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787779938.616901:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04812aad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1f575176-36bc-4786-83ee-2fea064a12a9+3:13180:x1874622881573504:12345-0@lo:104: Request processed in 104us (4063us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779938.616908:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00010000:1.0:1787779938.616930:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787779938.616935:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff9c0477a71800/0xc8fc0a517996072d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc8fc0a5179960734 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779938.616942:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0477a71800 already unused, calling callback (ffffffffc139ac20) 10000000:00010000:1.0:1787779938.616946:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff9c0477a71800/0xc8fc0a517996072d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc8fc0a5179960734 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779938.617343:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04618eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1f575176-36bc-4786-83ee-2fea064a12a9:3643:1874622881573760:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787779938.617396:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779938.617457:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881573760 00000100:00100000:0.0:1787779938.617462:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881573760 00010000:00010000:0.0:1787779938.617484:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c0477a71a00/0xc8fc0a5179960742 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc8fc0a517996073b expref: 24 pid: 6505 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779938.617507:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787779938.617513:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347bced00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1f575176-36bc-4786-83ee-2fea064a12a9+24:3643:x1874622881573760:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787779938.617535:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787779938.617540:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c0477a71a00/0xc8fc0a5179960742 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc8fc0a517996073b expref: 24 pid: 6505 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779938.617550:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c0477a71a00/0xc8fc0a5179960742 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc8fc0a517996073b expref: 24 pid: 6505 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779938.617567:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787779938.617596:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347bced00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1f575176-36bc-4786-83ee-2fea064a12a9+24:3643:x1874622881573760:12345-0@lo:103:ldlm_bl.0 Request processed in 84us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779938.617603:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787779938.617642:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04618eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1f575176-36bc-4786-83ee-2fea064a12a9:3643:1874622881573760:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787779938.617907:0:13180:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c0477a70600/0xc8fc0a5179960726 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc8fc0a517996071f expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779938.617918:0:13180:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c0477a70600/0xc8fc0a5179960726 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc8fc0a517996071f expref: 23 pid: 6505 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779938.617938:0:13180:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04812a8b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13180:1874622881573888:0@lo:104: 00010000:00010000:1.0:1787779938.618593:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff9c0477a71800/0xc8fc0a517996072d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc8fc0a5179960734 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787779938.618605:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff9c0477a71800/0xc8fc0a517996072d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc8fc0a5179960734 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787779938.618626:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787779938.618653:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff9c0477a71800/0xc8fc0a517996072d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a5179960734 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779938.618659:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787779938.618684:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff9c0477a71800/0xc8fc0a517996072d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a5179960734 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779938.618692:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff9c0477a71800/0xc8fc0a517996072d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a5179960734 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779938.618704:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787779938.618707:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787779938.618708:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787779938.618729:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0461beed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1f575176-36bc-4786-83ee-2fea064a12a9:3642:1874622881573632:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787779938.618779:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787779938.618790:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04618ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1f575176-36bc-4786-83ee-2fea064a12a9:3643:1874622881574016:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787779938.622166:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787779938.622225:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863658752 00000100:00100000:0.0:1787779938.622233:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863658752 00010000:00010000:0.0:1787779938.622269:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c0477868a00/0xc8fc0a5179960765 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1d1a expref: 13 pid: 6505 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779938.622307:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 41 00000100:00100000:0.0:1787779938.622316:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04778403c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+13:2411:x1874622863658752:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787779938.622330:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787779938.622336:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c0477868a00/0xc8fc0a5179960765 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1d1a expref: 13 pid: 6505 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779938.622349:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c0477868a00/0xc8fc0a5179960765 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1d1a expref: 13 pid: 6505 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779938.622376:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787779938.622434:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04778403c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+13:2411:x1874622863658752:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 118us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779938.622441:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 41 00010000:00010000:0.0:1787779938.623331:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787779938.623335:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787779938.623337:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787779938.630735:0:13180:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787779938.630875:0:13180:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c0477869600/0xc8fc0a5179960718 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1cdb expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779938.630894:0:13180:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c0477869600/0xc8fc0a5179960718 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1cdb expref: 12 pid: 6506 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779938.630930:0:13180:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04812ab480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13180:1874622881574144:192.168.203.31@tcp:104: 00000100:00100000:3.0:1787779938.631018:0:13180:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0347d45cc0 going to sleep for 11 seconds 00010000:00010000:3.0:1787779938.631044:0:13180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c0477868a00/0xc8fc0a5179960765 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1d1a expref: 12 pid: 6505 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779938.631058:0:13180:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0476494780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13180:1874622881573120:192.168.203.31@tcp:104: 00000100:00100000:3.0:1787779938.631069:0:13180:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04764961c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13180:1874622881573248:0@lo:104: 00010000:00010000:3.0:1787779938.631079:0:13180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c0477a71a00/0xc8fc0a5179960742 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc8fc0a517996073b expref: 23 pid: 6505 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779938.631088:0:13180:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04812a9680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13180:1874622881573376:0@lo:104: 00000100:00100000:3.0:1787779938.631096:0:13180:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04812a8f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13180:1874622881573504:0@lo:104: 00000100:00100000:0.0:1787779938.631264:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881573888 00000100:00100000:0.0:1787779938.631271:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881573888 00000100:00100000:0.0:1787779938.631318:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787779938.631327:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04812ab840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1f575176-36bc-4786-83ee-2fea064a12a9+3:13180:x1874622881573888:12345-0@lo:104: 00010000:00010000:0.0:1787779938.631340:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff9c0477869c00/0xc8fc0a517996071f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc8fc0a5179960726 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779938.631419:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787779938.631426:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04812ab840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1f575176-36bc-4786-83ee-2fea064a12a9+3:13180:x1874622881573888:12345-0@lo:104: Request processed in 101us (7485us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779938.631433:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787779938.631660:0:13180:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04812a8b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13180:1874622881573888:0@lo:104: 00010000:00010000:1.0:1787779938.631807:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787779938.631815:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff9c0477869c00/0xc8fc0a517996071f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc8fc0a5179960726 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779938.631822:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0477869c00 already unused, calling callback (ffffffffc139ac20) 10000000:00010000:1.0:1787779938.631826:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff9c0477869c00/0xc8fc0a517996071f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc8fc0a5179960726 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779938.631834:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff9c0477869c00/0xc8fc0a517996071f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc8fc0a5179960726 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787779938.631867:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff9c0477869c00/0xc8fc0a517996071f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc8fc0a5179960726 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787779938.631888:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787779938.631924:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff9c0477869c00/0xc8fc0a517996071f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a5179960726 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779938.631930:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787779938.631958:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff9c0477869c00/0xc8fc0a517996071f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a5179960726 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779938.631966:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff9c0477869c00/0xc8fc0a517996071f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a5179960726 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779938.631982:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787779938.631984:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787779938.631985:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787779938.631992:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787779938.632150:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779938.632177:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881573632 00000100:00100000:1.0:1787779938.632182:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881573632 00010000:00010000:1.0:1787779938.632204:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c0477a71600/0xc8fc0a5179960750 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc8fc0a5179960749 expref: 23 pid: 6506 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779938.632227:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787779938.632234:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04618e83c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1f575176-36bc-4786-83ee-2fea064a12a9+23:3642:x1874622881573632:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787779938.632245:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787779938.632250:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c0477a71600/0xc8fc0a5179960750 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc8fc0a5179960749 expref: 23 pid: 6506 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779938.632261:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c0477a71600/0xc8fc0a5179960750 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc8fc0a5179960749 expref: 23 pid: 6506 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779938.632285:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c0477a71600/0xc8fc0a5179960750 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc8fc0a5179960749 expref: 23 pid: 6506 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779938.632298:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787779938.632327:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04618e83c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1f575176-36bc-4786-83ee-2fea064a12a9+22:3642:x1874622881573632:12345-0@lo:103:ldlm_bl.0 Request processed in 93us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779938.632333:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787779938.632380:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0461beed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1f575176-36bc-4786-83ee-2fea064a12a9:3642:1874622881573632:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787779938.632400:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787779938.632408:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04618eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1f575176-36bc-4786-83ee-2fea064a12a9:3642:1874622881574272:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787779938.632435:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779938.632456:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881574272 00000100:00100000:1.0:1787779938.632459:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881574272 00010000:00010000:1.0:1787779938.632473:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c0477a70600/0xc8fc0a5179960726 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc8fc0a517996071f expref: 22 pid: 6505 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779938.633022:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787779938.633031:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04618e8780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1f575176-36bc-4786-83ee-2fea064a12a9+22:3642:x1874622881574272:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787779938.633041:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787779938.633046:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c0477a70600/0xc8fc0a5179960726 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc8fc0a517996071f expref: 22 pid: 6505 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779938.633054:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c0477a70600/0xc8fc0a5179960726 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc8fc0a517996071f expref: 22 pid: 6505 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779938.633428:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c0477a70600/0xc8fc0a5179960726 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc8fc0a517996071f expref: 22 pid: 6505 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779938.633454:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787779938.633627:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04618e8780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1f575176-36bc-4786-83ee-2fea064a12a9+21:3642:x1874622881574272:12345-0@lo:103:ldlm_bl.0 Request processed in 597us (1190us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779938.633634:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787779938.633674:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04618eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1f575176-36bc-4786-83ee-2fea064a12a9:3642:1874622881574272:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787779938.639451:0:13180:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04812ab480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13180:1874622881574144:192.168.203.31@tcp:104: 00010000:00010000:3.0:1787779938.639503:0:13180:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c04766dd600/0xc8fc0a5179960788 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779938.642430:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787779938.643630:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863658880 00000100:00100000:1.0:1787779938.643642:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863658880 00010000:00010000:1.0:1787779938.643683:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c0477869600/0xc8fc0a5179960718 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1cdb expref: 12 pid: 6506 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779938.643717:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 44 00000100:00100000:1.0:1787779938.643726:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477840000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+12:2411:x1874622863658880:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787779938.643741:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787779938.643747:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c0477869600/0xc8fc0a5179960718 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1cdb expref: 12 pid: 6506 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779938.643759:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c0477869600/0xc8fc0a5179960718 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1cdb expref: 12 pid: 6506 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779938.643777:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c0477869600/0xc8fc0a5179960718 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1cdb expref: 12 pid: 6506 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779938.643793:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787779938.643868:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477840000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+11:2411:x1874622863658880:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 143us (1446us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779938.643876:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 44 00000100:00100000:0.0:1787779938.643976:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779938.644252:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881574016 00000100:00100000:1.0:1787779938.644269:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881574016 00010000:00010000:1.0:1787779938.644284:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c0477a70a00/0xc8fc0a5179960734 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc8fc0a517996072d expref: 21 pid: 6506 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779938.644312:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787779938.644319:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046099f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1f575176-36bc-4786-83ee-2fea064a12a9+21:3643:x1874622881574016:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787779938.644340:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787779938.644345:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c0477a70a00/0xc8fc0a5179960734 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc8fc0a517996072d expref: 21 pid: 6506 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779938.644355:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c0477a70a00/0xc8fc0a5179960734 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc8fc0a517996072d expref: 21 pid: 6506 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779938.645692:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c0477a70a00/0xc8fc0a5179960734 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc8fc0a517996072d expref: 21 pid: 6506 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779938.645713:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c04766dd600/0xc8fc0a5179960788 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779938.645721:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c04766dd600/0xc8fc0a5179960788 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779938.645739:0:6498:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c04766dd600/0xc8fc0a5179960788 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779938.645746:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c04766dd600/0xc8fc0a5179960788 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779938.645752:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c04766dd600/0xc8fc0a5179960788 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779938.645758:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c04766dd600/0xc8fc0a5179960788 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779938.645773:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c04766dd600 already unused, calling callback (ffffffffc0d97420) 00010000:00010000:1.0:1787779938.645777:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c04766dd600/0xc8fc0a5179960788 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779938.645785:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c04766dd600/0xc8fc0a5179960788 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779938.645800:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c04766dd600/0xc8fc0a5179960788 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779938.645811:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787779938.645881:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046099f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1f575176-36bc-4786-83ee-2fea064a12a9+20:3643:x1874622881574016:12345-0@lo:103:ldlm_bl.0 Request processed in 1562us (1905us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779938.645889:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00010000:3.0:1787779938.646327:0:13180:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c04766dd600/0xc8fc0a5179960788 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779938.646336:0:13180:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c04766dd600/0xc8fc0a5179960788 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779938.646342:0:13180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c04766dd600/0xc8fc0a5179960788 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779938.650209:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04618ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1f575176-36bc-4786-83ee-2fea064a12a9:3643:1874622881574016:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787779939.484432:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787779939.612720:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787779939.612745:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04618e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881574400:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787779939.612856:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779939.613305:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881574400 00000100:00100000:1.0:1787779939.613316:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881574400 00000100:00100000:1.0:1787779939.613389:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787779939.613401:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477843c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881574400:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787779939.613429:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787779939.613496:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477843c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881574400:12345-0@lo:13:osp-pre-1-1.0 Request processed in 98us (657us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779939.613513:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00080000:2.0:1787779939.614931:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787779939.614955:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04812ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1f575176-36bc-4786-83ee-2fea064a12a9:3643:1874622881574528:0@lo:400:kworker.0 00000100:00100000:2.0:1787779939.615010:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779939.615059:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0476497c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881575040:0@lo:400:kworker.0 00000100:00100000:2.0:1787779939.615084:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779939.615126:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047785fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881575552:0@lo:400:kworker.0 00000100:00100000:2.0:1787779939.615152:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779939.615175:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1787779939.615182:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04812a8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1874622881574656:0@lo:400:kworker.0 00000100:00100000:2.0:1787779939.615203:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779939.615220:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04764961c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1874622881575168:0@lo:400:kworker.0 00000100:00100000:2.0:1787779939.615240:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779939.615255:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0461954f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1874622881575680:0@lo:400:kworker.0 00000100:00100000:2.0:1787779939.615274:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779939.615300:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881574656 00000100:00100000:2.0:1787779939.615306:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881574656 00000100:00100000:2.0:1787779939.615342:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881575168 00000100:00100000:2.0:1787779939.615345:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881575168 00000100:00100000:2.0:1787779939.615365:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881575680 00000100:00100000:2.0:1787779939.615368:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881575680 00000100:00100000:2.0:1787779939.615385:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1787779939.615392:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477980000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1874622881574656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779939.615457:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477980000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1874622881574656:12345-0@lo:400:kworker.0 Request processed in 65us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779939.615463:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1787779939.615479:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1787779939.615495:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477980780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1874622881575168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779939.615525:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477980780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1874622881575168:12345-0@lo:400:kworker.0 Request processed in 32us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779939.615531:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1787779939.615542:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1787779939.615548:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04779812c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1874622881575680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779939.615574:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04779812c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1874622881575680:12345-0@lo:400:kworker.0 Request processed in 26us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779939.615579:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1787779939.615605:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04812a9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1874622881574912:0@lo:400:kworker.0 00000100:00100000:2.0:1787779939.615629:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779939.615646:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047785f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874622881575424:0@lo:400:kworker.0 00000100:00100000:2.0:1787779939.615666:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779939.615680:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0461955e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881575936:0@lo:400:kworker.0 00000100:00100000:2.0:1787779939.615698:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779939.615712:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1787779939.615716:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04812a8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874622881574784:0@lo:400:kworker.0 00000100:00100000:2.0:1787779939.615745:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779939.615760:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0476494780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1874622881575296:0@lo:400:kworker.0 00000100:00100000:2.0:1787779939.615793:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779939.615816:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0461956940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1874622881575808:0@lo:400:kworker.0 00000100:00100000:2.0:1787779939.615833:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779939.615877:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881574912 00000100:00100000:2.0:1787779939.615881:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881574912 00000100:00100000:2.0:1787779939.615896:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881575296 00000100:00100000:2.0:1787779939.615903:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881575296 00000100:00100000:2.0:1787779939.615917:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881575808 00000100:00100000:2.0:1787779939.615919:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881575808 00000100:00100000:2.0:1787779939.615931:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1787779939.615936:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477981e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1874622881574912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779939.615965:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477981e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1874622881574912:12345-0@lo:400:kworker.0 Request processed in 29us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779939.615970:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1787779939.615979:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1787779939.615984:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477ae9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1874622881575296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779939.616004:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477ae9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1874622881575296:12345-0@lo:400:kworker.0 Request processed in 20us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779939.616009:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1787779939.616017:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1787779939.616022:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477ae8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1874622881575808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779939.616042:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477ae8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1874622881575808:12345-0@lo:400:kworker.0 Request processed in 20us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779939.616047:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00080000:2.0:1787779939.616061:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787779939.616064:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787779939.616089:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0476494780 x1874622881575296/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779955 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787779939.616103:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0476494780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1874622881575296:0@lo:400:kworker.0 00010000:00080000:2.0:1787779939.616114:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0461956940 x1874622881575808/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779955 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787779939.616132:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0461956940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1874622881575808:0@lo:400:kworker.0 00000100:00100000:2.0:1787779939.616151:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04812a9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1874622881574912:0@lo:400:kworker.0 00000100:00100000:2.0:1787779939.616186:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04812a8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1874622881574656:0@lo:400:kworker.0 00000100:00100000:2.0:1787779939.616194:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04764961c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1874622881575168:0@lo:400:kworker.0 00000100:00100000:2.0:1787779939.616203:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0461954f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1874622881575680:0@lo:400:kworker.0 00000100:00100000:2.0:1787779939.616239:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881575040 00000100:00100000:2.0:1787779939.616242:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881575040 00000100:00100000:2.0:1787779939.616259:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881574784 00000100:00100000:2.0:1787779939.616261:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881574784 00000100:00100000:2.0:1787779939.616272:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1787779939.616277:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04779830c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881575040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779939.616310:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04779830c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881575040:12345-0@lo:400:kworker.0 Request processed in 33us (1226us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779939.616315:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1787779939.616325:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1787779939.616330:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477aebc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1874622881574784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779939.616356:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477aebc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1874622881574784:12345-0@lo:400:kworker.0 Request processed in 26us (611us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779939.616361:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1787779939.616380:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04812a8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874622881574784:0@lo:400:kworker.0 00000100:00100000:2.0:1787779939.616398:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0476497c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881575040:0@lo:400:kworker.0 00000100:00100000:0.0:1787779939.617999:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881575552 00000100:00100000:0.0:1787779939.618010:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881575552 00000100:00100000:0.0:1787779939.618075:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881575424 00000100:00100000:0.0:1787779939.618079:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881575424 00000100:00100000:0.0:1787779939.618108:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881575936 00000100:00100000:0.0:1787779939.618111:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881575936 00000100:00100000:0.0:1787779939.618138:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1787779939.618155:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477980b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881575552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787779939.618231:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477980b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881575552:12345-0@lo:400:kworker.0 Request processed in 78us (3078us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779939.618238:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1787779939.618254:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1787779939.618260:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477983c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1874622881575424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787779939.618292:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477983c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1874622881575424:12345-0@lo:400:kworker.0 Request processed in 33us (2625us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779939.618298:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1787779939.618309:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787779939.618315:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046f1b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3642:x1874622881575936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787779939.618342:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046f1b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3642:x1874622881575936:12345-0@lo:400:kworker.0 Request processed in 28us (2643us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779939.618347:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00010000:00080000:0.0:1787779939.619020:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c04618e83c0 x1874622881574400/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779955 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787779939.619045:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04618e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881574400:0@lo:13:osp-pre-1-1.0 00010000:00080000:0.0:1787779939.619080:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c047785f840 x1874622881575424/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779955 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787779939.619091:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047785f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874622881575424:0@lo:400:kworker.0 00010000:00080000:0.0:1787779939.619114:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0461955e00 x1874622881575936/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779955 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787779939.619133:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0461955e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881575936:0@lo:400:kworker.0 00010000:00080000:0.0:1787779939.619164:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c047785fc00 x1874622881575552/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779955 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787779939.619180:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047785fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881575552:0@lo:400:kworker.0 00000100:00100000:3.0:1787779939.619373:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881574528 00000100:00100000:3.0:1787779939.619379:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881574528 00000100:00100000:3.0:1787779939.619422:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:3.0:1787779939.619430:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0478610050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+20:3643:x1874622881574528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779939.619497:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0478610050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+20:3643:x1874622881574528:12345-0@lo:400:kworker.0 Request processed in 67us (4486us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779939.619512:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:3.0:1787779939.619558:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04812ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1f575176-36bc-4786-83ee-2fea064a12a9:3643:1874622881574528:0@lo:400:kworker.0 00000100:00080000:2.0:1787779939.621666:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787779939.621675:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787779939.734182:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787779939.734344:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863659008 00000100:00100000:3.0:1787779939.734357:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863659008 00000100:00100000:3.0:1787779939.734503:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 320 00000100:00100000:3.0:1787779939.734517:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0442d5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+11:6179:x1874622863659008:12345-192.168.203.31@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787779939.734539:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787779939.734563:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c04766dc000/0xc8fc0a517996078f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf757128131ea1d4b expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779939.734599:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c04766dc000/0xc8fc0a517996078f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1d4b expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779939.734614:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c04766dc000/0xc8fc0a517996078f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1d4b expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779939.734625:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c04766dc000, rc 0) 00000100:00100000:3.0:1787779939.734734:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0442d5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+12:6179:x1874622863659008:12345-192.168.203.31@tcp:101:ll_cfg_requeue.0 Request processed in 220us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779939.734743:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 320 00000100:00100000:3.0:1787779939.751973:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787779939.752721:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863659136 00000100:00100000:0.0:1787779939.752735:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863659136 00000100:00100000:0.0:1787779939.752801:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 321 00000100:00100000:0.0:1787779939.752814:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0442d58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+12:6179:x1874622863659136:12345-192.168.203.31@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787779939.753160:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0442d58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+12:6179:x1874622863659136:12345-192.168.203.31@tcp:501:ll_cfg_requeue.0 Request processed in 347us (1200us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779939.753171:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 321 00000100:00100000:0.0:1787779939.764424:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787779939.764668:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863659264 00000100:00100000:3.0:1787779939.764682:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863659264 00000100:00100000:3.0:1787779939.764752:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 322 00000100:00100000:3.0:1787779939.764763:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0442d59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+12:6179:x1874622863659264:12345-192.168.203.31@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787779939.764995:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0442d59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+12:6179:x1874622863659264:12345-192.168.203.31@tcp:503:ll_cfg_requeue.0 Request processed in 233us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779939.765004:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 322 00000100:00100000:3.0:1787779939.776184:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787779939.778382:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863659392 00000100:00100000:0.0:1787779939.778401:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863659392 00000100:00100000:0.0:1787779939.778487:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 323 00000100:00100000:0.0:1787779939.778500:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0442d58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+12:6179:x1874622863659392:12345-192.168.203.31@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787779939.778521:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787779939.778653:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0477869400/0xc8fc0a5179960796 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf757128131ea1d52 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779939.778690:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0477869400/0xc8fc0a5179960796 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1d52 expref: 13 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779939.778703:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0477869400/0xc8fc0a5179960796 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1d52 expref: 13 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779939.778713:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0477869400, rc 0) 00000100:00100000:0.0:1787779939.778791:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0442d58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+13:6179:x1874622863659392:12345-192.168.203.31@tcp:101:ll_cfg_requeue.0 Request processed in 293us (2620us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779939.778818:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 323 00000100:00100000:0.0:1787779939.790078:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787779939.790207:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863659520 00000100:00100000:2.0:1787779939.790222:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863659520 00000100:00100000:2.0:1787779939.790319:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 324 00000100:00100000:2.0:1787779939.790330:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0442d59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+13:6179:x1874622863659520:12345-192.168.203.31@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787779939.790517:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0442d59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+13:6179:x1874622863659520:12345-192.168.203.31@tcp:501:ll_cfg_requeue.0 Request processed in 189us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779939.790526:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 324 00000100:00100000:2.0:1787779939.814712:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787779939.814795:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863659648 00000100:00100000:3.0:1787779939.814809:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863659648 00000100:00100000:3.0:1787779939.814908:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 325 00000100:00100000:3.0:1787779939.814920:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471775850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+13:6179:x1874622863659648:12345-192.168.203.31@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787779939.815386:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471775850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+13:6179:x1874622863659648:12345-192.168.203.31@tcp:503:ll_cfg_requeue.0 Request processed in 467us (686us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779939.815395:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 325 00000100:00100000:3.0:1787779940.124051:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787779940.124075:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04619570c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881576064:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787779940.124152:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779940.124870:0:8529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881576064 00000100:00100000:1.0:1787779940.124879:0:8529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881576064 00000100:00100000:1.0:1787779940.124947:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1787779940.124957:0:8529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0461955e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881576064:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787779940.124988:0:8529:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787779940.125068:0:8529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0461955e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881576064:12345-0@lo:13:osp-pre-0-1.0 Request processed in 112us (915us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779940.125076:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00010000:00080000:1.0:1787779940.125126:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c04619570c0 x1874622881576064/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779956 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787779940.125145:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04619570c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881576064:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787779940.128670:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787779940.128692:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0461957c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881576192:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787779940.128754:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779940.128811:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881576192 00000100:00100000:3.0:1787779940.128817:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881576192 00000100:00100000:3.0:1787779940.128875:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787779940.128884:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0461954f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881576192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787779940.128919:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787779940.128962:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0461954f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881576192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779940.128969:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00010000:00080000:3.0:1787779940.129005:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0461957c00 x1874622881576192/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779956 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779940.129022:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0461957c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881576192:0@lo:13:osp-pre-1-0.0 10000000:01000000:0.0:1787779940.444951:0:6509:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787779940.444959:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c0346bcb000 from 7 10000000:01000000:0.0:1787779940.444965:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787779940.445018:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c0477869a00/0xc8fc0a517996079d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779940.445040:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff9c0477869a00/0xc8fc0a517996079d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779940.445050:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff9c0477869a00/0xc8fc0a517996079d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779940.445076:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04778412c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881576320:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787779940.445161:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779940.445212:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0346d5b9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787779940.445288:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881576320 00000100:00100000:3.0:1787779940.445295:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881576320 00000100:00100000:3.0:1787779940.445350:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:3.0:1787779940.445369:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471775050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+20:6509:x1874622881576320:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787779940.445382:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787779940.445394:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c04766dd600/0xc8fc0a51799607a4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc8fc0a517996079d expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779940.445416:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c04766dd600/0xc8fc0a51799607a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc8fc0a517996079d expref: 21 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779940.445427:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c04766dd600/0xc8fc0a51799607a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a517996079d expref: 21 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779940.445436:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c04766dd600, rc 0) 00000100:00100000:3.0:1787779940.445483:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471775050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+21:6509:x1874622881576320:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779940.445489:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:0.0:1787779940.445700:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04778412c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881576320:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787779940.445714:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff9c0477869a00/0xc8fc0a517996079d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a51799607a4 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779940.445723:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff9c0477869a00/0xc8fc0a517996079d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc8fc0a51799607a4 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779940.445781:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04778412c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881576448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787779940.445807:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779940.445835:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0346d5b9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787779940.446223:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881576448 00000100:00100000:3.0:1787779940.446229:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881576448 00000100:00100000:3.0:1787779940.446281:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:3.0:1787779940.446288:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471777050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+21:6509:x1874622881576448:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787779940.446423:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471777050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+21:6509:x1874622881576448:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 135us (613us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779940.446431:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:2.0:1787779940.446499:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04778412c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881576448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787779940.446532:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477aead00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881576576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787779940.446574:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779940.446612:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0347c50540 going to sleep for 11 seconds 00000100:00100000:0.0:1787779940.446869:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881576576 00000100:00100000:0.0:1787779940.446880:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881576576 00000100:00100000:0.0:1787779940.446911:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:0.0:1787779940.446917:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471774850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+21:6509:x1874622881576576:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787779940.446995:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471774850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+21:6509:x1874622881576576:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 77us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779940.447002:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:0.0:1787779940.447043:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477aead00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881576576:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787779940.448335:0:13210:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1787779940.448552:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1787779940.448574:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787779940.448583:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c0477869a00/0xc8fc0a517996079d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a51799607a4 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779940.448595:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff9c0477869a00/0xc8fc0a517996079d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a51799607a4 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787779940.448606:0:6509:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787779940.448609:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c046ecd6000 from 7 10000000:01000000:0.0:1787779940.448612:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787779940.448645:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c0477868200/0xc8fc0a51799607ab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779940.448653:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff9c0477868200/0xc8fc0a51799607ab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779940.448663:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff9c0477868200/0xc8fc0a51799607ab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779940.448683:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477841a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881576704:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787779940.448733:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779940.448783:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0346d5b300 going to sleep for 11 seconds 00000100:00100000:2.0:1787779940.451414:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881576704 00000100:00100000:2.0:1787779940.451426:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881576704 00000100:00100000:2.0:1787779940.451492:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:2.0:1787779940.451502:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471777450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+21:6509:x1874622881576704:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787779940.451518:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787779940.451534:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0477a70600/0xc8fc0a51799607b2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc8fc0a51799607ab expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779940.451560:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0477a70600/0xc8fc0a51799607b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc8fc0a51799607ab expref: 22 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779940.451571:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0477a70600/0xc8fc0a51799607b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a51799607ab expref: 22 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779940.451579:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0477a70600, rc 0) 00000100:00100000:2.0:1787779940.453529:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471777450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+22:6509:x1874622881576704:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 2020us (4787us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779940.453555:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:0.0:1787779940.459503:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477841a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881576704:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787779940.459536:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff9c0477868200/0xc8fc0a51799607ab lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a51799607b2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779940.459549:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff9c0477868200/0xc8fc0a51799607ab lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc8fc0a51799607b2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779940.459960:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0461957c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881576832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787779940.460020:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779940.460069:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0347d45e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787779940.460460:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881576832 00000100:00100000:0.0:1787779940.460466:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881576832 00000100:00100000:0.0:1787779940.460518:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:0.0:1787779940.460527:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471776850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+22:6509:x1874622881576832:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787779940.461567:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471776850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+22:6509:x1874622881576832:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1038us (1543us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779940.461576:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:3.0:1787779940.463342:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0461957c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881576832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787779940.463411:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0461957c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881576960:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787779940.463485:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779940.463527:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0347d45e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787779940.464078:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881576960 00000100:00100000:0.0:1787779940.464086:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881576960 00000100:00100000:0.0:1787779940.464153:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:0.0:1787779940.464163:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471777c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+22:6509:x1874622881576960:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787779940.464293:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471777c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+22:6509:x1874622881576960:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 130us (807us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779940.464300:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:3.0:1787779940.465778:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0461957c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881576960:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787779940.470998:0:13211:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1787779940.471299:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1787779940.471320:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787779940.471332:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c0477868200/0xc8fc0a51799607ab lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a51799607b2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779940.471343:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff9c0477868200/0xc8fc0a51799607ab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a51799607b2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787779940.471364:0:6509:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787779940.471367:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c04764fa000 from 7 10000000:01000000:3.0:1787779940.471370:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787779940.471404:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c04766dc200/0xc8fc0a51799607b9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779940.471428:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff9c04766dc200/0xc8fc0a51799607b9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779940.471439:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff9c04766dc200/0xc8fc0a51799607b9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779940.471463:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0461957c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881577088:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787779940.471529:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779940.471563:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0347d45e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787779940.471674:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881577088 00000100:00100000:0.0:1787779940.471682:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881577088 00000100:00100000:0.0:1787779940.471736:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:0.0:1787779940.471746:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471776c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+22:6509:x1874622881577088:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787779940.471760:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787779940.471778:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0477868e00/0xc8fc0a51799607c0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc8fc0a51799607b9 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779940.471801:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0477868e00/0xc8fc0a51799607c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc8fc0a51799607b9 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779940.471812:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0477868e00/0xc8fc0a51799607c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a51799607b9 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779940.471821:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0477868e00, rc 0) 00000100:00100000:0.0:1787779940.471891:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471776c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+23:6509:x1874622881577088:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 146us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779940.471898:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:3.0:1787779940.472125:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0461957c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881577088:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787779940.472139:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff9c04766dc200/0xc8fc0a51799607b9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a51799607c0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779940.472149:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff9c04766dc200/0xc8fc0a51799607b9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc8fc0a51799607c0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779940.472204:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0461957c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881577216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787779940.472232:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779940.472260:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0347d45e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787779940.472345:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881577216 00000100:00100000:1.0:1787779940.472359:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881577216 00000100:00100000:1.0:1787779940.472385:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:1.0:1787779940.472393:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471777850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+23:6509:x1874622881577216:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787779940.472504:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471777850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+23:6509:x1874622881577216:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 112us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779940.472512:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:3.0:1787779940.472666:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0461957c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881577216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787779940.472694:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0461957c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881577344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787779940.472736:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779940.472757:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0347d45e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787779940.474275:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881577344 00000100:00100000:1.0:1787779940.474287:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881577344 00000100:00100000:1.0:1787779940.474342:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:1.0:1787779940.474351:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471776050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+23:6509:x1874622881577344:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787779940.474653:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471776050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+23:6509:x1874622881577344:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 303us (1916us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779940.474661:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:3.0:1787779940.474749:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0461957c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881577344:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787779940.475763:0:13213:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1787779940.484016:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1787779940.484061:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787779940.484072:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c04766dc200/0xc8fc0a51799607b9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a51799607c0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779940.484086:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff9c04766dc200/0xc8fc0a51799607b9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a51799607c0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787779940.484106:0:6509:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787779940.484109:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c044407a000 from 7 10000000:01000000:3.0:1787779940.484119:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787779940.484155:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c04766dd400/0xc8fc0a51799607c7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779940.484163:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff9c04766dd400/0xc8fc0a51799607c7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779940.484173:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff9c04766dd400/0xc8fc0a51799607c7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779940.484195:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0461957c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881577472:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787779940.484259:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779940.484308:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0347d45e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787779940.484560:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881577472 00000100:00100000:0.0:1787779940.484567:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881577472 00000100:00100000:0.0:1787779940.484640:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:0.0:1787779940.484650:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471774450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+23:6509:x1874622881577472:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787779940.484663:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787779940.484677:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0477869000/0xc8fc0a51799607ce lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xc8fc0a51799607c7 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779940.484702:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0477869000/0xc8fc0a51799607ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc8fc0a51799607c7 expref: 24 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779940.484713:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0477869000/0xc8fc0a51799607ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a51799607c7 expref: 24 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779940.484722:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0477869000, rc 0) 00000100:00100000:0.0:1787779940.484774:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471774450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+24:6509:x1874622881577472:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779940.484792:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:1.0:1787779940.487770:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0461957c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881577472:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787779940.487800:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff9c04766dd400/0xc8fc0a51799607c7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a51799607ce expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779940.487830:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff9c04766dd400/0xc8fc0a51799607c7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc8fc0a51799607ce expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779940.487934:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04618e8780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881577600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787779940.487989:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779940.488024:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881577600 00000100:00100000:1.0:1787779940.488029:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881577600 00000100:00100000:1.0:1787779940.488071:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:1.0:1787779940.488080:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471775450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+24:6509:x1874622881577600:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787779940.488213:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471775450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+24:6509:x1874622881577600:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 134us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779940.488221:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:1.0:1787779940.488262:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c046ef9cc00 going to sleep for 11 seconds 00000100:00100000:1.0:1787779940.488276:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04618e8780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881577600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787779940.488303:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04618e8780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881577728:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787779940.488340:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779940.488577:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881577728 00000100:00100000:3.0:1787779940.488582:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881577728 00000100:00100000:3.0:1787779940.488625:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:3.0:1787779940.488632:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471774c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+24:6509:x1874622881577728:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787779940.488718:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471774c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+24:6509:x1874622881577728:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 75us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779940.488725:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:1.0:1787779940.489184:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c046ef9cc00 going to sleep for 11 seconds 00000100:00100000:1.0:1787779940.489201:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04618e8780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881577728:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787779940.492683:0:13214:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1787779940.494126:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1787779940.494160:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787779940.494173:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c04766dd400/0xc8fc0a51799607c7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a51799607ce expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779940.494185:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff9c04766dd400/0xc8fc0a51799607c7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a51799607ce expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779940.508320:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787779940.669308:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04618e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881577856:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787779940.669379:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779940.669456:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881577856 00000100:00100000:1.0:1787779940.669463:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881577856 00000100:00100000:1.0:1787779940.669507:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1787779940.669533:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04618eb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874622881577856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787779940.669563:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787779940.669607:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04618eb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874622881577856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779940.669614:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00010000:00080000:1.0:1787779940.669669:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c04618e8780 x1874622881577856/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779956 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787779940.669686:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04618e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881577856:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787779941.290008:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787779941.290047:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787779941.290072:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787779941.290092:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787779941.290123:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787779941.290154:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863660032 00000100:00100000:0.0:1787779941.290162:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863660032 00000100:00100000:0.0:1787779941.290219:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863660288 00000100:00100000:0.0:1787779941.290222:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863660288 00000100:00100000:0.0:1787779941.290237:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863659904 00000100:00100000:0.0:1787779941.290239:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863659904 00000100:00100000:0.0:1787779941.290251:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863660160 00000100:00100000:0.0:1787779941.290253:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863660160 00000100:00100000:0.0:1787779941.290268:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 221 00000100:00100000:0.0:1787779941.290277:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477841a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:2411:x1874622863660032:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1787779941.290356:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477841a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:2411:x1874622863660032:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 69us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779941.290363:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 221 00000100:00100000:0.0:1787779941.290383:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 222 00000100:00100000:0.0:1787779941.290390:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477840780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+5:2411:x1874622863660288:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1787779941.290416:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477840780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+5:2411:x1874622863660288:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 27us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779941.290423:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 222 00000100:00100000:0.0:1787779941.290435:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 223 00000100:00100000:0.0:1787779941.290441:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477841e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+6:2410:x1874622863659904:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1787779941.290482:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477841e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+6:2410:x1874622863659904:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 41us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779941.290488:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 223 00000100:00100000:0.0:1787779941.290500:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 224 00000100:00100000:0.0:1787779941.290506:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04778430c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+5:2410:x1874622863660160:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1787779941.290529:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04778430c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+5:2410:x1874622863660160:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 23us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779941.290535:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 224 00000100:00100000:2.0:1787779941.291906:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863659776 00000100:00100000:2.0:1787779941.291917:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863659776 00000100:00100000:2.0:1787779941.291963:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 338 00000100:00100000:2.0:1787779941.291971:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471775c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+13:2411:x1874622863659776:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1787779941.292024:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471775c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+13:2411:x1874622863659776:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 54us (2025us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779941.292032:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 338 00000100:00080000:2.0:1787779941.292066:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787779941.292070:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1787779941.532539:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787779942.183588:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477aea1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874622881577984:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787779942.183654:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779942.183737:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881577984 00000100:00100000:2.0:1787779942.183744:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881577984 00000100:00100000:2.0:1787779942.183788:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1787779942.183797:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477aeb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1874622881577984:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787779942.183855:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787779942.183899:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477aeb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1874622881577984:12345-0@lo:41:osp-pre-0-1.0 Request processed in 103us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779942.183906:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1787779942.183958:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477aea1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874622881577984:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787779942.557668:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787779942.685520:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787779942.685543:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0461957c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881578112:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787779942.685609:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779942.685680:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881578112 00000100:00100000:3.0:1787779942.685686:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881578112 00000100:00100000:3.0:1787779942.685746:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1787779942.685754:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04619570c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881578112:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787779942.685785:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787779942.685827:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04619570c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881578112:12345-0@lo:41:osp-pre-1-0.0 Request processed in 74us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779942.685834:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1787779942.685904:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0461957c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881578112:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1787779943.585776:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787779944.607830:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787779944.732125:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347ebc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874622881578624:0@lo:400:kworker.0 00000100:00100000:3.0:1787779944.732196:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779944.732252:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347ee0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881579136:0@lo:400:kworker.0 00000100:00100000:3.0:1787779944.732277:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779944.732297:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0476441a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881579648:0@lo:400:kworker.0 00000100:00100000:2.0:1787779944.732339:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881578624 00000100:00100000:2.0:1787779944.732347:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881578624 00000100:00100000:2.0:1787779944.732397:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1787779944.732406:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0476442580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1874622881578624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787779944.732820:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0461957c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1f575176-36bc-4786-83ee-2fea064a12a9:3644:1874622881578240:0@lo:400:kworker.0 00000100:00100000:2.0:1787779944.736680:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0476442580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1874622881578624:12345-0@lo:400:kworker.0 Request processed in 4266us (4474us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779944.736694:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1787779944.736792:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347ebc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874622881578496:0@lo:400:kworker.0 00000100:00100000:2.0:1787779944.736832:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779944.736882:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347ee0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1874622881579008:0@lo:400:kworker.0 00000100:00100000:2.0:1787779944.736907:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779944.736932:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347e56580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1874622881579520:0@lo:400:kworker.0 00000100:00100000:2.0:1787779944.736952:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779944.736980:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:2.0:1787779944.736987:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347ebf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1874622881578368:0@lo:400:kworker.0 00000100:00100000:2.0:1787779944.737008:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779944.737023:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347ebd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1874622881578880:0@lo:400:kworker.0 00000100:00100000:2.0:1787779944.737040:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779944.737054:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347ee2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1874622881579392:0@lo:400:kworker.0 00000100:00100000:2.0:1787779944.737073:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779944.737097:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04618e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874622881579904:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787779944.737119:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779944.737150:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881579008 00000100:00100000:2.0:1787779944.737157:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881579008 00000100:00100000:2.0:1787779944.737195:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881579520 00000100:00100000:2.0:1787779944.737199:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881579520 00000100:00100000:2.0:1787779944.737211:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881578368 00000100:00100000:2.0:1787779944.737213:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881578368 00000100:00100000:2.0:1787779944.737224:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881578880 00000100:00100000:2.0:1787779944.737227:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881578880 00000100:00100000:2.0:1787779944.737253:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881579392 00000100:00100000:2.0:1787779944.737256:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881579392 00000100:00100000:2.0:1787779944.737269:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1787779944.737277:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477ae92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1874622881579008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779944.737324:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477ae92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1874622881579008:12345-0@lo:400:kworker.0 Request processed in 48us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779944.737330:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1787779944.737341:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1787779944.737347:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477ae8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1874622881579520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779944.737370:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477ae8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1874622881579520:12345-0@lo:400:kworker.0 Request processed in 24us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779944.737376:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1787779944.737385:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1787779944.737389:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477aea940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1874622881578368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779944.737408:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477aea940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1874622881578368:12345-0@lo:400:kworker.0 Request processed in 19us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779944.737413:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1787779944.737542:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1787779944.737549:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477aeb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1874622881578880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779944.737576:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477aeb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1874622881578880:12345-0@lo:400:kworker.0 Request processed in 28us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779944.737582:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1787779944.737592:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1787779944.737597:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477ae9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1874622881579392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779944.737617:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477ae9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1874622881579392:12345-0@lo:400:kworker.0 Request processed in 20us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779944.737627:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00080000:2.0:1787779944.737648:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787779944.737652:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787779944.737688:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347ebf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1874622881578368:0@lo:400:kworker.0 00000100:00100000:2.0:1787779944.737698:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347ebd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1874622881578880:0@lo:400:kworker.0 00000100:00100000:2.0:1787779944.737705:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347ee2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1874622881579392:0@lo:400:kworker.0 00010000:00080000:2.0:1787779944.737716:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0347ee0780 x1874622881579008/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779960 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787779944.737726:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347ee0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1874622881579008:0@lo:400:kworker.0 00010000:00080000:2.0:1787779944.737734:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0347e56580 x1874622881579520/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779960 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787779944.737743:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347e56580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1874622881579520:0@lo:400:kworker.0 00000100:00100000:3.0:1787779944.738800:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779944.738866:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881578496 00000100:00100000:3.0:1787779944.738872:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881578496 00000100:00100000:3.0:1787779944.738920:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1787779944.738929:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477aea1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1874622881578496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779944.738974:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477aea1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1874622881578496:12345-0@lo:400:kworker.0 Request processed in 48us (2142us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779944.738980:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1787779944.738999:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881579136 00000100:00100000:3.0:1787779944.739003:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881579136 00000100:00100000:3.0:1787779944.739028:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881579648 00000100:00100000:3.0:1787779944.739030:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881579648 00000100:00100000:3.0:1787779944.739066:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1787779944.739072:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0476441e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881579136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779944.739112:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0476441e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881579136:12345-0@lo:400:kworker.0 Request processed in 40us (6834us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779944.739118:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1787779944.739129:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1787779944.739134:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04764403c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881579648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779944.739155:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04764403c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881579648:12345-0@lo:400:kworker.0 Request processed in 22us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779944.739160:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1787779944.739176:0:8529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881579904 00000100:00100000:3.0:1787779944.739179:0:8529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881579904 00000100:00100000:3.0:1787779944.739201:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787779944.739207:0:8529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477ae83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1874622881579904:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787779944.739227:0:8529:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787779944.739256:0:8529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477ae83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1874622881579904:12345-0@lo:13:osp-pre-1-1.0 Request processed in 50us (2137us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779944.739269:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00080000:3.0:1787779944.739295:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787779944.739299:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787779944.739407:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0476441a40 x1874622881579648/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779960 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779944.739630:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0476441a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881579648:0@lo:400:kworker.0 00000100:00100000:3.0:1787779944.739662:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347ebc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874622881578624:0@lo:400:kworker.0 00010000:00080000:3.0:1787779944.739672:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0347ee0b40 x1874622881579136/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779960 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779944.739681:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347ee0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881579136:0@lo:400:kworker.0 00000100:00100000:0.0:1787779944.740361:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779944.740407:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347ebcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881578752:0@lo:400:kworker.0 00000100:00100000:0.0:1787779944.740454:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779944.740472:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347ee3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881579264:0@lo:400:kworker.0 00000100:00100000:0.0:1787779944.740496:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779944.740509:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881578240 00000100:00100000:0.0:1787779944.740513:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0476442940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881579776:0@lo:400:kworker.0 00000100:00100000:3.0:1787779944.740514:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881578240 00000100:00100000:0.0:1787779944.740532:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779944.740547:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:3.0:1787779944.740554:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471774050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+24:3644:x1874622881578240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779944.740599:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471774050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+24:3644:x1874622881578240:12345-0@lo:400:kworker.0 Request processed in 46us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779944.740606:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:0.0:1787779944.740609:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0461957c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1f575176-36bc-4786-83ee-2fea064a12a9:3644:1874622881578240:0@lo:400:kworker.0 00000100:00100000:3.0:1787779944.740631:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881578752 00000100:00100000:3.0:1787779944.740634:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881578752 00000100:00100000:3.0:1787779944.740652:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1787779944.740658:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477843480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881578752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779944.740701:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477843480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881578752:12345-0@lo:400:kworker.0 Request processed in 42us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779944.740708:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1787779944.740735:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881579264 00000100:00100000:0.0:1787779944.740737:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347ebcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881578752:0@lo:400:kworker.0 00000100:00100000:3.0:1787779944.740738:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881579264 00000100:00100000:3.0:1787779944.740774:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881579776 00000100:00100000:3.0:1787779944.740777:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881579776 00000100:00100000:3.0:1787779944.740796:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787779944.740801:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04778421c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881579264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779944.740835:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04778421c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881579264:12345-0@lo:400:kworker.0 Request processed in 34us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779944.740960:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787779944.740972:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787779944.740978:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477842d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881579776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779944.741006:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477842d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881579776:12345-0@lo:400:kworker.0 Request processed in 28us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779944.741012:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00010000:00080000:2.0:1787779944.741215:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c04618e8780 x1874622881579904/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779960 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787779944.741232:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04618e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874622881579904:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787779944.741243:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347ebc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874622881578496:0@lo:400:kworker.0 00000100:00080000:3.0:1787779944.742912:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787779944.742918:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787779944.742954:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0347ee3c00 x1874622881579264/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779960 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779944.742968:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347ee3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881579264:0@lo:400:kworker.0 00010000:00080000:3.0:1787779944.742980:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0476442940 x1874622881579776/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779960 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779944.742987:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0476442940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881579776:0@lo:400:kworker.0 00000001:02000400:2.0:1787779944.836987:0:13379:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg331-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1787779945.254185:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477840f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881580032:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787779945.254252:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779945.254351:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881580032 00000100:00100000:0.0:1787779945.254360:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881580032 00000100:00100000:0.0:1787779945.254432:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787779945.254443:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477ae8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1874622881580032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787779945.254476:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787779945.254525:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477ae8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1874622881580032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779945.254532:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00010000:00080000:0.0:1787779945.254571:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0477840f00 x1874622881580032/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779961 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787779945.254589:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477840f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881580032:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787779945.267113:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0476442940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881580160:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787779945.267176:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779945.267242:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881580160 00000100:00100000:3.0:1787779945.267249:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881580160 00000100:00100000:3.0:1787779945.267298:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787779945.267305:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0476441a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881580160:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787779945.267332:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787779945.267372:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0476441a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881580160:12345-0@lo:13:osp-pre-0-1.0 Request processed in 67us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779945.267379:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00010000:00080000:3.0:1787779945.267425:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0476442940 x1874622881580160/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779961 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779945.267449:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0476442940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881580160:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1787779945.628916:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787779945.756043:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04618ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881580288:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787779945.756124:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779945.756243:0:8529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881580288 00000100:00100000:0.0:1787779945.756251:0:8529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881580288 00000100:00100000:0.0:1787779945.756304:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787779945.756313:0:8529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0476442940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881580288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787779945.756334:0:8529:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787779945.756389:0:8529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0476442940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881580288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779945.756397:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00010000:00080000:1.0:1787779945.756476:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c04618ea580 x1874622881580288/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779961 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787779945.756495:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04618ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881580288:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787779946.403194:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787779946.403243:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787779946.403274:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787779946.403307:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787779946.403331:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787779946.403341:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863660672 00000100:00100000:1.0:1787779946.403351:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863660672 00000100:00100000:1.0:1787779946.403403:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863660928 00000100:00100000:1.0:1787779946.403405:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863660928 00000100:00100000:1.0:1787779946.403417:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863660544 00000100:00100000:1.0:1787779946.403418:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863660544 00000100:00100000:1.0:1787779946.403427:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863660800 00000100:00100000:1.0:1787779946.403429:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863660800 00000100:00100000:1.0:1787779946.403443:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 231 00000100:00100000:1.0:1787779946.403452:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477840f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:2410:x1874622863660672:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1787779946.403471:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 232 00000100:00100000:2.0:1787779946.403496:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477840b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+5:2410:x1874622863660928:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1787779946.403519:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477840f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:2410:x1874622863660672:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 67us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779946.403527:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 231 00000100:00100000:1.0:1787779946.403544:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 233 00000100:00100000:2.0:1787779946.403549:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477840b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+5:2410:x1874622863660928:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 68us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779946.403563:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 232 00000100:00100000:1.0:1787779946.403564:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04778412c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+6:2410:x1874622863660544:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1787779946.403586:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 234 00000100:00100000:1.0:1787779946.403594:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04778412c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+6:2410:x1874622863660544:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 32us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779946.403598:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04778403c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+5:2410:x1874622863660800:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1787779946.403606:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 233 00000100:00100000:2.0:1787779946.403649:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04778403c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+5:2410:x1874622863660800:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 55us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779946.403657:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 234 00000100:00100000:3.0:1787779946.403754:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863660416 00000100:00100000:3.0:1787779946.403759:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863660416 00000100:00100000:3.0:1787779946.403800:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 340 00000100:00100000:3.0:1787779946.403807:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471776450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+13:2410:x1874622863660416:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1787779946.403927:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471776450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+13:2410:x1874622863660416:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 120us (742us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779946.403934:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 340 00000100:00080000:0.0:1787779946.404473:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787779946.404478:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1787779946.653411:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787779947.292884:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787779947.292907:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477ae8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874622881580416:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787779947.292999:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779947.293653:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881580416 00000100:00100000:2.0:1787779947.293662:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881580416 00000100:00100000:2.0:1787779947.293714:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1787779947.293725:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477840000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1874622881580416:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787779947.293758:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787779947.293808:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477840000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1874622881580416:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (809us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779947.293815:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1787779947.293998:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477ae8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874622881580416:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787779947.676137:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787779947.805036:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477aea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881580544:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787779947.805111:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779947.805182:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881580544 00000100:00100000:2.0:1787779947.805189:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881580544 00000100:00100000:2.0:1787779947.805232:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1787779947.805240:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477ae9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1874622881580544:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787779947.805273:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787779947.805326:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477ae9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1874622881580544:12345-0@lo:41:osp-pre-1-0.0 Request processed in 86us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779947.805344:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1787779947.805384:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477aea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881580544:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1787779948.701743:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787779949.726192:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787779949.852404:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346cff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874622881580800:0@lo:400:kworker.0 00000100:00100000:1.0:1787779949.852483:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779949.852658:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c046215e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1874622881581312:0@lo:400:kworker.0 00000100:00100000:1.0:1787779949.852682:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779949.852703:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347a87c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1874622881581824:0@lo:400:kworker.0 00000100:00100000:1.0:1787779949.852720:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779949.852746:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:1.0:1787779949.852752:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346cfda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1f575176-36bc-4786-83ee-2fea064a12a9:3644:1874622881580672:0@lo:400:kworker.0 00000100:00100000:1.0:1787779949.852776:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779949.852798:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346cff840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881581184:0@lo:400:kworker.0 00000100:00100000:1.0:1787779949.852819:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779949.852833:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c046215c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881581696:0@lo:400:kworker.0 00000100:00100000:1.0:1787779949.852957:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779949.852974:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346d4ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881582208:0@lo:400:kworker.0 00000100:00100000:1.0:1787779949.852992:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779949.853024:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881580672 00000100:00100000:1.0:1787779949.853030:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881580672 00000100:00100000:3.0:1787779949.853155:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881580800 00000100:00100000:3.0:1787779949.853160:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881580800 00000100:00100000:3.0:1787779949.853193:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881581312 00000100:00100000:3.0:1787779949.853196:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881581312 00000100:00100000:3.0:1787779949.853219:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881581824 00000100:00100000:3.0:1787779949.853221:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881581824 00000100:00100000:3.0:1787779949.853238:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1787779949.853245:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04618e8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874622881580800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779949.853315:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04618e8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874622881580800:12345-0@lo:400:kworker.0 Request processed in 70us (832us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779949.853323:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1787779949.853340:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1787779949.853346:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04618e8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1874622881581312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779949.853372:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04618e8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1874622881581312:12345-0@lo:400:kworker.0 Request processed in 27us (689us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779949.853377:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1787779949.853388:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1787779949.853393:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04618ea580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1874622881581824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779949.853416:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04618ea580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1874622881581824:12345-0@lo:400:kworker.0 Request processed in 23us (695us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779949.853420:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1787779949.853438:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881581696 00000100:00100000:3.0:1787779949.853441:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881581696 00000100:00100000:3.0:1787779949.853461:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881582208 00000100:00100000:3.0:1787779949.853464:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881582208 00000100:00100000:3.0:1787779949.853481:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787779949.853487:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04618e83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881581696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779949.853515:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04618e83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881581696:12345-0@lo:400:kworker.0 Request processed in 29us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779949.853521:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787779949.853533:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787779949.853538:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04618ebc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881582208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779949.853564:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04618ebc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881582208:12345-0@lo:400:kworker.0 Request processed in 26us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779949.853579:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00010000:00080000:3.0:1787779949.853642:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c046215c000 x1874622881581696/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779965 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779949.853655:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c046215c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881581696:0@lo:400:kworker.0 00010000:00080000:3.0:1787779949.853666:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0346d4ed00 x1874622881582208/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779965 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779949.853673:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346d4ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881582208:0@lo:400:kworker.0 00000100:00100000:3.0:1787779949.853682:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346cff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874622881580800:0@lo:400:kworker.0 00000100:00100000:3.0:1787779949.853690:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c046215e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1874622881581312:0@lo:400:kworker.0 00000100:00100000:3.0:1787779949.853698:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347a87c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1874622881581824:0@lo:400:kworker.0 00000100:00100000:1.0:1787779949.854072:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:1.0:1787779949.854081:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471772050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+24:3644:x1874622881580672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787779949.854123:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471772050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+24:3644:x1874622881580672:12345-0@lo:400:kworker.0 Request processed in 44us (1345us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779949.854136:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:1.0:1787779949.854173:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346cfda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1f575176-36bc-4786-83ee-2fea064a12a9:3644:1874622881580672:0@lo:400:kworker.0 00000100:00100000:2.0:1787779949.854288:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346cfe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1874622881581056:0@lo:400:kworker.0 00000100:00100000:2.0:1787779949.854319:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779949.854341:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c046215d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874622881581568:0@lo:400:kworker.0 00000100:00100000:2.0:1787779949.854362:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779949.854378:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347a843c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874622881582080:0@lo:400:kworker.0 00000100:00100000:2.0:1787779949.854396:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779949.854413:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1787779949.854419:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346cfed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874622881580928:0@lo:400:kworker.0 00000100:00100000:2.0:1787779949.854439:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779949.854454:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c046215fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1874622881581440:0@lo:400:kworker.0 00000100:00100000:2.0:1787779949.854472:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779949.854482:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347a86580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1874622881581952:0@lo:400:kworker.0 00000100:00100000:2.0:1787779949.854502:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779949.854522:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881581056 00000100:00100000:2.0:1787779949.854527:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881581056 00000100:00100000:2.0:1787779949.854548:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881581440 00000100:00100000:2.0:1787779949.854550:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881581440 00000100:00100000:2.0:1787779949.854564:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881581952 00000100:00100000:2.0:1787779949.854566:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881581952 00000100:00100000:2.0:1787779949.854581:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1787779949.854586:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477aea580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1874622881581056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779949.854622:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477aea580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1874622881581056:12345-0@lo:400:kworker.0 Request processed in 35us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779949.854638:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1787779949.854651:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1787779949.854656:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347e56580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1874622881581440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779949.854682:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347e56580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1874622881581440:12345-0@lo:400:kworker.0 Request processed in 27us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779949.854687:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1787779949.854697:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1787779949.854702:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347ee3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1874622881581952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779949.854725:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347ee3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1874622881581952:12345-0@lo:400:kworker.0 Request processed in 23us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779949.854730:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1787779949.854749:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881581184 00000100:00100000:2.0:1787779949.854753:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881581184 00000100:00100000:2.0:1787779949.854767:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881580928 00000100:00100000:2.0:1787779949.854769:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881580928 00000100:00100000:2.0:1787779949.854778:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1787779949.854784:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04618e8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881581184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779949.854816:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04618e8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881581184:12345-0@lo:400:kworker.0 Request processed in 32us (1996us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779949.854821:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1787779949.854830:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00080000:0.0:1787779949.855344:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787779949.855350:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787779949.855352:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787779949.855355:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787779949.855367:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881581568 00000100:00100000:0.0:1787779949.855371:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881581568 00000100:00100000:0.0:1787779949.855410:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881582080 00000100:00100000:0.0:1787779949.855413:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881582080 00000100:00100000:0.0:1787779949.855429:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787779949.855437:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477aeb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1874622881581568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787779949.855492:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477aeb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1874622881581568:12345-0@lo:400:kworker.0 Request processed in 56us (1128us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779949.855498:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787779949.855512:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787779949.855519:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477ae8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1874622881582080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787779949.855547:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477ae8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1874622881582080:12345-0@lo:400:kworker.0 Request processed in 29us (1150us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779949.855553:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00080000:0.0:1787779949.855570:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787779949.855573:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787779949.855649:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c046215fc00 x1874622881581440/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779965 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787779949.855661:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c046215fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1874622881581440:0@lo:400:kworker.0 00010000:00080000:0.0:1787779949.855684:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0347a86580 x1874622881581952/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779965 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787779949.855693:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347a86580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1874622881581952:0@lo:400:kworker.0 00000100:00100000:0.0:1787779949.855704:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346cfe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1874622881581056:0@lo:400:kworker.0 00000100:00100000:1.0:1787779949.856118:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787779949.856131:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04618eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881582336:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787779949.856167:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1787779949.856758:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c046215d680 x1874622881581568/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779965 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787779949.856771:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c046215d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874622881581568:0@lo:400:kworker.0 00010000:00080000:0.0:1787779949.856782:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0347a843c0 x1874622881582080/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779965 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787779949.856789:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347a843c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874622881582080:0@lo:400:kworker.0 00000100:00100000:2.0:1787779949.857031:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477aead00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1874622881580928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779949.857103:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477aead00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1874622881580928:12345-0@lo:400:kworker.0 Request processed in 2266us (2663us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779949.857111:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1787779949.857157:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346cfed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874622881580928:0@lo:400:kworker.0 00000100:00100000:0.0:1787779949.857395:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346cff840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881581184:0@lo:400:kworker.0 00000100:00100000:1.0:1787779949.857982:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881582336 00000100:00100000:1.0:1787779949.857990:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881582336 00000100:00100000:1.0:1787779949.858094:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1787779949.858104:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347bcc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881582336:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787779949.858130:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787779949.858195:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347bcc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881582336:12345-0@lo:13:osp-pre-1-1.0 Request processed in 93us (2028us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779949.858202:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00010000:00080000:2.0:1787779949.858267:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c04618eb480 x1874622881582336/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779965 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787779949.858283:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04618eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881582336:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787779950.364097:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787779950.364139:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346d4ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874622881582464:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787779950.364239:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779950.364539:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881582464 00000100:00100000:3.0:1787779950.364549:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881582464 00000100:00100000:3.0:1787779950.364617:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787779950.364629:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347bcde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1874622881582464:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787779950.364678:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787779950.364759:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347bcde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1874622881582464:12345-0@lo:13:osp-pre-0-1.0 Request processed in 133us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779950.364767:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00010000:00080000:1.0:1787779950.365038:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0346d4ed00 x1874622881582464/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779966 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787779950.365073:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346d4ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874622881582464:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787779950.373819:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346d4de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881582592:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787779950.373948:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779950.374154:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881582592 00000100:00100000:3.0:1787779950.374164:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881582592 00000100:00100000:3.0:1787779950.374221:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787779950.374232:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347bced00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1874622881582592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787779950.374268:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787779950.374351:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347bced00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1874622881582592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 122us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779950.374358:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00010000:00080000:1.0:1787779950.374625:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0346d4de00 x1874622881582592/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779966 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787779950.374659:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346d4de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881582592:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787779950.748960:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787779950.885461:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787779950.885483:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346d4f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881582720:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787779950.885563:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779950.885631:0:8529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881582720 00000100:00100000:3.0:1787779950.885637:0:8529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881582720 00000100:00100000:3.0:1787779950.885673:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787779950.885678:0:8529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346d4cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881582720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787779950.885709:0:8529:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787779950.885751:0:8529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346d4cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881582720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779950.885759:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00010000:00080000:3.0:1787779950.885805:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0346d4f840 x1874622881582720/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779966 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779950.885823:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346d4f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881582720:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787779951.520125:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787779951.520165:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787779951.520197:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787779951.520231:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787779951.520256:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787779951.520292:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863661312 00000100:00100000:0.0:1787779951.520301:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863661312 00000100:00100000:0.0:1787779951.520351:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863661568 00000100:00100000:0.0:1787779951.520355:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863661568 00000100:00100000:0.0:1787779951.520366:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863661184 00000100:00100000:0.0:1787779951.520369:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863661184 00000100:00100000:0.0:1787779951.520377:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863661440 00000100:00100000:0.0:1787779951.520380:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863661440 00000100:00100000:0.0:1787779951.520394:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 241 00000100:00100000:0.0:1787779951.520416:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0461957c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:2411:x1874622863661312:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1787779951.520491:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0461957c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:2411:x1874622863661312:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 77us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779951.520499:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 241 00000100:00100000:0.0:1787779951.520515:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 242 00000100:00100000:0.0:1787779951.520521:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0461956940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+5:2411:x1874622863661568:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1787779951.520543:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0461956940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+5:2411:x1874622863661568:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 22us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779951.520550:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 242 00000100:00100000:0.0:1787779951.520559:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 243 00000100:00100000:0.0:1787779951.520564:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c047785fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+6:2411:x1874622863661184:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1787779951.520586:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c047785fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+6:2411:x1874622863661184:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 22us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779951.520593:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 243 00000100:00100000:0.0:1787779951.520603:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 244 00000100:00100000:0.0:1787779951.520610:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c047785f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+5:2411:x1874622863661440:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1787779951.520631:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c047785f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+5:2411:x1874622863661440:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 22us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779951.520637:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 244 00000100:00080000:0.0:1787779951.520656:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787779951.520659:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787779951.521374:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863661056 00000100:00100000:3.0:1787779951.521380:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863661056 00000100:00100000:3.0:1787779951.521425:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 342 00000100:00100000:3.0:1787779951.521433:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471770450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+13:2411:x1874622863661056:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1787779951.521790:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471770450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+13:2411:x1874622863661056:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 358us (1676us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779951.521795:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 342 00010000:00010000:0.0:1787779951.772153:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787779952.412766:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347ee0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881582848:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787779952.412893:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779952.417136:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881582848 00000100:00100000:0.0:1787779952.417150:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881582848 00000100:00100000:0.0:1787779952.417239:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1787779952.417249:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346d4f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881582848:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787779952.417285:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787779952.417378:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346d4f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881582848:12345-0@lo:41:osp-pre-0-1.0 Request processed in 131us (4486us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779952.417385:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1787779952.418626:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347ee0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881582848:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787779952.798321:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787779952.929098:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787779952.929122:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346d4de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881582976:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787779952.929214:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779952.929355:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881582976 00000100:00100000:3.0:1787779952.929369:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881582976 00000100:00100000:3.0:1787779952.929430:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1787779952.929438:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046efcde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1874622881582976:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787779952.929468:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787779952.929519:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046efcde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1874622881582976:12345-0@lo:41:osp-pre-1-0.0 Request processed in 81us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779952.929525:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1787779952.929563:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346d4de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881582976:0@lo:41:osp-pre-1-0.0 00000001:02000400:0.0:1787779953.612423:0:13529:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 17:32:31 (1787779951) === 00010000:00010000:3.0:1787779953.820991:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787779953.943617:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787779953.943666:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787779953.944043:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863661696 00000100:00100000:1.0:1787779953.944053:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863661696 00000100:00100000:1.0:1787779953.944115:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 22 00000100:00100000:1.0:1787779953.944126:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c047785cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+6:2410:x1874622863661696:12345-192.168.203.31@tcp:41:mkdir.0 00000004:00000024:1.0:1787779953.944161:0:6512:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1787779953.944244:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c047785cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+6:2410:x1874622863661696:12345-192.168.203.31@tcp:41:mkdir.0 Request processed in 121us (638us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779953.944253:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 22 00000100:00080000:1.0:1787779953.944275:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787779953.944459:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863661824 00000100:00100000:3.0:1787779953.944464:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863661824 00000100:00100000:3.0:1787779953.944501:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 2 00000100:00100000:3.0:1787779953.944508:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c047785c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:781d29bb-23d2-48e3-b16d-c29e52cd5375+6:10534:x1874622863661824:12345-192.168.203.31@tcp:700:mkdir.0 00000100:00100000:3.0:1787779953.944553:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c047785c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:781d29bb-23d2-48e3-b16d-c29e52cd5375+6:10534:x1874622863661824:12345-192.168.203.31@tcp:700:mkdir.0 Request processed in 46us (887us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779953.944560:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 2 00000100:00100000:0.0:1787779953.951786:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787779953.951903:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863662080 00000100:00100000:2.0:1787779953.951928:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863662080 00000100:00100000:2.0:1787779953.952005:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 23 00000100:00100000:2.0:1787779953.952230:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346de12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+6:10534:x1874622863662080:12345-192.168.203.31@tcp:36:mkdir.0 00010000:00010000:2.0:1787779953.952321:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787779953.952423:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6400/0xc8fc0a5179960677 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1cc6 expref: 6 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779953.952442:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c0341cd4500) 00010000:00010000:2.0:1787779953.952489:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787779953.952658:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71a00/0xc8fc0a51799607d5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779953.952682:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71a00/0xc8fc0a51799607d5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779953.952706:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71a00/0xc8fc0a51799607d5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779953.952744:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70a00/0xc8fc0a51799607dc lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779953.952752:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70a00/0xc8fc0a51799607dc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779953.952802:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70a00/0xc8fc0a51799607dc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779953.953516:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dca00/0xc8fc0a51799607e3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779953.953529:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dca00/0xc8fc0a51799607e3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779953.953536:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dca00/0xc8fc0a51799607e3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787779953.953562:0:6514:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007572c6ad reply state 00000000c81e9265 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dca00/0xc8fc0a51799607e3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779953.953574:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dca00/0xc8fc0a51799607e3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779953.953581:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9c04440ffa00) 00010000:00010000:3.0:1787779953.953583:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787779953.953587:0:6514:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1787779953.953591:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1787779953.953599:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71a00/0xc8fc0a51799607d5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779953.953606:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71a00/0xc8fc0a51799607d5 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779953.953613:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71a00/0xc8fc0a51799607d5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779953.953619:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0477a71a00 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:3.0:1787779953.953623:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71a00/0xc8fc0a51799607d5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779953.953630:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71a00/0xc8fc0a51799607d5 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779953.953639:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c0347a50200) 00010000:00010000:3.0:1787779953.953642:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787779953.953645:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71a00/0xc8fc0a51799607d5 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779953.953663:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71a00/0xc8fc0a51799607d5 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787779953.954039:0:6514:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007572c6ad reply state 00000000c81e9265 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70a00/0xc8fc0a51799607dc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779953.954055:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70a00/0xc8fc0a51799607dc lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779953.954061:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9c0347a50100) 00010000:00010000:3.0:1787779953.954064:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787779953.954066:0:6514:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1787779953.954207:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346de12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+7:10534:x1874622863662080:12345-192.168.203.31@tcp:36:mkdir.0 Request processed in 1987us (2427us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1787779953.960672:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 23 00000100:00100000:0.0:1787779953.971781:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787779953.971901:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863662208 00000100:00100000:2.0:1787779953.971911:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863662208 00000100:00100000:2.0:1787779953.971963:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 24 00000100:00100000:2.0:1787779953.971973:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346de2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+7:10535:x1874622863662208:12345-192.168.203.31@tcp:101:chmod.0 00010000:00010000:2.0:1787779953.972003:0:7821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787779953.972040:0:7821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70e00/0xc8fc0a51799607ea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea1d59 expref: -99 pid: 7821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779953.972103:0:7821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70200/0xc8fc0a51799607f1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779953.972117:0:7821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70200/0xc8fc0a51799607f1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779953.972128:0:7821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70200/0xc8fc0a51799607f1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787779953.972172:0:7821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787779953.972176:0:7821:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787779953.972212:0:7821:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70200/0xc8fc0a51799607f1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779953.972236:0:7821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70e00/0xc8fc0a51799607ea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1d59 expref: 9 pid: 7821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779953.972262:0:7821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70200/0xc8fc0a51799607f1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1d59 expref: 8 pid: 7821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779953.972284:0:7821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c0347a50c00) 00010000:00010000:2.0:1787779953.972288:0:7821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787779953.972291:0:7821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0477a70200, rc 0) 00000100:00100000:2.0:1787779953.972350:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346de2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+8:10535:x1874622863662208:12345-192.168.203.31@tcp:101:chmod.0 Request processed in 378us (576us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779953.972911:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 24 00000100:00100000:0.0:1787779953.976977:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787779953.977048:0:12488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863662464 00000100:00100000:2.0:1787779953.977057:0:12488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863662464 00000100:00100000:2.0:1787779953.977110:0:12488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 25 00000100:00100000:2.0:1787779953.977119:0:12488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346de03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:781d29bb-23d2-48e3-b16d-c29e52cd5375+8:10535:x1874622863662464:12345-192.168.203.31@tcp:36:chmod.0 00010000:00010000:2.0:1787779953.977170:0:12488:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787779953.977196:0:12488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70200/0xc8fc0a51799607f1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1d59 expref: 8 pid: 7821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779953.977212:0:12488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c0347a50c00) 00010000:00010000:2.0:1787779953.977220:0:12488:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787779953.977243:0:12488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71a00/0xc8fc0a51799607f8 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779953.977255:0:12488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71a00/0xc8fc0a51799607f8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779953.977264:0:12488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71a00/0xc8fc0a51799607f8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787779953.977449:0:12488:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000076e57a02 reply state 0000000011bb1078 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71a00/0xc8fc0a51799607f8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779953.977472:0:12488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71a00/0xc8fc0a51799607f8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779953.977478:0:12488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c0347a50a00) 00010000:00010000:2.0:1787779953.977480:0:12488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1787779953.977483:0:12488:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1787779953.977490:0:12488:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1787779953.977580:0:12488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346de03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:781d29bb-23d2-48e3-b16d-c29e52cd5375+9:10535:x1874622863662464:12345-192.168.203.31@tcp:36:chmod.0 Request processed in 461us (611us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1787779953.977587:0:12488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 25 00000100:00100000:0.0:1787779954.026491:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787779954.026590:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863662592 00000100:00100000:3.0:1787779954.026600:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863662592 00000100:00100000:3.0:1787779954.026663:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 26 00000100:00100000:3.0:1787779954.026673:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346de2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+9:10536:x1874622863662592:12345-192.168.203.31@tcp:101:chown.0 00010000:00010000:3.0:1787779954.026708:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787779954.026729:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd200/0xc8fc0a51799607ff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea1d60 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779954.026799:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc600/0xc8fc0a5179960806 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779954.026813:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc600/0xc8fc0a5179960806 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779954.026878:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc600/0xc8fc0a5179960806 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787779954.026921:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787779954.026924:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787779954.026964:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc600/0xc8fc0a5179960806 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779954.026988:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd200/0xc8fc0a51799607ff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1d60 expref: 11 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779954.027005:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc600/0xc8fc0a5179960806 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1d60 expref: 10 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779954.027013:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c0347a50a00) 00010000:00010000:3.0:1787779954.027024:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787779954.027028:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c04766dc600, rc 0) 00000100:00100000:3.0:1787779954.027076:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346de2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+10:10536:x1874622863662592:12345-192.168.203.31@tcp:101:chown.0 Request processed in 406us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779954.027084:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 26 00000100:00100000:0.0:1787779954.032579:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787779954.032697:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863662720 00000100:00100000:2.0:1787779954.032707:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863662720 00000100:00100000:2.0:1787779954.032768:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 27 00000100:00100000:2.0:1787779954.032778:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04779403c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+10:10536:x1874622863662720:12345-192.168.203.31@tcp:101:chown.0 00010000:00010000:2.0:1787779954.032799:0:7821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787779954.032820:0:7821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70200/0xc8fc0a517996080d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea1d67 expref: -99 pid: 7821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779954.032917:0:7821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70e00/0xc8fc0a5179960814 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779954.032933:0:7821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70e00/0xc8fc0a5179960814 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779954.032944:0:7821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70e00/0xc8fc0a5179960814 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779954.032955:0:7821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71600/0xc8fc0a517996081b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779954.032979:0:7821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71600/0xc8fc0a517996081b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779954.032987:0:7821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71600/0xc8fc0a517996081b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779954.033069:0:7821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71800/0xc8fc0a5179960822 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779954.033079:0:7821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71800/0xc8fc0a5179960822 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779954.033085:0:7821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71800/0xc8fc0a5179960822 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787779954.033128:0:7821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787779954.033132:0:7821:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787779954.033154:0:7821:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71800/0xc8fc0a5179960822 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779954.033165:0:7821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70e00/0xc8fc0a5179960814 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779954.033172:0:7821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70e00/0xc8fc0a5179960814 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779954.033178:0:7821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70e00/0xc8fc0a5179960814 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779954.033184:0:7821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0477a70e00 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:2.0:1787779954.033188:0:7821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70e00/0xc8fc0a5179960814 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779954.033202:0:7821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70e00/0xc8fc0a5179960814 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779954.033213:0:7821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c0347a50a00) 00010000:00010000:2.0:1787779954.033216:0:7821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787779954.033220:0:7821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70e00/0xc8fc0a5179960814 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779954.033226:0:7821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70e00/0xc8fc0a5179960814 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779954.033237:0:7821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71600/0xc8fc0a517996081b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779954.033242:0:7821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71600/0xc8fc0a517996081b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779954.033247:0:7821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71600/0xc8fc0a517996081b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779954.033252:0:7821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0477a71600 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:2.0:1787779954.033255:0:7821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71600/0xc8fc0a517996081b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779954.033260:0:7821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71600/0xc8fc0a517996081b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779954.033266:0:7821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9c0347a50100) 00010000:00010000:2.0:1787779954.033269:0:7821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787779954.033271:0:7821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71600/0xc8fc0a517996081b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779954.033286:0:7821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71600/0xc8fc0a517996081b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779954.033313:0:7821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70200/0xc8fc0a517996080d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1d67 expref: 12 pid: 7821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779954.033326:0:7821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71800/0xc8fc0a5179960822 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1d67 expref: 11 pid: 7821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779954.033333:0:7821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9c04440ffa00) 00010000:00010000:2.0:1787779954.033336:0:7821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787779954.033338:0:7821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0477a71800, rc 0) 00000100:00100000:2.0:1787779954.033402:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04779403c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+11:10536:x1874622863662720:12345-192.168.203.31@tcp:101:chown.0 Request processed in 625us (832us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779954.033410:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 27 00000100:00100000:0.0:1787779954.038102:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787779954.038198:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863662848 00000100:00100000:3.0:1787779954.038208:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863662848 00000100:00100000:3.0:1787779954.038268:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 6 00000100:00100000:3.0:1787779954.038278:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477942940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:781d29bb-23d2-48e3-b16d-c29e52cd5375+11:10536:x1874622863662848:12345-192.168.203.31@tcp:900:chown.0 00000100:00100000:3.0:1787779954.038372:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477942940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:781d29bb-23d2-48e3-b16d-c29e52cd5375+11:10536:x1874622863662848:12345-192.168.203.31@tcp:900:chown.0 Request processed in 94us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779954.038380:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 6 00000100:00100000:0.0:1787779954.042486:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787779954.042590:0:12488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863663104 00000100:00100000:2.0:1787779954.042600:0:12488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863663104 00000100:00100000:2.0:1787779954.042664:0:12488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 28 00000100:00100000:2.0:1787779954.042674:0:12488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477af1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:781d29bb-23d2-48e3-b16d-c29e52cd5375+11:10536:x1874622863663104:12345-192.168.203.31@tcp:36:chown.0 00010000:00010000:2.0:1787779954.042727:0:12488:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787779954.042754:0:12488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71800/0xc8fc0a5179960822 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1d67 expref: 11 pid: 7821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779954.042773:0:12488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9c04440ffa00) 00010000:00010000:2.0:1787779954.042778:0:12488:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787779954.042801:0:12488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70200/0xc8fc0a5179960829 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779954.042828:0:12488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70200/0xc8fc0a5179960829 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779954.042893:0:12488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70200/0xc8fc0a5179960829 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787779954.045663:0:6491:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967301 is committed 00000004:00010000:2.0:1787779954.045759:0:12488:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000099575972 reply state 000000009c1fc89f transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70200/0xc8fc0a5179960829 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779954.045780:0:12488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70200/0xc8fc0a5179960829 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779954.045789:0:12488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9c04440ffa00) 00010000:00010000:2.0:1787779954.045792:0:12488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1787779954.045797:0:12488:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1787779954.045809:0:12488:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00080000:2.0:1787779954.045918:0:12488:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1787779954.045942:0:12488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477af1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:781d29bb-23d2-48e3-b16d-c29e52cd5375+9:10536:x1874622863663104:12345-192.168.203.31@tcp:36:chown.0 Request processed in 3265us (3463us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1787779954.045956:0:12488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 28 00010000:00010000:1.0:1787779954.046213:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70a00/0xc8fc0a51799607dc lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779954.046225:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70a00/0xc8fc0a51799607dc lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779954.046232:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70a00/0xc8fc0a51799607dc lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779954.046239:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0477a70a00 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:1.0:1787779954.046243:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70a00/0xc8fc0a51799607dc lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779954.046250:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70a00/0xc8fc0a51799607dc lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779954.046267:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9c0347a50100) 00010000:00010000:1.0:1787779954.046289:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787779954.046295:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70a00/0xc8fc0a51799607dc lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779954.046301:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70a00/0xc8fc0a51799607dc lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779954.046322:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dca00/0xc8fc0a51799607e3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779954.046329:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dca00/0xc8fc0a51799607e3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779954.046334:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dca00/0xc8fc0a51799607e3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779954.046339:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c04766dca00 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:1.0:1787779954.046341:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dca00/0xc8fc0a51799607e3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779954.046346:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dca00/0xc8fc0a51799607e3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779954.046354:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9c04440ffa00) 00010000:00010000:1.0:1787779954.046357:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787779954.046359:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dca00/0xc8fc0a51799607e3 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779954.046364:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dca00/0xc8fc0a51799607e3 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779954.046382:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70200/0xc8fc0a5179960829 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779954.046392:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70200/0xc8fc0a5179960829 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779954.046398:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70200/0xc8fc0a5179960829 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779954.046403:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0477a70200 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:3.0:1787779954.046407:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70200/0xc8fc0a5179960829 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779954.046413:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70200/0xc8fc0a5179960829 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779954.046423:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9c04440ffa00) 00010000:00010000:3.0:1787779954.046426:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787779954.046428:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70200/0xc8fc0a5179960829 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779954.046434:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70200/0xc8fc0a5179960829 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779954.046502:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71a00/0xc8fc0a51799607f8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779954.046518:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71a00/0xc8fc0a51799607f8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779954.046524:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71a00/0xc8fc0a51799607f8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779954.046529:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0477a71a00 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:1.0:1787779954.046533:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71a00/0xc8fc0a51799607f8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779954.046540:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71a00/0xc8fc0a51799607f8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779954.046549:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c0347a50a00) 00010000:00010000:1.0:1787779954.046551:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787779954.046554:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71a00/0xc8fc0a51799607f8 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779954.046560:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71a00/0xc8fc0a51799607f8 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779954.090028:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787779954.091354:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863663232 00000100:00100000:1.0:1787779954.091367:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863663232 00000100:00100000:1.0:1787779954.091495:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 29 00000100:00100000:1.0:1787779954.091507:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346efcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+6:10537:x1874622863663232:12345-192.168.203.31@tcp:101:touch.500 00010000:00010000:1.0:1787779954.091530:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787779954.091553:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6e00/0xc8fc0a5179960830 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea1d6e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787779954.093520:0:6512:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 1894us 00010000:00010000:1.0:1787779954.125219:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6a00/0xc8fc0a5179960837 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779954.125242:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6a00/0xc8fc0a5179960837 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779954.125693:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6a00/0xc8fc0a5179960837 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779954.132726:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd200/0xc8fc0a517996083e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779954.132825:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd200/0xc8fc0a517996083e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779954.132982:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd200/0xc8fc0a517996083e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779954.133132:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a5179960845 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779954.133141:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a5179960845 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779954.133149:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a5179960845 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787779954.133179:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787779954.133183:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787779954.133224:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a5179960845 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779954.133237:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6a00/0xc8fc0a5179960837 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779954.133244:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6a00/0xc8fc0a5179960837 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779954.133322:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6a00/0xc8fc0a5179960837 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779954.133328:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0346dd6a00 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:3.0:1787779954.133333:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6a00/0xc8fc0a5179960837 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779954.133340:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6a00/0xc8fc0a5179960837 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779954.133352:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c0347a50a00) 00010000:00010000:3.0:1787779954.133423:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787779954.133430:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6a00/0xc8fc0a5179960837 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779954.133437:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6a00/0xc8fc0a5179960837 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779954.133452:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd200/0xc8fc0a517996083e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779954.133458:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd200/0xc8fc0a517996083e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779954.133464:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd200/0xc8fc0a517996083e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779954.133469:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c04766dd200 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:3.0:1787779954.133472:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd200/0xc8fc0a517996083e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779954.133479:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd200/0xc8fc0a517996083e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779954.133487:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9c04440ff700) 00010000:00010000:3.0:1787779954.133489:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787779954.133492:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd200/0xc8fc0a517996083e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779954.133497:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd200/0xc8fc0a517996083e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779954.133620:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6e00/0xc8fc0a5179960830 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1d6e expref: 8 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779954.133651:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a5179960845 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1d6e expref: 7 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779954.133657:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9c04440ff100) 00010000:00010000:3.0:1787779954.133660:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787779954.133662:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c04766dc400, rc 0) 00000100:00100000:3.0:1787779954.133780:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346efcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+7:10537:x1874622863663232:12345-192.168.203.31@tcp:101:touch.500 Request processed in 42274us (43770us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779954.133790:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 29 00000100:00100000:0.0:1787779954.154152:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787779954.155317:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863663488 00000100:00100000:3.0:1787779954.155328:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863663488 00000100:00100000:3.0:1787779954.155398:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 30 00000100:00100000:3.0:1787779954.155408:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c047796f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+7:10537:x1874622863663488:12345-192.168.203.31@tcp:101:touch.500 00010000:00010000:3.0:1787779954.155427:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787779954.155446:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd200/0xc8fc0a517996084c lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea1d75 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779954.155545:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dca00/0xc8fc0a5179960853 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779954.155559:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dca00/0xc8fc0a5179960853 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779954.155569:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dca00/0xc8fc0a5179960853 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779954.155582:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766ddc00/0xc8fc0a517996085a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0xd2a6d7e3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779954.155604:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766ddc00/0xc8fc0a517996085a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xd2a6d7e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779954.155612:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766ddc00/0xc8fc0a517996085a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xd2a6d7e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787779954.155997:0:6513:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2:0x0], index 1: 0 00010000:00010000:3.0:1787779954.156142:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04427dbc00/0xc8fc0a5179960861 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779954.156151:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c04427dbc00/0xc8fc0a5179960861 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779954.156159:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c04427dbc00/0xc8fc0a5179960861 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779954.156188:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dca00/0xc8fc0a5179960853 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779954.156195:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dca00/0xc8fc0a5179960853 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779954.156201:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dca00/0xc8fc0a5179960853 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779954.156206:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c04766dca00 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:3.0:1787779954.156210:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dca00/0xc8fc0a5179960853 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779954.156217:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dca00/0xc8fc0a5179960853 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779954.156242:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9c04440ff100) 00010000:00010000:3.0:1787779954.156244:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787779954.156249:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dca00/0xc8fc0a5179960853 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779954.156255:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dca00/0xc8fc0a5179960853 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787779954.156268:0:6513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000093729e20 reply state 00000000bd5f1722 transno 4294967302 ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766ddc00/0xc8fc0a517996085a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xd2a6d7e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779954.156278:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766ddc00/0xc8fc0a517996085a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xd2a6d7e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779954.156284:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xd2a6d7e3 (ffff9c04440ff700) 00010000:00010000:3.0:1787779954.156286:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787779954.156289:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787779954.156316:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd200/0xc8fc0a517996084c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1d75 expref: 10 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779954.156330:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04427dbc00/0xc8fc0a5179960861 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1d75 expref: 9 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779954.156337:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9c04440ffb00) 00010000:00010000:3.0:1787779954.156339:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787779954.156342:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c04427dbc00, rc 0) 00000100:00100000:3.0:1787779954.156416:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c047796f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+10:10537:x1874622863663488:12345-192.168.203.31@tcp:101:touch.500 Request processed in 1008us (2272us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1787779954.156424:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 30 00000100:00100000:0.0:1787779954.159810:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787779954.159960:0:12488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863663744 00000100:00100000:1.0:1787779954.159969:0:12488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863663744 00000100:00100000:1.0:1787779954.160033:0:12488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 31 00000100:00100000:1.0:1787779954.160043:0:12488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c047796cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:781d29bb-23d2-48e3-b16d-c29e52cd5375+10:10537:x1874622863663744:12345-192.168.203.31@tcp:36:touch.500 00010000:00010000:1.0:1787779954.160102:0:12488:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787779954.160129:0:12488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04427dbc00/0xc8fc0a5179960861 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1d75 expref: 10 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779954.160146:0:12488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9c04440ffb00) 00010000:00010000:1.0:1787779954.160155:0:12488:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787779954.160210:0:12488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6600/0xc8fc0a517996086f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779954.160222:0:12488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6600/0xc8fc0a517996086f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779954.160232:0:12488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6600/0xc8fc0a517996086f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787779954.160341:0:12488:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a0a6d55b reply state 00000000d431fce9 transno 4294967303 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6600/0xc8fc0a517996086f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779954.160376:0:12488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6600/0xc8fc0a517996086f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779954.160383:0:12488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9c0341cd4800) 00010000:00010000:1.0:1787779954.160385:0:12488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787779954.160388:0:12488:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787779954.160475:0:12488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c047796cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:781d29bb-23d2-48e3-b16d-c29e52cd5375+11:10537:x1874622863663744:12345-192.168.203.31@tcp:36:touch.500 Request processed in 433us (674us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1787779954.160484:0:12488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 31 00000100:00100000:1.0:1787779954.163831:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787779954.164152:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863663872 00000100:00100000:3.0:1787779954.164169:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863663872 00000100:00100000:3.0:1787779954.164231:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 32 00000100:00100000:3.0:1787779954.164240:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046efcc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+11:10537:x1874622863663872:12345-192.168.203.31@tcp:101:touch.500 00010000:00010000:3.0:1787779954.164273:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787779954.164294:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0440031e00/0xc8fc0a5179960876 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea1d7c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779954.164347:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0440031e00/0xc8fc0a5179960876 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1d7c expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779954.164361:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0440031e00/0xc8fc0a5179960876 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1d7c expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779954.164390:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9c0341cd4800) 00010000:00010000:3.0:1787779954.164393:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787779954.164396:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0440031e00, rc 0) 00000100:00100000:3.0:1787779954.164453:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046efcc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+12:10537:x1874622863663872:12345-192.168.203.31@tcp:101:touch.500 Request processed in 214us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779954.164461:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 32 00000100:00100000:0.0:1787779954.172217:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787779954.172700:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863664000 00000100:00100000:2.0:1787779954.172710:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863664000 00000100:00100000:2.0:1787779954.172747:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 24 00000100:00100000:2.0:1787779954.172767:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0345e76d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2407:x1874622863664000:12345-192.168.203.31@tcp:8:touch.500 00010000:00080000:2.0:1787779954.172803:0:8428:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 781d29bb-23d2-48e3-b16d-c29e52cd5375@192.168.203.31@tcp t0 exp 0000000000000000 cur 362 last 0 00000020:00000080:2.0:1787779954.172835:0:8428:0:(genops.c:1385:class_connect()) connect: client 781d29bb-23d2-48e3-b16d-c29e52cd5375, cookie 0xc8fc0a517996087d 00002000:00100000:2.0:1787779954.172864:0:8428:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 781d29bb-23d2-48e3-b16d-c29e52cd5375/ffff9c0347d28800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113939 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787779954.172881:0:8428:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787779954.172965:0:8428:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787779954.172995:0:8428:0:(import.c:65:import_set_state_nolock()) ffff9c0347d2d800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787779954.173072:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0345e76d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+6:2407:x1874622863664000:12345-192.168.203.31@tcp:8:touch.500 Request processed in 305us (864us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779954.173081:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 24 00000100:00100000:0.0:1787779954.176442:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787779954.176943:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863664128 00000100:00100000:3.0:1787779954.176953:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863664128 00000100:00080000:0.0:1787779954.177026:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787779954.177042:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 25 00000100:00100000:3.0:1787779954.177054:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0345e75e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+6:0:x1874622863664128:12345-192.168.203.31@tcp:2:touch.500 00000001:00080000:2.0:1787779954.191624:0:9508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000001:00100000:2.0:1787779954.191638:0:9508:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 781d29bb-23d2-48e3-b16d-c29e52cd5375 00000100:00100000:3.0:1787779954.191878:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0345e75e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:0:x1874622863664128:12345-192.168.203.31@tcp:2:touch.500 Request processed in 14780us (15399us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1787779954.191890:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 25 00000100:00100000:1.0:1787779954.194443:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787779954.194583:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863664384 00000100:00100000:0.0:1787779954.194593:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863664384 00000100:00100000:0.0:1787779954.194649:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 2 00000100:00100000:0.0:1787779954.194674:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0461beed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+12:10537:x1874622863664384:12345-192.168.203.31@tcp:35:touch.500 00000100:00100000:0.0:1787779954.194987:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0461beed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+13:10537:x1874622863664384:12345-192.168.203.31@tcp:35:touch.500 Request processed in 315us (551us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1787779954.194995:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 2 00000100:00100000:1.0:1787779954.211498:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787779954.215160:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863664512 00000100:00100000:0.0:1787779954.215173:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863664512 00000100:00100000:0.0:1787779954.215247:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 33 00000100:00100000:0.0:1787779954.215265:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346daf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+13:10538:x1874622863664512:12345-192.168.203.31@tcp:101:rm.0 00010000:00010000:0.0:1787779954.215292:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787779954.215315:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868000/0xc8fc0a5179960884 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea1d83 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779954.215379:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869800/0xc8fc0a517996088b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779954.215392:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869800/0xc8fc0a517996088b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779954.215405:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869800/0xc8fc0a517996088b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787779954.215451:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787779954.215455:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787779954.215491:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869800/0xc8fc0a517996088b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779954.215519:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868000/0xc8fc0a5179960884 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1d83 expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779954.215561:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869800/0xc8fc0a517996088b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1d83 expref: 14 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779954.215570:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9c04440ff100) 00010000:00010000:0.0:1787779954.215573:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787779954.215576:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0477869800, rc 0) 00000100:00100000:0.0:1787779954.215652:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346daf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+14:10538:x1874622863664512:12345-192.168.203.31@tcp:101:rm.0 Request processed in 396us (4163us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779954.215659:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 33 00000100:00100000:3.0:1787779954.219060:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787779954.219148:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863664768 00000100:00100000:2.0:1787779954.219157:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863664768 00000100:00100000:2.0:1787779954.219213:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 34 00000100:00100000:2.0:1787779954.219223:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346d4de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+14:10538:x1874622863664768:12345-192.168.203.31@tcp:101:rm.0 00010000:00010000:2.0:1787779954.219242:0:7821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787779954.219271:0:7821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71600/0xc8fc0a5179960892 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea1d8a expref: -99 pid: 7821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787779954.219364:0:7821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1787779954.219511:0:7821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71600/0xc8fc0a5179960892 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1d8a expref: 16 pid: 7821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779954.219525:0:7821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c0347a50a00) 00010000:00010000:2.0:1787779954.219529:0:7821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787779954.219533:0:7821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71600/0xc8fc0a5179960892 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1d8a expref: 16 pid: 7821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779954.219546:0:7821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0477a71600, rc 0) 00000100:00100000:2.0:1787779954.219607:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346d4de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+15:10538:x1874622863664768:12345-192.168.203.31@tcp:101:rm.0 Request processed in 387us (561us total) trans 4294967305 rc 301/301 00000100:00100000:2.0:1787779954.219615:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 34 00000100:00100000:2.0:1787779954.223797:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787779954.223891:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863664896 00000100:00100000:0.0:1787779954.223899:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863664896 00000100:00100000:0.0:1787779954.223941:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 3 00000100:00100000:0.0:1787779954.223950:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347ee0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+15:10538:x1874622863664896:12345-192.168.203.31@tcp:37:rm.0 00000100:00100000:0.0:1787779954.232987:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347ee0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+15:10538:x1874622863664896:12345-192.168.203.31@tcp:37:rm.0 Request processed in 9027us (9188us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779954.233001:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 3 00000100:00100000:3.0:1787779954.238410:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787779954.238550:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863665152 00000100:00100000:1.0:1787779954.238559:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863665152 00000100:00100000:1.0:1787779954.238612:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 4 00000100:00100000:1.0:1787779954.238622:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c044361a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+15:10538:x1874622863665152:12345-192.168.203.31@tcp:35:rm.0 00000100:00100000:1.0:1787779954.238875:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c044361a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+16:10538:x1874622863665152:12345-192.168.203.31@tcp:35:rm.0 Request processed in 253us (473us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1787779954.238883:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 4 00000100:00100000:2.0:1787779954.247478:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787779954.247575:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863665408 00000100:00100000:1.0:1787779954.247585:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863665408 00000100:00100000:1.0:1787779954.247647:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 35 00000100:00100000:1.0:1787779954.247657:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347ee2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+16:10538:x1874622863665408:12345-192.168.203.31@tcp:101:rm.0 00010000:00010000:1.0:1787779954.247681:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787779954.247701:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6a00/0xc8fc0a51799608a0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea1d91 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779954.247821:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6400/0xc8fc0a51799608a7 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779954.247836:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6400/0xc8fc0a51799608a7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779954.247884:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6400/0xc8fc0a51799608a7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787779954.247895:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1787779954.248040:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6a00/0xc8fc0a51799608a0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1d91 expref: 19 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779954.248059:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6400/0xc8fc0a51799608a7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1d91 expref: 18 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779954.248068:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9c04440ff100) 00010000:00010000:1.0:1787779954.248071:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787779954.248075:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0346dd6400, rc 0) 00000100:00100000:1.0:1787779954.248130:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347ee2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+18:10538:x1874622863665408:12345-192.168.203.31@tcp:101:rm.0 Request processed in 475us (662us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1787779954.248138:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 35 00000100:00100000:2.0:1787779954.251196:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787779954.251472:0:12488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863665536 00000100:00100000:1.0:1787779954.251480:0:12488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863665536 00000100:00100000:1.0:1787779954.251533:0:12488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 36 00000100:00100000:1.0:1787779954.251542:0:12488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347ee0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:781d29bb-23d2-48e3-b16d-c29e52cd5375+18:10538:x1874622863665536:12345-192.168.203.31@tcp:41:rm.0 00000004:00000024:1.0:1787779954.251593:0:12488:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 7847059456 avail 7384014848 00000100:00100000:1.0:1787779954.253041:0:12488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347ee0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:781d29bb-23d2-48e3-b16d-c29e52cd5375+18:10538:x1874622863665536:12345-192.168.203.31@tcp:41:rm.0 Request processed in 1491us (1845us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779954.253063:0:12488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 36 00000100:00100000:3.0:1787779954.274237:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787779954.274471:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863665664 00000100:00100000:0.0:1787779954.274480:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863665664 00000100:00100000:0.0:1787779954.274543:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 37 00000100:00100000:0.0:1787779954.274553:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346d4ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+18:10538:x1874622863665664:12345-192.168.203.31@tcp:101:rm.0 00010000:00010000:0.0:1787779954.274572:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787779954.274594:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868000/0xc8fc0a51799608b5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea1d98 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779954.274653:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869600/0xc8fc0a51799608bc lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779954.274680:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869600/0xc8fc0a51799608bc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779954.274691:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869600/0xc8fc0a51799608bc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779954.274701:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868a00/0xc8fc0a51799608c3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0xd2a6d7e3 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779954.274708:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868a00/0xc8fc0a51799608c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd2a6d7e3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779954.274724:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868a00/0xc8fc0a51799608c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd2a6d7e3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779954.274803:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869c00/0xc8fc0a51799608ca lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779954.274811:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869c00/0xc8fc0a51799608ca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779954.274819:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869c00/0xc8fc0a51799608ca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787779954.274890:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2:0x0]: returning size 0 00000004:00200000:0.0:1787779954.274895:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787779954.274924:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869c00/0xc8fc0a51799608ca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779954.274943:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869c00/0xc8fc0a51799608ca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779954.274962:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869600/0xc8fc0a51799608bc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779954.274968:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869600/0xc8fc0a51799608bc lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779954.274975:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869600/0xc8fc0a51799608bc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779954.274981:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0477869600 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:0.0:1787779954.274985:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869600/0xc8fc0a51799608bc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779954.274991:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869600/0xc8fc0a51799608bc lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779954.275003:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9c04440ff100) 00010000:00010000:0.0:1787779954.275006:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787779954.275011:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869600/0xc8fc0a51799608bc lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779954.275027:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869600/0xc8fc0a51799608bc lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779954.275040:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868a00/0xc8fc0a51799608c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd2a6d7e3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779954.275046:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868a00/0xc8fc0a51799608c3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd2a6d7e3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779954.275052:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868a00/0xc8fc0a51799608c3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd2a6d7e3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779954.275063:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0477868a00 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:0.0:1787779954.275067:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868a00/0xc8fc0a51799608c3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd2a6d7e3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779954.275073:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868a00/0xc8fc0a51799608c3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd2a6d7e3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779954.275081:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xd2a6d7e3 (ffff9c04440ff700) 00010000:00010000:0.0:1787779954.275083:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787779954.275086:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868a00/0xc8fc0a51799608c3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xd2a6d7e3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779954.275093:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868a00/0xc8fc0a51799608c3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xd2a6d7e3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779954.275117:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868000/0xc8fc0a51799608b5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1d98 expref: 20 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779954.275130:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869c00/0xc8fc0a51799608ca lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1d98 expref: 19 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779954.275137:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9c0341cd4800) 00010000:00010000:0.0:1787779954.275140:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787779954.275142:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0477869c00, rc 0) 00000100:00100000:0.0:1787779954.275195:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346d4ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+19:10538:x1874622863665664:12345-192.168.203.31@tcp:101:rm.0 Request processed in 643us (965us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779954.275202:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 37 00000100:00100000:3.0:1787779954.283677:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787779954.283834:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863665920 00000100:00100000:0.0:1787779954.283901:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863665920 00000100:00100000:0.0:1787779954.283969:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 38 00000100:00100000:0.0:1787779954.283979:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347a843c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+19:10538:x1874622863665920:12345-192.168.203.31@tcp:36:rm.0 00010000:00010000:0.0:1787779954.284038:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787779954.284063:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869c00/0xc8fc0a51799608ca lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1d98 expref: 19 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779954.284083:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0440031e00/0xc8fc0a5179960876 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1d7c expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779954.284094:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9c0341cd4800) 00010000:00010000:0.0:1787779954.284104:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869800/0xc8fc0a517996088b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1d83 expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779954.284111:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9c04440ff100) 00010000:00010000:0.0:1787779954.284114:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787779954.284134:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868c00/0xc8fc0a51799608d1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779954.284147:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868c00/0xc8fc0a51799608d1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779954.284156:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868c00/0xc8fc0a51799608d1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779954.284165:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868800/0xc8fc0a51799608d8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0xd2a6d7e3 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779954.284171:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868800/0xc8fc0a51799608d8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xd2a6d7e3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779954.284188:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868800/0xc8fc0a51799608d8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xd2a6d7e3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779954.284295:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869200/0xc8fc0a51799608df lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779954.284303:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869200/0xc8fc0a51799608df lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779954.284310:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869200/0xc8fc0a51799608df lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787779954.284495:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:0.0:1787779954.284504:0:6514:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 362288664184ns, next at 363288662171ns, rc = 0 00010000:00010000:0.0:1787779954.284545:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868400/0xc8fc0a51799608e6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779954.284553:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868400/0xc8fc0a51799608e6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779954.284560:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868400/0xc8fc0a51799608e6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779954.284566:0:6514:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868400/0xc8fc0a51799608e6 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779954.284572:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868400/0xc8fc0a51799608e6 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779954.284577:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868400/0xc8fc0a51799608e6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779954.284601:0:6514:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787779954.284617:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869200/0xc8fc0a51799608df lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779954.284623:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869200/0xc8fc0a51799608df lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779954.284629:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869200/0xc8fc0a51799608df lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779954.284634:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0477869200 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:0.0:1787779954.284638:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869200/0xc8fc0a51799608df lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779954.284645:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869200/0xc8fc0a51799608df lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779954.284653:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9c0341cd4800) 00010000:00010000:0.0:1787779954.284656:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787779954.284659:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869200/0xc8fc0a51799608df lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779954.284666:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869200/0xc8fc0a51799608df lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779954.284680:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868c00/0xc8fc0a51799608d1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779954.284688:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868c00/0xc8fc0a51799608d1 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779954.284693:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868c00/0xc8fc0a51799608d1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779954.284704:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0477868c00 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:0.0:1787779954.284707:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868c00/0xc8fc0a51799608d1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779954.284726:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868c00/0xc8fc0a51799608d1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779954.284734:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9c04440ff100) 00010000:00010000:0.0:1787779954.284737:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787779954.284740:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868c00/0xc8fc0a51799608d1 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779954.284745:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868c00/0xc8fc0a51799608d1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787779954.284754:0:6514:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fdd4a642 reply state 000000009add55a2 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868800/0xc8fc0a51799608d8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xd2a6d7e3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779954.284764:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868800/0xc8fc0a51799608d8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xd2a6d7e3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779954.284769:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xd2a6d7e3 (ffff9c04440ff700) 00010000:00010000:0.0:1787779954.284771:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787779954.284774:0:6514:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787779954.284866:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347a843c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+18:10538:x1874622863665920:12345-192.168.203.31@tcp:36:rm.0 Request processed in 888us (1197us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1787779954.284873:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 38 00010000:00010000:1.0:1787779954.285246:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787779954.285253:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868400/0xc8fc0a51799608e6 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779954.285260:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0477868400 already unused, calling callback (ffffffffc0d97420) 00010000:00010000:1.0:1787779954.285263:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868400/0xc8fc0a51799608e6 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779954.285270:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868400/0xc8fc0a51799608e6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779954.285280:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9c0341cd4800) 00010000:00010000:1.0:1787779954.285282:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787779954.285286:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868400/0xc8fc0a51799608e6 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779954.285291:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868400/0xc8fc0a51799608e6 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779954.285301:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787779954.285303:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787779954.285305:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787779954.296854:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787779954.297046:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863666176 00000100:00100000:3.0:1787779954.297065:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863666176 00000100:00100000:3.0:1787779954.297125:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 5 00000100:00100000:3.0:1787779954.297135:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347ee0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+18:10538:x1874622863666176:12345-192.168.203.31@tcp:35:rm.0 00000100:00100000:3.0:1787779954.297358:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347ee0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+19:10538:x1874622863666176:12345-192.168.203.31@tcp:35:rm.0 Request processed in 224us (531us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1787779954.297366:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 5 00000100:00100000:3.0:1787779954.303066:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787779954.303123:0:12488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863666432 00000100:00100000:1.0:1787779954.303133:0:12488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863666432 00000100:00100000:1.0:1787779954.303196:0:12488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 39 00000100:00100000:1.0:1787779954.303206:0:12488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347a86580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:781d29bb-23d2-48e3-b16d-c29e52cd5375+19:10538:x1874622863666432:12345-192.168.203.31@tcp:36:rm.0 00010000:00010000:1.0:1787779954.303262:0:12488:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1787779954.303300:0:12488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6400/0xc8fc0a51799608a7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1d91 expref: 19 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779954.303321:0:12488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a5179960845 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1d6e expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779954.303332:0:12488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9c04440ff100) 00010000:00010000:1.0:1787779954.303346:0:12488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc600/0xc8fc0a5179960806 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1d60 expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779954.303355:0:12488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c0347a50a00) 00010000:00010000:1.0:1787779954.303360:0:12488:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787779954.303394:0:12488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6a00/0xc8fc0a51799608ed lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779954.303406:0:12488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6a00/0xc8fc0a51799608ed lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779954.303417:0:12488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6a00/0xc8fc0a51799608ed lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779954.303428:0:12488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6200/0xc8fc0a51799608f4 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779954.303435:0:12488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6200/0xc8fc0a51799608f4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779954.303441:0:12488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6200/0xc8fc0a51799608f4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779954.303522:0:12488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd7a00/0xc8fc0a51799608fb lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779954.303536:0:12488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd7a00/0xc8fc0a51799608fb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779954.303543:0:12488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd7a00/0xc8fc0a51799608fb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787779954.303754:0:12488:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1787779954.303772:0:12488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd7a00/0xc8fc0a51799608fb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779954.303779:0:12488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd7a00/0xc8fc0a51799608fb lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779954.303784:0:12488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd7a00/0xc8fc0a51799608fb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779954.303790:0:12488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0346dd7a00 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:1.0:1787779954.303794:0:12488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd7a00/0xc8fc0a51799608fb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779954.303801:0:12488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd7a00/0xc8fc0a51799608fb lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779954.303809:0:12488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9c0341cd4c00) 00010000:00010000:1.0:1787779954.303812:0:12488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787779954.303815:0:12488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd7a00/0xc8fc0a51799608fb lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779954.303821:0:12488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd7a00/0xc8fc0a51799608fb lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779954.303862:0:12488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6a00/0xc8fc0a51799608ed lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779954.303875:0:12488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6a00/0xc8fc0a51799608ed lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779954.303881:0:12488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6a00/0xc8fc0a51799608ed lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779954.303887:0:12488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0346dd6a00 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:1.0:1787779954.303890:0:12488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6a00/0xc8fc0a51799608ed lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779954.303896:0:12488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6a00/0xc8fc0a51799608ed lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779954.303904:0:12488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c0341cd4f00) 00010000:00010000:1.0:1787779954.303907:0:12488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787779954.303920:0:12488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6a00/0xc8fc0a51799608ed lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779954.303927:0:12488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6a00/0xc8fc0a51799608ed lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787779954.304765:0:12488:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000034831c5a reply state 0000000086b81d18 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6200/0xc8fc0a51799608f4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779954.304782:0:12488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6200/0xc8fc0a51799608f4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779954.304790:0:12488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9c0341cd4400) 00010000:00010000:1.0:1787779954.304792:0:12488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787779954.304795:0:12488:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787779954.304905:0:12488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347a86580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:781d29bb-23d2-48e3-b16d-c29e52cd5375+18:10538:x1874622863666432:12345-192.168.203.31@tcp:36:rm.0 Request processed in 1699us (2622us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1787779954.305171:0:12488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 39 00010000:00010000:0.0:1787779954.844594:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787779954.972566:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346cff840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1874622881583232:0@lo:400:kworker.0 00000100:00100000:3.0:1787779954.972627:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779954.972674:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346cff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1874622881583744:0@lo:400:kworker.0 00000100:00100000:3.0:1787779954.972692:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779954.972710:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c046215c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1874622881584256:0@lo:400:kworker.0 00000100:00100000:3.0:1787779954.972729:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779954.972750:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1787779954.972755:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346cfed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881583360:0@lo:400:kworker.0 00000100:00100000:3.0:1787779954.972779:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779954.972796:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c046215d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1874622881583872:0@lo:400:kworker.0 00000100:00100000:3.0:1787779954.972815:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779954.972832:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346da4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1874622881584384:0@lo:400:kworker.0 00000100:00100000:3.0:1787779954.972870:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779954.972922:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881583360 00000100:00100000:3.0:1787779954.972929:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881583360 00000100:00100000:3.0:1787779954.972968:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1787779954.972976:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346da7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881583360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779954.973038:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346da7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881583360:12345-0@lo:400:kworker.0 Request processed in 62us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779954.973044:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1787779954.973077:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346cfed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881583360:0@lo:400:kworker.0 00000100:00100000:3.0:1787779954.973099:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881583232 00000100:00100000:3.0:1787779954.973102:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881583232 00000100:00100000:3.0:1787779954.973119:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881583744 00000100:00100000:3.0:1787779954.973121:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881583744 00000100:00100000:3.0:1787779954.973138:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881584256 00000100:00100000:3.0:1787779954.973140:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881584256 00000100:00100000:3.0:1787779954.973149:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881583872 00000100:00100000:3.0:1787779954.973151:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881583872 00000100:00100000:2.0:1787779954.973254:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346cfe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874622881583488:0@lo:400:kworker.0 00000100:00100000:2.0:1787779954.973285:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779954.973296:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c046215fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881584000:0@lo:400:kworker.0 00000100:00100000:2.0:1787779954.973314:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779954.973329:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346da4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881584512:0@lo:400:kworker.0 00000100:00100000:2.0:1787779954.973344:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779954.973357:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:2.0:1787779954.973362:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347a87c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1f575176-36bc-4786-83ee-2fea064a12a9:3641:1874622881583104:0@lo:400:kworker.0 00000100:00100000:2.0:1787779954.973384:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779954.973405:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346cfda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881583616:0@lo:400:kworker.0 00000100:00100000:2.0:1787779954.973424:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779954.973439:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c046215e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881584128:0@lo:400:kworker.0 00000100:00100000:2.0:1787779954.973460:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779954.973477:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346da6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881584640:0@lo:400:kworker.0 00000100:00100000:2.0:1787779954.973495:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779954.973522:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881583104 00000100:00100000:2.0:1787779954.973526:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881583104 00000100:00100000:2.0:1787779954.973554:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:2.0:1787779954.973561:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471771450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+24:3641:x1874622881583104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779954.973593:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471771450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+24:3641:x1874622881583104:12345-0@lo:400:kworker.0 Request processed in 33us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779954.973610:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:2.0:1787779954.973639:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881584000 00000100:00100000:2.0:1787779954.973642:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881584000 00000100:00100000:2.0:1787779954.973660:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881584512 00000100:00100000:2.0:1787779954.973662:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881584512 00000100:00100000:2.0:1787779954.973675:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881584128 00000100:00100000:2.0:1787779954.973677:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881584128 00000100:00100000:2.0:1787779954.973687:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881584640 00000100:00100000:2.0:1787779954.973690:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881584640 00000100:00100000:2.0:1787779954.973702:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787779954.973707:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347ebc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881584000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779954.973738:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347ebc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881584000:12345-0@lo:400:kworker.0 Request processed in 31us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779954.973744:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787779954.973755:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787779954.973760:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347ebcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881584512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779954.973786:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347ebcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881584512:12345-0@lo:400:kworker.0 Request processed in 27us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779954.973792:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787779954.973804:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787779954.973810:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347ebd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874622881584128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779954.973833:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347ebd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874622881584128:12345-0@lo:400:kworker.0 Request processed in 24us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779954.973858:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787779954.973870:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787779954.973876:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347ebf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874622881584640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779954.973913:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347ebf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874622881584640:12345-0@lo:400:kworker.0 Request processed in 38us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779954.973919:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787779954.973935:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881583616 00000100:00100000:2.0:1787779954.973939:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881583616 00000100:00100000:2.0:1787779954.973955:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1787779954.973960:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347ebc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874622881583616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779954.973988:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347ebc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874622881583616:12345-0@lo:400:kworker.0 Request processed in 28us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779954.973994:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1787779954.974030:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347a87c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1f575176-36bc-4786-83ee-2fea064a12a9:3641:1874622881583104:0@lo:400:kworker.0 00000100:00100000:2.0:1787779954.974041:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346cfda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881583616:0@lo:400:kworker.0 00010000:00080000:2.0:1787779954.974052:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c046215e940 x1874622881584128/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779970 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787779954.974063:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c046215e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881584128:0@lo:400:kworker.0 00010000:00080000:2.0:1787779954.974072:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0346da6d00 x1874622881584640/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779970 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787779954.974079:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346da6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881584640:0@lo:400:kworker.0 00010000:00080000:2.0:1787779954.974087:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c046215fc00 x1874622881584000/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779970 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787779954.974094:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c046215fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881584000:0@lo:400:kworker.0 00010000:00080000:2.0:1787779954.974102:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0346da4f00 x1874622881584512/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779970 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787779954.974124:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346da4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881584512:0@lo:400:kworker.0 00000100:00080000:0.0:1787779954.974321:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787779954.974325:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787779954.974335:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787779954.974337:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787779954.974348:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881584384 00000100:00100000:0.0:1787779954.974351:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881584384 00000100:00100000:0.0:1787779954.974388:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881583488 00000100:00100000:0.0:1787779954.974391:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881583488 00000100:00100000:0.0:1787779954.974403:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1787779954.974409:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346da7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1874622881583232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787779954.974453:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346da7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1874622881583232:12345-0@lo:400:kworker.0 Request processed in 43us (1825us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779954.974458:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1787779954.974473:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1787779954.974479:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346da5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1874622881583744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787779954.974504:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346da5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1874622881583744:12345-0@lo:400:kworker.0 Request processed in 26us (1812us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779954.974509:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1787779954.974519:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1787779954.974525:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346da4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1874622881584256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787779954.974551:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346da4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1874622881584256:12345-0@lo:400:kworker.0 Request processed in 27us (1821us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779954.974556:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1787779954.974567:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1787779954.974573:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346da43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1874622881583872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787779954.974596:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346da43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1874622881583872:12345-0@lo:400:kworker.0 Request processed in 23us (1779us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779954.974601:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1787779954.974611:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1787779954.974624:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c047798a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1874622881584384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787779954.974652:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c047798a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1874622881584384:12345-0@lo:400:kworker.0 Request processed in 29us (1782us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779954.974657:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1787779954.974669:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1787779954.974674:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04618eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874622881583488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787779954.974703:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04618eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874622881583488:12345-0@lo:400:kworker.0 Request processed in 29us (1418us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779954.974708:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00010000:00080000:0.0:1787779954.974737:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c046215d680 x1874622881583872/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779970 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787779954.974746:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c046215d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1874622881583872:0@lo:400:kworker.0 00010000:00080000:0.0:1787779954.974756:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0346da4780 x1874622881584384/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779970 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787779954.974765:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346da4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1874622881584384:0@lo:400:kworker.0 00000100:00100000:0.0:1787779954.974776:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346cff840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1874622881583232:0@lo:400:kworker.0 00000100:00100000:0.0:1787779954.974784:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346cff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1874622881583744:0@lo:400:kworker.0 00000100:00100000:0.0:1787779954.974794:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c046215c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1874622881584256:0@lo:400:kworker.0 00000100:00100000:0.0:1787779954.974828:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346cfe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874622881583488:0@lo:400:kworker.0 00000100:00080000:2.0:1787779954.975453:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787779954.976863:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787779954.976886:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346dac780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881584768:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787779954.976955:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779954.977030:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881584768 00000100:00100000:1.0:1787779954.977038:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881584768 00000100:00100000:1.0:1787779954.977096:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787779954.977104:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346da4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881584768:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787779954.977127:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787779954.977174:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346da4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881584768:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779954.977181:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00010000:00080000:1.0:1787779954.977216:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0346dac780 x1874622881584768/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779970 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787779954.977233:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346dac780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881584768:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787779955.486764:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346dac780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881584896:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787779955.486941:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1787779955.487113:0:9898:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 363491272147ns, next at 364491268174ns, rc = 0 00000100:00100000:0.0:1787779955.487142:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0345e77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881585024:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787779955.487175:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779955.487453:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881584896 00000100:00100000:1.0:1787779955.487463:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881584896 00000100:00100000:1.0:1787779955.487514:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881585024 00000100:00100000:1.0:1787779955.487517:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881585024 00000100:00100000:1.0:1787779955.487536:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1787779955.487547:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346da6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881584896:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787779955.487585:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787779955.490915:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1787779955.490941:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0345e74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874622881585024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787779955.490979:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787779955.491100:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0345e74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874622881585024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 169us (3923us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779955.491110:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00010000:00080000:3.0:1787779955.491174:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0345e77480 x1874622881585024/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779971 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779955.491201:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0345e77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881585024:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787779955.491305:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346da6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881584896:12345-0@lo:13:osp-pre-0-1.0 Request processed in 3758us (4363us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779955.491314:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00010000:00080000:2.0:1787779955.499973:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0346dac780 x1874622881584896/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779971 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787779955.500019:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346dac780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881584896:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1787779955.868029:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787779955.996785:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346cfe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881585152:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787779955.996909:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779956.004336:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881585152 00000100:00100000:0.0:1787779956.004529:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881585152 00000100:00100000:0.0:1787779956.004625:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787779956.004639:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0345e770c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1874622881585152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787779956.004677:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787779956.004791:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0345e770c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1874622881585152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 155us (7882us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779956.004799:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00080000:2.0:1787779956.005416:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787779956.011072:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0346cfe1c0 x1874622881585152/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779971 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787779956.011108:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346cfe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881585152:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787779956.640094:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787779956.640126:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787779956.640272:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863666560 00000100:00100000:1.0:1787779956.640290:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863666560 00000100:00100000:1.0:1787779956.640372:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 344 00000100:00100000:1.0:1787779956.640384:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471770c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+13:2410:x1874622863666560:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1787779956.640494:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471770c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+13:2410:x1874622863666560:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 112us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779956.640504:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 344 00000100:00100000:2.0:1787779956.641198:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787779956.645756:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863666816 00000100:00100000:3.0:1787779956.645933:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863666816 00000100:00100000:3.0:1787779956.646170:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863667072 00000100:00100000:3.0:1787779956.646176:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863667072 00000100:00100000:3.0:1787779956.646223:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 251 00000100:00100000:3.0:1787779956.646235:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346da4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:2410:x1874622863666816:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1787779956.646312:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346da4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:2410:x1874622863666816:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 78us (6183us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779956.646321:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 251 00000100:00100000:3.0:1787779956.646354:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 252 00000100:00100000:3.0:1787779956.646366:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046215c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+5:2410:x1874622863667072:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1787779956.646733:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787779956.646777:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046215c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+5:2410:x1874622863667072:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 413us (5583us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779956.646784:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 252 00000100:00100000:3.0:1787779956.646925:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863666688 00000100:00100000:3.0:1787779956.646929:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863666688 00000100:00100000:3.0:1787779956.646958:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 253 00000100:00100000:3.0:1787779956.646964:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046215d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+18:2410:x1874622863666688:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1787779956.647307:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046215d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+18:2410:x1874622863666688:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 341us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779956.647314:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 253 00000100:00100000:3.0:1787779956.647966:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00080000:2.0:1787779956.648377:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787779956.648424:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787779956.648447:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863667200 00000100:00100000:3.0:1787779956.648452:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863667200 00000100:00100000:3.0:1787779956.648493:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 254 00000100:00080000:2.0:1787779956.648497:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787779956.648503:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346cff840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+5:2410:x1874622863667200:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1787779956.648516:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863666944 00000100:00100000:2.0:1787779956.648522:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863666944 00000100:00100000:3.0:1787779956.648573:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346cff840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+5:2410:x1874622863667200:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 71us (149us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779956.648580:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 254 00000100:00100000:2.0:1787779956.648599:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 107 00000100:00100000:2.0:1787779956.648610:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346cff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:2410:x1874622863666944:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1787779956.648957:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346cff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:2410:x1874622863666944:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 348us (991us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779956.648966:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 107 00000100:00080000:2.0:1787779956.649492:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787779956.893241:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787779957.533793:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c046215fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881585280:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787779957.533887:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779957.534132:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881585280 00000100:00100000:1.0:1787779957.534141:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881585280 00000100:00100000:1.0:1787779957.534186:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1787779957.534195:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0345e75a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881585280:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787779957.534228:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1787779957.534279:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0345e75a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881585280:12345-0@lo:41:osp-pre-0-1.0 Request processed in 84us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779957.534287:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1787779957.534473:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c046215fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881585280:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787779957.916359:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787779958.045345:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787779958.045369:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c046215e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881585408:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787779958.045438:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779958.046354:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881585408 00000100:00100000:2.0:1787779958.046363:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881585408 00000100:00100000:2.0:1787779958.046423:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1787779958.046432:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0345e74f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881585408:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787779958.046464:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787779958.047653:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0345e74f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881585408:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1216us (2208us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779958.047663:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1787779958.047796:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c046215e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881585408:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1787779958.940039:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787779959.086086:0:13677:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:3.0:1787779959.976220:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787779960.093443:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787779960.093474:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0345e76580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1f575176-36bc-4786-83ee-2fea064a12a9:3642:1874622881585536:0@lo:400:kworker.0 00000100:00100000:0.0:1787779960.093582:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779960.093679:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0345e77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1874622881585664:0@lo:400:kworker.0 00000100:00100000:0.0:1787779960.093738:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779960.093796:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347fead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881585792:0@lo:400:kworker.0 00000100:00100000:0.0:1787779960.093828:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779960.093908:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347feb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874622881585920:0@lo:400:kworker.0 00000100:00100000:0.0:1787779960.093938:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779960.094009:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787779960.094016:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347fe8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881586048:0@lo:400:kworker.0 00000100:00100000:0.0:1787779960.094040:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779960.094093:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347fe9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1874622881586304:0@lo:400:kworker.0 00000100:00100000:0.0:1787779960.094116:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779960.094147:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347feb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1874622881586176:0@lo:400:kworker.0 00000100:00100000:0.0:1787779960.094176:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779960.094247:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347fe8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881586432:0@lo:400:kworker.0 00000100:00100000:0.0:1787779960.094302:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779960.094388:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347febc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1874622881586816:0@lo:400:kworker.0 00000100:00100000:0.0:1787779960.094416:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779960.094472:0:12488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881585664 00000100:00100000:3.0:1787779960.094477:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347fe9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881586560:0@lo:400:kworker.0 00000100:00100000:0.0:1787779960.094483:0:12488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881585664 00000100:00100000:0.0:1787779960.094538:0:12488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881585920 00000100:00100000:0.0:1787779960.094542:0:12488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881585920 00000100:00100000:3.0:1787779960.094561:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779960.094561:0:12488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881586304 00000100:00100000:0.0:1787779960.094567:0:12488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881586304 00000100:00100000:0.0:1787779960.094606:0:12488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881586176 00000100:00100000:0.0:1787779960.094609:0:12488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881586176 00000100:00100000:0.0:1787779960.094622:0:12488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881586816 00000100:00100000:0.0:1787779960.094624:0:12488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881586816 00000100:00100000:0.0:1787779960.094642:0:12488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1787779960.094658:0:12488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347fe8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1874622881585664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779960.096272:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787779960.096292:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347feb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1874622881586688:0@lo:400:kworker.0 00000100:00100000:0.0:1787779960.097328:0:12488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347fe8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1874622881585664:12345-0@lo:400:kworker.0 Request processed in 2665us (3582us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779960.097345:0:12488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1787779960.097391:0:12488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1787779960.097405:0:12488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347fe92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1874622881585920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787779960.097457:0:12488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347fe92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1874622881585920:12345-0@lo:400:kworker.0 Request processed in 58us (3519us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779960.097464:0:12488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1787779960.097476:0:12488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1787779960.097484:0:12488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347fe83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1874622881586304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787779960.097512:0:12488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347fe83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1874622881586304:12345-0@lo:400:kworker.0 Request processed in 29us (3395us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779960.097517:0:12488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1787779960.097529:0:12488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1787779960.097536:0:12488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347fe8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1874622881586176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787779960.097579:0:12488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347fe8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1874622881586176:12345-0@lo:400:kworker.0 Request processed in 44us (3403us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779960.097586:0:12488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1787779960.097598:0:12488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1787779960.097606:0:12488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347fe9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1874622881586816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787779960.097645:0:12488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347fe9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1874622881586816:12345-0@lo:400:kworker.0 Request processed in 40us (3229us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779960.097651:0:12488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1787779960.097678:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346efe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881586944:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787779960.097751:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779960.098099:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347feb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874622881585920:0@lo:400:kworker.0 00000100:00100000:0.0:1787779960.098140:0:8529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881586944 00000100:00100000:0.0:1787779960.098148:0:8529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881586944 00000100:00100000:0.0:1787779960.098194:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1787779960.098201:0:8529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347e58780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881586944:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787779960.098284:0:8529:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787779960.098328:0:8529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347e58780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881586944:12345-0@lo:13:osp-pre-1-1.0 Request processed in 128us (577us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779960.098335:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00010000:00080000:0.0:1787779960.098367:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0346efe580 x1874622881586944/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779976 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787779960.098384:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346efe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881586944:0@lo:13:osp-pre-1-1.0 00010000:00080000:0.0:1787779960.098420:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0347febc00 x1874622881586816/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779976 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787779960.098430:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347febc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1874622881586816:0@lo:400:kworker.0 00010000:00080000:0.0:1787779960.098444:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0347fe9680 x1874622881586304/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779976 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787779960.098456:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347fe9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1874622881586304:0@lo:400:kworker.0 00000100:00100000:0.0:1787779960.098484:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347feb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1874622881586176:0@lo:400:kworker.0 00000100:00100000:0.0:1787779960.098497:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0345e77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1874622881585664:0@lo:400:kworker.0 00000100:00100000:0.0:1787779960.098542:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787779960.098551:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347e5a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874622881587072:0@lo:400:kworker.0 00000100:00100000:2.0:1787779960.099184:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881585536 00000100:00100000:2.0:1787779960.099192:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881585536 00000100:00100000:2.0:1787779960.099250:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:2.0:1787779960.099260:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471771c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+24:3642:x1874622881585536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779960.099317:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471771c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+24:3642:x1874622881585536:12345-0@lo:400:kworker.0 Request processed in 59us (5736us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779960.099324:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:2.0:1787779960.099363:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881585792 00000100:00100000:2.0:1787779960.099368:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881585792 00000100:00100000:2.0:1787779960.099387:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881586048 00000100:00100000:2.0:1787779960.099391:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881586048 00000100:00100000:2.0:1787779960.099405:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1787779960.099411:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347fea1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881585792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779960.099453:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347fea1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881585792:12345-0@lo:400:kworker.0 Request processed in 42us (5624us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779960.099460:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1787779960.099471:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1787779960.099477:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347fea940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1874622881586048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779960.099503:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347fea940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1874622881586048:12345-0@lo:400:kworker.0 Request processed in 27us (5462us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779960.099518:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1787779960.099538:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881586432 00000100:00100000:2.0:1787779960.099542:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881586432 00000100:00100000:2.0:1787779960.099587:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881586560 00000100:00100000:2.0:1787779960.099591:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881586560 00000100:00100000:0.0:1787779960.099913:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779960.100051:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881587072 00000100:00100000:2.0:1787779960.100056:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881587072 00000100:00100000:2.0:1787779960.100076:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787779960.100083:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347fea580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881586432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779960.100130:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347fea580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881586432:12345-0@lo:400:kworker.0 Request processed in 48us (5828us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779960.100136:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787779960.100147:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787779960.100153:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346cfed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1874622881586560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779960.100185:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346cfed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1874622881586560:12345-0@lo:400:kworker.0 Request processed in 32us (5628us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779960.100191:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787779960.100201:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787779960.100206:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347e59a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1874622881587072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787779960.100407:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347fe8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881586048:0@lo:400:kworker.0 00000100:00100000:0.0:1787779960.100426:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0345e76580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1f575176-36bc-4786-83ee-2fea064a12a9:3642:1874622881585536:0@lo:400:kworker.0 00000100:00100000:0.0:1787779960.100498:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347e5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881587200:0@lo:400:kworker.0 00000100:00100000:0.0:1787779960.100525:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779960.101156:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347e59a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1874622881587072:12345-0@lo:400:kworker.0 Request processed in 946us (1240us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779960.101166:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787779960.101184:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881587200 00000100:00100000:2.0:1787779960.101189:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881587200 00010000:00080000:0.0:1787779960.101341:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0347e5a580 x1874622881587072/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779976 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787779960.101355:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347e5a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874622881587072:0@lo:400:kworker.0 00000100:00100000:2.0:1787779960.101420:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787779960.101431:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347e5bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3642:x1874622881587200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779960.101457:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1787779960.101553:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0347fe9a40 x1874622881586560/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779976 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779960.101568:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347fe9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881586560:0@lo:400:kworker.0 00000100:00100000:0.0:1787779960.101707:0:12488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881586688 00000100:00100000:0.0:1787779960.101715:0:12488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881586688 00000100:00100000:0.0:1787779960.101747:0:12488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1787779960.101755:0:12488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346cfda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1874622881586688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779960.101898:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347e5bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3642:x1874622881587200:12345-0@lo:400:kworker.0 Request processed in 469us (1371us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779960.101906:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00080000:2.0:1787779960.101928:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787779960.101933:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787779960.101936:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787779960.101938:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787779960.102116:0:12488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346cfda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1874622881586688:12345-0@lo:400:kworker.0 Request processed in 361us (672us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779960.102123:0:12488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00010000:00080000:2.0:1787779960.102292:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0347fe8780 x1874622881586432/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779976 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787779960.102305:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347fe8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881586432:0@lo:400:kworker.0 00000100:00100000:2.0:1787779960.102346:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347fead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881585792:0@lo:400:kworker.0 00010000:00080000:2.0:1787779960.102369:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0347e5b480 x1874622881587200/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779976 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787779960.102377:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347e5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881587200:0@lo:400:kworker.0 00000100:00100000:3.0:1787779960.102573:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347feb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1874622881586688:0@lo:400:kworker.0 00000004:00080000:3.0:1787779960.123394:0:6491:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:3.0:1787779960.123447:0:6491:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00000004:00080000:3.0:1787779960.123464:0:6491:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00010000:00010000:1.0:1787779960.123925:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766ddc00/0xc8fc0a517996085a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xd2a6d7e3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779960.123940:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766ddc00/0xc8fc0a517996085a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xd2a6d7e3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779960.123949:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766ddc00/0xc8fc0a517996085a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xd2a6d7e3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779960.123964:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c04766ddc00 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:1.0:1787779960.123970:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766ddc00/0xc8fc0a517996085a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xd2a6d7e3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779960.123986:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766ddc00/0xc8fc0a517996085a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xd2a6d7e3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779960.124011:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xd2a6d7e3 (ffff9c04440ff700) 00010000:00010000:1.0:1787779960.124025:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787779960.124031:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766ddc00/0xc8fc0a517996085a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xd2a6d7e3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779960.124038:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766ddc00/0xc8fc0a517996085a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xd2a6d7e3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779960.124062:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6600/0xc8fc0a517996086f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779960.124069:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6600/0xc8fc0a517996086f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779960.124074:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6600/0xc8fc0a517996086f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779960.124079:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0346dd6600 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:1.0:1787779960.124082:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6600/0xc8fc0a517996086f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779960.124088:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6600/0xc8fc0a517996086f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779960.124097:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9c0341cd4800) 00010000:00010000:1.0:1787779960.124100:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787779960.124102:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6600/0xc8fc0a517996086f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779960.124108:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6600/0xc8fc0a517996086f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779960.124126:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868800/0xc8fc0a51799608d8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xd2a6d7e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779960.124143:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868800/0xc8fc0a51799608d8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xd2a6d7e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779960.124148:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868800/0xc8fc0a51799608d8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xd2a6d7e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779960.124153:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0477868800 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:1.0:1787779960.124156:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868800/0xc8fc0a51799608d8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xd2a6d7e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779960.124162:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868800/0xc8fc0a51799608d8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xd2a6d7e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779960.124170:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xd2a6d7e3 (ffff9c04440ff700) 00010000:00010000:1.0:1787779960.124173:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787779960.124177:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868800/0xc8fc0a51799608d8 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xd2a6d7e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779960.124182:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868800/0xc8fc0a51799608d8 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xd2a6d7e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779960.124200:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6200/0xc8fc0a51799608f4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779960.124206:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6200/0xc8fc0a51799608f4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779960.124224:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6200/0xc8fc0a51799608f4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779960.124230:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0346dd6200 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:1.0:1787779960.124241:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6200/0xc8fc0a51799608f4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779960.124249:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6200/0xc8fc0a51799608f4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779960.124261:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9c0341cd4400) 00010000:00010000:1.0:1787779960.124263:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787779960.124266:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6200/0xc8fc0a51799608f4 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779960.124272:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6200/0xc8fc0a51799608f4 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779960.124298:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787779960.124323:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346efe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881587328:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1787779960.124415:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779960.124502:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881587328 00000100:00100000:1.0:1787779960.124512:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881587328 00000100:00100000:1.0:1787779960.126298:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787779960.126317:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0461beed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881587328:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1787779960.126359:0:9899:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2 count 1 00002000:00010000:1.0:1787779960.126401:0:9899:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 0, mtime: 0x6a8f5b72, atime: 0x6a8f5b72, ctime: 0x6a8f5b72, blocks: 0x0 00010000:00010000:1.0:1787779960.126410:0:9899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000022e582cc/0xc8fc0a5179960902 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779960.126431:0:9899:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=368s v=(0 0) 00010000:00010000:1.0:1787779960.126438:0:9899:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787779960.126446:0:9899:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000022e582cc/0xc8fc0a5179960902 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779960.126483:0:9899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000022e582cc/0xc8fc0a5179960902 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779960.126495:0:9899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000022e582cc/0xc8fc0a5179960902 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779960.126503:0:9899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000022e582cc/0xc8fc0a5179960902 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779960.128261:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787779960.128278:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000022e582cc/0xc8fc0a5179960902 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779960.128295:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0346dd7400 already unused, calling callback (ffffffffc0d97420) 00010000:00010000:0.0:1787779960.128301:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000022e582cc/0xc8fc0a5179960902 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779960.128314:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000022e582cc/0xc8fc0a5179960902 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779960.128363:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000022e582cc/0xc8fc0a5179960902 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779960.128376:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787779960.128378:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787779960.128380:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787779960.129662:0:9899:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787779960.129679:0:9899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000022e582cc/0xc8fc0a5179960902 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779960.130042:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0461beed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3644:x1874622881587328:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3727us (5623us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1787779960.130053:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000004:00080000:0.0:1787779960.130289:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c0346efe580/2, rc 0, transno 4294967301 00000100:00100000:0.0:1787779960.130297:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346efe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881587328:0@lo:6:osp-syn-1-0.0 00000020:00000080:3.0:1787779960.341456:0:13725:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff2e160d40 20000000:00000080:3.0:1787779960.341474:0:13725:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9c0347f78c00 uarg=0000000000000000 20000000:01000000:3.0:1787779960.341518:0:13725:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1787779960.341526:0:13725:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1787779960.341530:0:13725:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:1.0:1787779960.342294:0:13726:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:3.0:1787779960.342511:0:13725:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:0.0:1787779960.345884:0:13725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:0.0:1787779960.345927:0:13725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:0.0:1787779960.345943:0:13725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:0.0:1787779960.345956:0:13725:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787779960.345989:0:13725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c0477868400/0xc8fc0a5179960909 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779960.346008:0:13725:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c04766dc000/0xc8fc0a517996078f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1d4b expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779960.346016:0:13725:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c0477869400/0xc8fc0a5179960796 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1d52 expref: 12 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779960.346024:0:13725:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c04766dd600/0xc8fc0a51799607a4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a517996079d expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779960.346031:0:13725:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c0477a70600/0xc8fc0a51799607b2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a51799607ab expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779960.346038:0:13725:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c0477868e00/0xc8fc0a51799607c0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a51799607b9 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779960.346061:0:13725:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c0477869000/0xc8fc0a51799607ce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a51799607c7 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779960.346069:0:13725:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c0477868400/0xc8fc0a5179960909 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779960.346113:0:13725:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c0477869000/0xc8fc0a51799607ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc8fc0a51799607c7 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779960.346126:0:13725:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c0477869000/0xc8fc0a51799607ce lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc8fc0a51799607c7 expref: 23 pid: 6505 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779960.346140:0:13725:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347e5a580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13725:1874622881587456:0@lo:104: 00000100:00100000:0.0:1787779960.346204:0:13725:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787779960.346256:0:13725:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c0477868e00/0xc8fc0a51799607c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc8fc0a51799607b9 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779960.346262:0:13725:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c0477868e00/0xc8fc0a51799607c0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc8fc0a51799607b9 expref: 23 pid: 6505 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779960.346267:0:13725:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347e59e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13725:1874622881587584:0@lo:104: 00010000:00010000:0.0:1787779960.346283:0:13725:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c0477a70600/0xc8fc0a51799607b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc8fc0a51799607ab expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779960.346287:0:13725:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c0477a70600/0xc8fc0a51799607b2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc8fc0a51799607ab expref: 23 pid: 6507 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779960.346292:0:13725:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347e58000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13725:1874622881587712:0@lo:104: 00010000:00010000:0.0:1787779960.346303:0:13725:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c04766dd600/0xc8fc0a51799607a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc8fc0a517996079d expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779960.346313:0:13725:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c04766dd600/0xc8fc0a51799607a4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc8fc0a517996079d expref: 23 pid: 6507 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779960.346319:0:13725:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347e5ad00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13725:1874622881587840:0@lo:104: 00010000:00010000:0.0:1787779960.346335:0:13725:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c0477869400/0xc8fc0a5179960796 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1d52 expref: 12 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779960.346341:0:13725:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c0477869400/0xc8fc0a5179960796 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1d52 expref: 12 pid: 6507 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779960.346347:0:13725:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347e5a1c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13725:1874622881587968:192.168.203.31@tcp:104: 00010000:00010000:0.0:1787779960.346383:0:13725:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c04766dc000/0xc8fc0a517996078f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1d4b expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779960.346388:0:13725:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c04766dc000/0xc8fc0a517996078f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1d4b expref: 12 pid: 6506 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779960.346393:0:13725:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347e5b0c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13725:1874622881588096:192.168.203.31@tcp:104: 00000100:00100000:0.0:1787779960.346406:0:13725:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0347ce30c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787779960.346471:0:6495:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787779960.346486:0:6495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779960.346509:0:6495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779960.346546:0:6495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779960.346559:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881587456 00000100:00100000:1.0:1787779960.346565:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881587456 00000100:00100000:1.0:1787779960.346593:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881587584 00000100:00100000:1.0:1787779960.346595:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881587584 00000100:00100000:1.0:1787779960.346600:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881587712 00000100:00100000:1.0:1787779960.346602:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881587712 00000100:00100000:1.0:1787779960.346619:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881587840 00000100:00100000:1.0:1787779960.346622:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881587840 00000100:00100000:1.0:1787779960.346633:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787779960.346640:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347cfcc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1f575176-36bc-4786-83ee-2fea064a12a9+6:13725:x1874622881587456:12345-0@lo:104: 00010000:00010000:1.0:1787779960.346652:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff9c04766dd400/0xc8fc0a51799607c7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc8fc0a51799607ce expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779960.346711:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787779960.346715:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787779960.346716:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347cfcc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1f575176-36bc-4786-83ee-2fea064a12a9+6:13725:x1874622881587456:12345-0@lo:104: Request processed in 77us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779960.346722:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477980b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:1f575176-36bc-4786-83ee-2fea064a12a9+6:13725:x1874622881587584:12345-0@lo:104: 00000100:00100000:1.0:1787779960.346723:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00010000:0.0:1787779960.346730:0:8454:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff9c04766dc200/0xc8fc0a51799607b9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc8fc0a51799607c0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779960.346760:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00010000:00010000:0.0:1787779960.346761:0:8454:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787779960.346765:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477980b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:1f575176-36bc-4786-83ee-2fea064a12a9+5:13725:x1874622881587584:12345-0@lo:104: Request processed in 45us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779960.346766:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477983c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1f575176-36bc-4786-83ee-2fea064a12a9+5:13725:x1874622881587712:12345-0@lo:104: 00010000:00010000:1.0:1787779960.346773:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff9c0477868200/0xc8fc0a51799607ab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc8fc0a51799607b2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779960.346776:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787779960.346789:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787779960.346794:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347dae940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:1f575176-36bc-4786-83ee-2fea064a12a9+4:13725:x1874622881587840:12345-0@lo:104: 00010000:00010000:0.0:1787779960.346802:0:8454:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff9c0477869a00/0xc8fc0a517996079d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc8fc0a51799607a4 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779960.346803:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1787779960.346807:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477983c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1f575176-36bc-4786-83ee-2fea064a12a9+4:13725:x1874622881587712:12345-0@lo:104: Request processed in 42us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779960.346812:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00010000:0.0:1787779960.346827:0:8454:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00010000:00010000:1.0:1787779960.346828:0:7453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00000100:00100000:0.0:1787779960.346831:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347dae940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:1f575176-36bc-4786-83ee-2fea064a12a9+3:13725:x1874622881587840:12345-0@lo:104: Request processed in 38us (286us total) trans 0 rc 0/0 00010000:00010000:1.0:1787779960.346833:0:7453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff9c04766dd400/0xc8fc0a51799607c7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc8fc0a51799607ce expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779960.346858:0:7453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c04766dd400 already unused, calling callback (ffffffffc139ac20) 00000100:00100000:0.0:1787779960.346860:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 10000000:00010000:1.0:1787779960.346863:0:7453:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff9c04766dd400/0xc8fc0a51799607c7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xc8fc0a51799607ce expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779960.346870:0:7453:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff9c04766dd400/0xc8fc0a51799607c7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xc8fc0a51799607ce expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787779960.346884:0:7453:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff9c04766dd400/0xc8fc0a51799607c7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xc8fc0a51799607ce expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787779960.346889:0:7453:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:0.0:1787779960.346893:0:13725:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347e5a580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13725:1874622881587456:0@lo:104: 00000100:00100000:0.0:1787779960.346901:0:13725:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347e59e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13725:1874622881587584:0@lo:104: 00000100:00100000:0.0:1787779960.346907:0:13725:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347e58000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13725:1874622881587712:0@lo:104: 00000100:00100000:0.0:1787779960.346913:0:13725:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347e5ad00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13725:1874622881587840:0@lo:104: 00010000:00010000:1.0:1787779960.346915:0:7453:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff9c04766dd400/0xc8fc0a51799607c7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a51799607ce expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779960.346920:0:7453:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787779960.346940:0:7453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff9c04766dd400/0xc8fc0a51799607c7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a51799607ce expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779960.346947:0:7453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff9c04766dd400/0xc8fc0a51799607c7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a51799607ce expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779960.346950:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347daf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1f575176-36bc-4786-83ee-2fea064a12a9:3644:1874622881588224:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787779960.346959:0:7453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787779960.346963:0:7453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff9c04766dc200/0xc8fc0a51799607b9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc8fc0a51799607c0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779960.346968:0:7453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c04766dc200 already unused, calling callback (ffffffffc139ac20) 10000000:00010000:1.0:1787779960.346984:0:7453:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff9c04766dc200/0xc8fc0a51799607b9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc8fc0a51799607c0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779960.346992:0:7453:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff9c04766dc200/0xc8fc0a51799607b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc8fc0a51799607c0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779960.346993:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:00010000:1.0:1787779960.346998:0:7453:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff9c04766dc200/0xc8fc0a51799607b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc8fc0a51799607c0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787779960.347003:0:7453:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787779960.347023:0:7453:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff9c04766dc200/0xc8fc0a51799607b9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a51799607c0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779960.347028:0:7453:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787779960.347048:0:7453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff9c04766dc200/0xc8fc0a51799607b9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a51799607c0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779960.347055:0:7453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff9c04766dc200/0xc8fc0a51799607b9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a51799607c0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779960.347065:0:7453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787779960.347067:0:7453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff9c0477868200/0xc8fc0a51799607ab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc8fc0a51799607b2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779960.347071:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347dad680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1f575176-36bc-4786-83ee-2fea064a12a9:3641:1874622881588352:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787779960.347073:0:7453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0477868200 already unused, calling callback (ffffffffc139ac20) 10000000:00010000:1.0:1787779960.347076:0:7453:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff9c0477868200/0xc8fc0a51799607ab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc8fc0a51799607b2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779960.347083:0:7453:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff9c0477868200/0xc8fc0a51799607ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc8fc0a51799607b2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787779960.347089:0:7453:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff9c0477868200/0xc8fc0a51799607ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc8fc0a51799607b2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779960.347093:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:1.0:1787779960.347095:0:7453:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787779960.347106:0:7453:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff9c0477868200/0xc8fc0a51799607ab lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a51799607b2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779960.347112:0:7453:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787779960.347118:0:7453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff9c0477868200/0xc8fc0a51799607ab lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a51799607b2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779960.347123:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787779960.347128:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347dac3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1f575176-36bc-4786-83ee-2fea064a12a9:3641:1874622881588480:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787779960.347134:0:7453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff9c0477868200/0xc8fc0a51799607ab lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a51799607b2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779960.347143:0:7453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787779960.347146:0:7453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff9c0477869a00/0xc8fc0a517996079d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc8fc0a51799607a4 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779960.347147:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787779960.347152:0:7453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0477869a00 already unused, calling callback (ffffffffc139ac20) 10000000:00010000:1.0:1787779960.347155:0:7453:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff9c0477869a00/0xc8fc0a517996079d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc8fc0a51799607a4 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779960.347162:0:7453:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff9c0477869a00/0xc8fc0a517996079d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc8fc0a51799607a4 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787779960.347168:0:7453:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff9c0477869a00/0xc8fc0a517996079d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc8fc0a51799607a4 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779960.347170:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881588224 10000000:01000000:1.0:1787779960.347173:0:7453:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:0.0:1787779960.347173:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881588224 00010000:00010000:1.0:1787779960.347186:0:7453:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff9c0477869a00/0xc8fc0a517996079d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a51799607a4 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779960.347189:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c0477869000/0xc8fc0a51799607ce lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc8fc0a51799607c7 expref: 24 pid: 6505 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779960.347191:0:7453:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787779960.347202:0:7453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff9c0477869a00/0xc8fc0a517996079d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a51799607a4 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779960.347208:0:7453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff9c0477869a00/0xc8fc0a517996079d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a51799607a4 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779960.347217:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881588352 00010000:00010000:1.0:1787779960.347219:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787779960.347220:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881588352 00010000:00010000:1.0:1787779960.347224:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787779960.347226:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787779960.347231:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c0477868e00/0xc8fc0a51799607c0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc8fc0a51799607b9 expref: 25 pid: 6505 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779960.347232:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787779960.347241:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881588480 00000100:00100000:0.0:1787779960.347243:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881588480 00000100:00100000:1.0:1787779960.347249:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347dacf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1f575176-36bc-4786-83ee-2fea064a12a9:3643:1874622881588608:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787779960.347252:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c0477a70600/0xc8fc0a51799607b2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc8fc0a51799607ab expref: 26 pid: 6507 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779960.347263:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787779960.347268:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347e592c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1f575176-36bc-4786-83ee-2fea064a12a9+26:3644:x1874622881588224:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787779960.347272:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787779960.347277:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787779960.347281:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c0477869000/0xc8fc0a51799607ce lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc8fc0a51799607c7 expref: 26 pid: 6505 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779960.347291:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c0477869000/0xc8fc0a51799607ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc8fc0a51799607c7 expref: 26 pid: 6505 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779960.347294:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881588608 00000100:00100000:1.0:1787779960.347297:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881588608 00010000:00010000:0.0:1787779960.347304:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c0477869000/0xc8fc0a51799607ce lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc8fc0a51799607c7 expref: 27 pid: 6505 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779960.347309:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c04766dd600/0xc8fc0a51799607a4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc8fc0a517996079d expref: 27 pid: 6507 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779960.347315:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787779960.347321:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787779960.347326:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347e58b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1f575176-36bc-4786-83ee-2fea064a12a9+26:3641:x1874622881588352:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787779960.347333:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1787779960.347336:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347e592c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1f575176-36bc-4786-83ee-2fea064a12a9+26:3644:x1874622881588224:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (343us total) trans 0 rc 0/0 00010000:00010000:1.0:1787779960.347337:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c0477868e00/0xc8fc0a51799607c0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc8fc0a51799607b9 expref: 26 pid: 6505 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779960.347342:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00010000:1.0:1787779960.347345:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c0477868e00/0xc8fc0a51799607c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc8fc0a51799607b9 expref: 26 pid: 6505 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779960.347356:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c0477868e00/0xc8fc0a51799607c0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc8fc0a51799607b9 expref: 25 pid: 6505 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779960.347357:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787779960.347362:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347e5a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1f575176-36bc-4786-83ee-2fea064a12a9+24:3641:x1874622881588480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787779960.347364:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787779960.347377:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787779960.347382:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c0477a70600/0xc8fc0a51799607b2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc8fc0a51799607ab expref: 24 pid: 6507 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779960.347390:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c0477a70600/0xc8fc0a51799607b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc8fc0a51799607ab expref: 24 pid: 6507 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779960.347397:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347e58b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1f575176-36bc-4786-83ee-2fea064a12a9+24:3641:x1874622881588352:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779960.347404:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00010000:0.0:1787779960.347404:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c0477a70600/0xc8fc0a51799607b2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc8fc0a51799607ab expref: 24 pid: 6507 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779960.347413:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787779960.347417:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787779960.347422:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347dac780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1f575176-36bc-4786-83ee-2fea064a12a9+22:3643:x1874622881588608:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787779960.347430:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1787779960.347437:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347e5a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1f575176-36bc-4786-83ee-2fea064a12a9+22:3641:x1874622881588480:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (289us total) trans 0 rc 0/0 00010000:00010000:1.0:1787779960.347441:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c04766dd600/0xc8fc0a51799607a4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc8fc0a517996079d expref: 22 pid: 6507 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779960.347442:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00010000:1.0:1787779960.347451:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c04766dd600/0xc8fc0a51799607a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc8fc0a517996079d expref: 21 pid: 6507 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779960.347461:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c04766dd600/0xc8fc0a51799607a4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc8fc0a517996079d expref: 21 pid: 6507 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779960.347472:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787779960.347523:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347dac780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1f575176-36bc-4786-83ee-2fea064a12a9+20:3643:x1874622881588608:12345-0@lo:103:ldlm_bl.0 Request processed in 100us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779960.347529:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787779960.347563:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347daf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1f575176-36bc-4786-83ee-2fea064a12a9:3644:1874622881588224:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787779960.347585:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347dac3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1f575176-36bc-4786-83ee-2fea064a12a9:3641:1874622881588480:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787779960.347601:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347dad680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1f575176-36bc-4786-83ee-2fea064a12a9:3641:1874622881588352:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787779960.347665:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787779960.347672:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347dacf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1f575176-36bc-4786-83ee-2fea064a12a9:3643:1874622881588608:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787779960.361989:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787779960.362031:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787779960.362107:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863667328 00000100:00100000:1.0:1787779960.362124:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863667328 00010000:00010000:1.0:1787779960.362265:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c0477869400/0xc8fc0a5179960796 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1d52 expref: 13 pid: 6507 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779960.362320:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863667456 00000100:00100000:1.0:1787779960.362326:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863667456 00010000:00010000:1.0:1787779960.362341:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c04766dc000/0xc8fc0a517996078f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1d4b expref: 14 pid: 6506 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779960.362373:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 50 00000100:00100000:1.0:1787779960.362384:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046215e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+14:2410:x1874622863667328:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787779960.362433:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787779960.362445:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c0477869400/0xc8fc0a5179960796 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1d52 expref: 14 pid: 6507 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779960.362446:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 51 00010000:00010000:1.0:1787779960.362461:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c0477869400/0xc8fc0a5179960796 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1d52 expref: 14 pid: 6507 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779960.362482:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046215fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+14:2410:x1874622863667456:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787779960.362502:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787779960.362511:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c04766dc000/0xc8fc0a517996078f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1d4b expref: 14 pid: 6506 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779960.362641:0:13725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c0477869400/0xc8fc0a5179960796 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1d52 expref: 14 pid: 6507 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779960.362658:0:13725:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347e5a1c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13725:1874622881587968:192.168.203.31@tcp:104: 00000100:00100000:0.0:1787779960.362671:0:13725:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347e5b0c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13725:1874622881588096:192.168.203.31@tcp:104: 00010000:00010000:1.0:1787779960.362903:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787779960.362987:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046215e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+13:2410:x1874622863667328:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 603us (1021us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779960.362996:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 50 00010000:00010000:3.0:1787779960.366885:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c04766dc000/0xc8fc0a517996078f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1d4b expref: 12 pid: 6506 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779960.366924:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c04766dc000/0xc8fc0a517996078f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1d4b expref: 12 pid: 6506 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779960.367096:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c0477868400/0xc8fc0a5179960909 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 13725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779960.367109:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0477868400/0xc8fc0a5179960909 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 13725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779960.367547:0:13725:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c0477868400/0xc8fc0a5179960909 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779960.368291:0:6499:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c0477868400/0xc8fc0a5179960909 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779960.368305:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c0477868400/0xc8fc0a5179960909 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779960.368312:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c0477868400/0xc8fc0a5179960909 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779960.368320:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c0477868400/0xc8fc0a5179960909 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779960.368326:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0477868400 already unused, calling callback (ffffffffc0d97420) 00010000:00010000:3.0:1787779960.368332:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c0477868400/0xc8fc0a5179960909 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779960.368363:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c0477868400/0xc8fc0a5179960909 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779960.369458:0:13725:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c0477868400/0xc8fc0a5179960909 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779960.369475:0:13725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c0477868400/0xc8fc0a5179960909 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779960.374995:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c0477868400/0xc8fc0a5179960909 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779960.375023:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c0477868400/0xc8fc0a5179960909 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779960.375056:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787779960.377233:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046215fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+11:2410:x1874622863667456:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 14748us (15188us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779960.377250:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 51 00000100:00100000:3.0:1787779960.605308:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787779960.605339:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346dac780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881588736:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787779960.605445:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779960.605527:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881588736 00000100:00100000:3.0:1787779960.605535:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881588736 00000100:00100000:3.0:1787779960.605590:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1787779960.605600:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347c37c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1874622881588736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787779960.605628:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787779960.605679:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347c37c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1874622881588736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779960.605687:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1787779960.605746:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346dac780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881588736:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787779960.612813:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347a86d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881588864:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787779960.612930:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779960.613028:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881588864 00000100:00100000:2.0:1787779960.613038:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881588864 00000100:00100000:2.0:1787779960.613096:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1787779960.613106:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347a87c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881588864:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787779960.613144:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787779960.613196:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347a87c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881588864:12345-0@lo:13:osp-pre-0-1.0 Request processed in 91us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779960.613223:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00010000:00080000:2.0:1787779960.613272:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0347a86d00 x1874622881588864/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779976 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787779960.613294:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347a86d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881588864:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1787779960.989012:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787779961.116116:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787779961.116139:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347c35e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881588992:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787779961.116202:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779961.116263:0:8529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881588992 00000100:00100000:3.0:1787779961.116269:0:8529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881588992 00000100:00100000:3.0:1787779961.116318:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1787779961.116326:0:8529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347c34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874622881588992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787779961.116346:0:8529:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787779961.116385:0:8529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347c34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874622881588992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 60us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779961.116392:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00010000:00080000:3.0:1787779961.116442:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0347c35e00 x1874622881588992/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779977 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779961.116460:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347c35e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881588992:0@lo:13:osp-pre-0-0.0 00000020:00000080:2.0:1787779961.367070:0:13775:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdf9331520 20000000:00000080:2.0:1787779961.367088:0:13775:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9c0347d89c00 uarg=0000000000000000 20000000:01000000:2.0:1787779961.367130:0:13775:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:2.0:1787779961.367136:0:13775:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:2.0:1787779961.367140:0:13775:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0001.hsm_control=enabled del=0 00000040:00080000:3.0:1787779961.384863:0:13776:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 20000000:02000000:2.0:1787779961.385208:0:13775:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0001.hsm_control=enabled in log params 00000040:00080000:3.0:1787779961.385703:0:13775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10112 00000040:00080000:3.0:1787779961.386152:0:13775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 128 off10240 00000040:00080000:3.0:1787779961.386173:0:13775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 224 off10464 10000000:01000000:3.0:1787779961.386186:0:13775:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787779961.386207:0:13775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c0440030200/0xc8fc0a5179960910 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779961.386224:0:13775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0440030200/0xc8fc0a5179960910 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779961.386234:0:13775:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c0440030200/0xc8fc0a5179960910 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779961.386241:0:13775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c0440030200/0xc8fc0a5179960910 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779961.386248:0:13775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c0440030200/0xc8fc0a5179960910 lrc: 3/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779961.386256:0:13775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c0440030200/0xc8fc0a5179960910 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779961.386290:0:13775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0440030200 already unused, calling callback (ffffffffc0d97420) 00010000:00010000:3.0:1787779961.386294:0:13775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c0440030200/0xc8fc0a5179960910 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779961.386302:0:13775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c0440030200/0xc8fc0a5179960910 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779961.386315:0:13775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c0440030200/0xc8fc0a5179960910 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779961.386332:0:13775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c0440030200/0xc8fc0a5179960910 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779961.386339:0:13775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c0440030200/0xc8fc0a5179960910 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779961.760906:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787779961.765150:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787779961.765178:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787779961.765209:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787779961.765237:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787779961.765261:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787779961.765294:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863667840 00000100:00100000:2.0:1787779961.765303:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863667840 00000100:00100000:3.0:1787779961.765316:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863668096 00000100:00100000:3.0:1787779961.765321:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863668096 00000100:00100000:0.0:1787779961.765379:0:12488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863667712 00000100:00100000:0.0:1787779961.765395:0:12488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863667712 00000100:00100000:3.0:1787779961.765443:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863668224 00000100:00100000:3.0:1787779961.765447:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863668224 00000100:00100000:1.0:1787779961.765726:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863667584 00000100:00100000:1.0:1787779961.765731:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863667584 00000100:00100000:1.0:1787779961.765889:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 346 00000100:00100000:1.0:1787779961.765898:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471770050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+11:6179:x1874622863667584:12345-192.168.203.31@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787779961.765914:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787779961.765933:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0346dd6200/0xc8fc0a5179960917 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf757128131ea1d9f expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779961.770158:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0346dd6200/0xc8fc0a5179960917 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1d9f expref: 12 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779961.770187:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0346dd6200/0xc8fc0a5179960917 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1d9f expref: 12 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779961.770219:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0346dd6200, rc 0) 00000100:00100000:1.0:1787779961.770293:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471770050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+12:6179:x1874622863667584:12345-192.168.203.31@tcp:101:ll_cfg_requeue.0 Request processed in 4394us (9395us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779961.770303:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 346 00000100:00080000:1.0:1787779961.770474:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787779961.770479:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787779961.770499:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 261 00000100:00100000:1.0:1787779961.770511:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04812aa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+5:2411:x1874622863668096:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1787779961.770568:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04812aa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+5:2411:x1874622863668096:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 61us (5389us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779961.770576:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 261 00000100:00100000:2.0:1787779961.771542:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 262 00000100:00100000:2.0:1787779961.771556:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347a86d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:2411:x1874622863667840:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1787779961.771597:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347a86d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:2411:x1874622863667840:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 47us (6457us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779961.771603:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 262 00000100:00100000:2.0:1787779961.777034:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787779961.777067:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863668352 00000100:00100000:2.0:1787779961.777087:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863668352 00000100:00100000:2.0:1787779961.777142:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 347 00000100:00100000:2.0:1787779961.777151:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471772450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+12:6179:x1874622863668352:12345-192.168.203.31@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787779961.777499:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471772450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+12:6179:x1874622863668352:12345-192.168.203.31@tcp:501:ll_cfg_requeue.0 Request processed in 347us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779961.777507:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 347 00000100:00100000:2.0:1787779961.777563:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863667968 00000100:00100000:2.0:1787779961.777567:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863667968 00000100:00100000:2.0:1787779961.777598:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 112 00000100:00100000:2.0:1787779961.777603:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04812aad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:2410:x1874622863667968:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1787779961.777627:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04812aad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:2410:x1874622863667968:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 25us (12390us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779961.777634:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 112 00000100:00100000:0.0:1787779961.779892:0:12488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 263 00000100:00100000:0.0:1787779961.779908:0:12488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04812a9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:2410:x1874622863667712:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1787779961.779981:0:12488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04812a9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:2410:x1874622863667712:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 78us (14770us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779961.779988:0:12488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 263 00000100:00100000:0.0:1787779961.780180:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787779961.780487:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863668480 00000100:00100000:0.0:1787779961.780495:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863668480 00000100:00100000:0.0:1787779961.780525:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 348 00000100:00100000:0.0:1787779961.780532:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471771850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+12:6179:x1874622863668480:12345-192.168.203.31@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787779961.780636:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471771850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+12:6179:x1874622863668480:12345-192.168.203.31@tcp:503:ll_cfg_requeue.0 Request processed in 103us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779961.780643:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 348 00000100:00080000:0.0:1787779961.780736:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787779961.798430:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787779961.798609:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863668608 00000100:00100000:2.0:1787779961.798618:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863668608 00000100:00100000:2.0:1787779961.798674:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 349 00000100:00100000:2.0:1787779961.798683:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471771050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+12:10823:x1874622863668608:12345-192.168.203.31@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787779961.798823:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471771050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+12:10823:x1874622863668608:12345-192.168.203.31@tcp:502:llog_process_th.0 Request processed in 140us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779961.798831:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 349 00000100:00100000:3.0:1787779961.805362:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 264 00000100:00100000:3.0:1787779961.805380:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04812ab840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+5:2410:x1874622863668224:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1787779961.805453:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04812ab840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+5:2410:x1874622863668224:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 81us (40192us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779961.805460:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 264 00000100:00100000:2.0:1787779961.805714:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787779961.807835:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863668736 00000100:00100000:3.0:1787779961.810571:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863668736 00000100:00100000:2.0:1787779961.811212:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 350 00000100:00100000:2.0:1787779961.811224:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471773050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+12:10823:x1874622863668736:12345-192.168.203.31@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787779961.811386:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471773050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+12:10823:x1874622863668736:12345-192.168.203.31@tcp:502:llog_process_th.0 Request processed in 163us (5672us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779961.811406:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 350 00000100:00100000:2.0:1787779961.831399:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787779961.831536:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863668864 00000100:00100000:0.0:1787779961.831545:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863668864 00000100:00100000:0.0:1787779961.831597:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 351 00000100:00100000:0.0:1787779961.831608:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471770850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+12:6179:x1874622863668864:12345-192.168.203.31@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787779961.831623:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787779961.831640:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0477869a00/0xc8fc0a517996091e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf757128131ea1da6 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779961.831669:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0477869a00/0xc8fc0a517996091e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1da6 expref: 13 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779961.831698:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0477869a00/0xc8fc0a517996091e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1da6 expref: 13 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779961.831707:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0477869a00, rc 0) 00000100:00100000:0.0:1787779961.831773:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471770850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+13:6179:x1874622863668864:12345-192.168.203.31@tcp:101:ll_cfg_requeue.0 Request processed in 166us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779961.831780:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 351 00000100:00100000:0.0:1787779961.846422:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787779961.847025:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863668992 00000100:00100000:3.0:1787779961.847050:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863668992 00000100:00100000:3.0:1787779961.847114:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 352 00000100:00100000:3.0:1787779961.847126:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471773450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+13:6179:x1874622863668992:12345-192.168.203.31@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787779961.847280:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471773450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+13:6179:x1874622863668992:12345-192.168.203.31@tcp:501:ll_cfg_requeue.0 Request processed in 157us (867us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779961.847288:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 352 00000100:00100000:1.0:1787779961.852716:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787779961.852808:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863669120 00000100:00100000:2.0:1787779961.852819:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863669120 00000100:00100000:2.0:1787779961.852905:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 353 00000100:00100000:2.0:1787779961.852915:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471772850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+13:6179:x1874622863669120:12345-192.168.203.31@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787779961.853061:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471772850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+13:6179:x1874622863669120:12345-192.168.203.31@tcp:503:ll_cfg_requeue.0 Request processed in 147us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779961.853069:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 353 00000100:00100000:2.0:1787779961.867783:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787779961.868144:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863669248 00000100:00100000:0.0:1787779961.868153:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863669248 00000100:00100000:0.0:1787779961.868215:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 354 00000100:00100000:0.0:1787779961.868225:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471773c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+13:10826:x1874622863669248:12345-192.168.203.31@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787779961.868383:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471773c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+13:10826:x1874622863669248:12345-192.168.203.31@tcp:502:llog_process_th.0 Request processed in 159us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779961.868391:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 354 00000100:00100000:0.0:1787779961.878027:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787779961.881133:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863669376 00000100:00100000:3.0:1787779961.881145:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863669376 00000100:00100000:0.0:1787779961.882831:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 355 00000100:00100000:0.0:1787779961.882881:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471772c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+13:10826:x1874622863669376:12345-192.168.203.31@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787779961.883047:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471772c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+13:10826:x1874622863669376:12345-192.168.203.31@tcp:502:llog_process_th.0 Request processed in 169us (5030us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779961.883057:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 355 10000000:01000000:1.0:1787779961.950166:0:6509:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787779961.950175:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c0346bcb000 from 7 10000000:01000000:1.0:1787779961.950180:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787779961.950231:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c0346dd7a00/0xc8fc0a5179960925 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779961.950244:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff9c0346dd7a00/0xc8fc0a5179960925 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779961.950256:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff9c0346dd7a00/0xc8fc0a5179960925 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779961.950281:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347dad680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881589120:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787779961.950353:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779961.950459:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0346d5bcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787779961.950546:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881589120 00000100:00100000:2.0:1787779961.950555:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881589120 00000100:00100000:2.0:1787779961.950608:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:2.0:1787779961.950617:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471773850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+20:6509:x1874622881589120:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787779961.950632:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787779961.950645:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0477a70000/0xc8fc0a517996092c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc8fc0a5179960925 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779961.950667:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0477a70000/0xc8fc0a517996092c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc8fc0a5179960925 expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779961.950678:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0477a70000/0xc8fc0a517996092c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a5179960925 expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779961.950688:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0477a70000, rc 0) 00000100:00100000:2.0:1787779961.950935:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471773850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+21:6509:x1874622881589120:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 318us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779961.950955:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:1.0:1787779961.951033:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347dad680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881589120:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787779961.951049:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff9c0346dd7a00/0xc8fc0a5179960925 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a517996092c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779961.951058:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff9c0346dd7a00/0xc8fc0a5179960925 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc8fc0a517996092c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779961.951119:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347dad680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881589248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787779961.951148:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779961.951166:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0346d5bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787779961.951554:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881589248 00000100:00100000:0.0:1787779961.951560:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881589248 00000100:00100000:0.0:1787779961.951593:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:0.0:1787779961.951609:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046098c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+21:6509:x1874622881589248:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787779961.951731:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046098c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+21:6509:x1874622881589248:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 124us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779961.951739:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:1.0:1787779961.952643:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347dad680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881589248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787779961.952699:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347dad680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881589376:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787779961.952755:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779961.952887:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0346d5bcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787779961.956986:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881589376 00000100:00100000:2.0:1787779961.957000:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881589376 00000100:00100000:2.0:1787779961.957071:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:2.0:1787779961.957081:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046098e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+21:6509:x1874622881589376:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787779961.958060:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046098e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+21:6509:x1874622881589376:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 976us (5301us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779961.958068:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:1.0:1787779961.960399:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347dad680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881589376:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787779961.961171:0:13789:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04812ab480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f575176-36bc-4786-83ee-2fea064a12a9:13789:1874622881589504:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787779961.961253:0:13789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779961.961295:0:13789:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0346cc9480 going to sleep for 11 seconds 00000100:00100000:0.0:1787779961.961484:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881589504 00000100:00100000:0.0:1787779961.961492:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881589504 00000100:00100000:0.0:1787779961.961539:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:0.0:1787779961.961549:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046098d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+21:13789:x1874622881589504:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787779961.961675:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046098d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+21:13789:x1874622881589504:12345-0@lo:502:llog_process_th.0 Request processed in 127us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779961.961682:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:2.0:1787779961.961992:0:13789:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04812ab480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f575176-36bc-4786-83ee-2fea064a12a9:13789:1874622881589504:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787779961.962020:0:13789:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787779961.962029:0:13789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787779961.962032:0:13789:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787779961.962038:0:13789:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c0346bcb000 00000020:00000080:2.0:1787779961.962041:0:13789:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787779961.962106:0:13789:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787779961.962119:0:13789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787779961.962121:0:13789:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787779961.962124:0:13789:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787779961.962126:0:13789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787779961.962128:0:13789:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1787779961.962132:0:13789:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c0346bcb000 00000020:00000080:2.0:1787779961.962134:0:13789:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787779961.962170:0:13789:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04812ab480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f575176-36bc-4786-83ee-2fea064a12a9:13789:1874622881589632:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787779961.962205:0:13789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779961.962246:0:13789:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c044133ac00 going to sleep for 11 seconds 00000100:00100000:0.0:1787779961.962998:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881589632 00000100:00100000:0.0:1787779961.963004:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881589632 00000100:00100000:0.0:1787779961.963039:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:0.0:1787779961.963046:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046098d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+21:13789:x1874622881589632:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787779961.965128:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046098d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+21:13789:x1874622881589632:12345-0@lo:502:llog_process_th.0 Request processed in 2071us (2910us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779961.965144:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:3.0:1787779961.971606:0:13789:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04812ab480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f575176-36bc-4786-83ee-2fea064a12a9:13789:1874622881589632:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787779961.971654:0:13789:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787779961.971663:0:13789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787779961.971665:0:13789:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1787779961.971672:0:13789:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1787779961.972609:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:1.0:1787779961.972639:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787779961.972651:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c0346dd7a00/0xc8fc0a5179960925 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a517996092c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779961.972662:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff9c0346dd7a00/0xc8fc0a5179960925 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a517996092c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787779961.972673:0:6509:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787779961.972676:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c046ecd6000 from 7 10000000:01000000:1.0:1787779961.972678:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787779961.972717:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c0346dd6400/0xc8fc0a5179960933 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779961.972726:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff9c0346dd6400/0xc8fc0a5179960933 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779961.972736:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff9c0346dd6400/0xc8fc0a5179960933 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779961.972758:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347dad680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881589760:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787779961.972819:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779961.974308:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0346d5bcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787779961.987594:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881589760 00000100:00100000:2.0:1787779961.987613:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881589760 00000100:00100000:2.0:1787779961.987665:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:2.0:1787779961.987675:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046098f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+21:6509:x1874622881589760:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787779961.987691:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787779961.987709:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0477a71c00/0xc8fc0a517996093a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc8fc0a5179960933 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779961.987736:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0477a71c00/0xc8fc0a517996093a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc8fc0a5179960933 expref: 22 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779961.987747:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0477a71c00/0xc8fc0a517996093a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a5179960933 expref: 22 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779961.987757:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0477a71c00, rc 0) 00000100:00100000:2.0:1787779961.987857:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046098f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+22:6509:x1874622881589760:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 184us (15038us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779961.987863:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:2.0:1787779961.988006:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347dad680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881589760:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787779961.988022:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff9c0346dd6400/0xc8fc0a5179960933 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a517996093a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779961.988031:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff9c0346dd6400/0xc8fc0a5179960933 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc8fc0a517996093a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779961.988101:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04812aa580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881589888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787779961.988164:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779961.988203:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c044133ab40 going to sleep for 11 seconds 00000100:00100000:2.0:1787779961.988216:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881589888 00000100:00100000:2.0:1787779961.988221:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881589888 00000100:00100000:2.0:1787779961.988244:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:2.0:1787779961.988250:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046098c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+22:6509:x1874622881589888:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787779961.988361:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046098c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+22:6509:x1874622881589888:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 110us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779961.988368:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:2.0:1787779961.988397:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04812aa580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881589888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787779961.988425:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04812aa580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881590016:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787779961.988474:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779961.988488:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c044133ab40 going to sleep for 11 seconds 00000100:00100000:2.0:1787779961.988499:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881590016 00000100:00100000:2.0:1787779961.988502:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881590016 00000100:00100000:2.0:1787779961.988518:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:2.0:1787779961.988524:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046098f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+22:6509:x1874622881590016:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787779961.988596:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046098f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+22:6509:x1874622881590016:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 71us (121us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779961.988603:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:2.0:1787779961.988638:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04812aa580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881590016:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787779961.988881:0:13792:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04812aa580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f575176-36bc-4786-83ee-2fea064a12a9:13792:1874622881590144:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787779961.988917:0:13792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779961.988935:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881590144 00000100:00100000:2.0:1787779961.988939:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881590144 00000100:00100000:2.0:1787779961.988969:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:2.0:1787779961.988976:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046098e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+22:13792:x1874622881590144:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787779961.989044:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046098e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+22:13792:x1874622881590144:12345-0@lo:502:llog_process_th.0 Request processed in 68us (126us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779961.989051:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:2.0:1787779961.989077:0:13792:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c044133ab40 going to sleep for 11 seconds 00000100:00100000:2.0:1787779961.989089:0:13792:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04812aa580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f575176-36bc-4786-83ee-2fea064a12a9:13792:1874622881590144:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787779961.989109:0:13792:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787779961.989117:0:13792:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787779961.989120:0:13792:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787779961.989127:0:13792:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c046ecd6000 00000020:00000080:2.0:1787779961.989129:0:13792:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787779961.989179:0:13792:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787779961.989182:0:13792:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787779961.989183:0:13792:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787779961.989186:0:13792:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787779961.989189:0:13792:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787779961.989190:0:13792:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1787779961.989193:0:13792:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c046ecd6000 00000020:00000080:2.0:1787779961.989195:0:13792:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787779961.989223:0:13792:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04812aa580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f575176-36bc-4786-83ee-2fea064a12a9:13792:1874622881590272:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787779961.989252:0:13792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779961.989268:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881590272 00000100:00100000:2.0:1787779961.989271:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881590272 00000100:00100000:2.0:1787779961.989290:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:2.0:1787779961.989296:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046098fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+22:13792:x1874622881590272:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787779961.989351:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046098fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+22:13792:x1874622881590272:12345-0@lo:502:llog_process_th.0 Request processed in 55us (98us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779961.989357:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:2.0:1787779961.989386:0:13792:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c044133ab40 going to sleep for 11 seconds 00000100:00100000:2.0:1787779961.989396:0:13792:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04812aa580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f575176-36bc-4786-83ee-2fea064a12a9:13792:1874622881590272:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787779961.989412:0:13792:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787779961.989415:0:13792:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787779961.989416:0:13792:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1787779961.989419:0:13792:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1787779961.989463:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:2.0:1787779961.989477:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787779961.989485:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c0346dd6400/0xc8fc0a5179960933 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a517996093a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779961.989494:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff9c0346dd6400/0xc8fc0a5179960933 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a517996093a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787779961.989503:0:6509:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787779961.989505:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c04764fa000 from 7 10000000:01000000:2.0:1787779961.989508:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787779961.989524:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c0477a70800/0xc8fc0a5179960941 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779961.989531:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff9c0477a70800/0xc8fc0a5179960941 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779961.989539:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff9c0477a70800/0xc8fc0a5179960941 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779961.989550:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04812aa580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881590400:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787779961.989573:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779961.989584:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0443d6e480 going to sleep for 11 seconds 00000100:00100000:2.0:1787779961.989594:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881590400 00000100:00100000:2.0:1787779961.989602:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881590400 00000100:00100000:2.0:1787779961.989621:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:2.0:1787779961.989627:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046098ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+22:6509:x1874622881590400:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787779961.989634:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787779961.989643:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0477a70400/0xc8fc0a5179960948 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc8fc0a5179960941 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779961.989661:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0477a70400/0xc8fc0a5179960948 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc8fc0a5179960941 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779961.989670:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0477a70400/0xc8fc0a5179960948 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a5179960941 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779961.989677:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0477a70400, rc 0) 00000100:00100000:2.0:1787779961.989703:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046098ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+23:6509:x1874622881590400:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 76us (129us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779961.989708:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:2.0:1787779961.989733:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04812aa580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881590400:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787779961.989744:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff9c0477a70800/0xc8fc0a5179960941 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a5179960948 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779961.989752:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff9c0477a70800/0xc8fc0a5179960941 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc8fc0a5179960948 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779961.989788:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04812aa580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881590528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787779961.989811:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779961.989821:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0443d6e480 going to sleep for 11 seconds 00000100:00100000:2.0:1787779961.989831:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881590528 00000100:00100000:2.0:1787779961.989866:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881590528 00000100:00100000:2.0:1787779961.989887:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:2.0:1787779961.989892:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046098f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+23:6509:x1874622881590528:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787779961.989974:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046098f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+23:6509:x1874622881590528:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 81us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779961.989980:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00100000:2.0:1787779961.990007:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04812aa580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881590528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787779961.990030:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04812aa580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881590656:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787779961.990063:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779961.990076:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0443d6e480 going to sleep for 11 seconds 00000100:00100000:2.0:1787779961.990088:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881590656 00000100:00100000:2.0:1787779961.990091:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881590656 00000100:00100000:2.0:1787779961.990113:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:2.0:1787779961.990119:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046098e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+23:6509:x1874622881590656:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787779961.990184:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046098e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+23:6509:x1874622881590656:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 64us (120us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779961.990190:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:2.0:1787779961.990223:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04812aa580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881590656:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787779961.990439:0:13793:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04812aa580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f575176-36bc-4786-83ee-2fea064a12a9:13793:1874622881590784:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787779961.990472:0:13793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779961.990490:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881590784 00000100:00100000:2.0:1787779961.990494:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881590784 00000100:00100000:2.0:1787779961.990514:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:2.0:1787779961.990520:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046098c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+23:13793:x1874622881590784:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787779961.990581:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046098c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+23:13793:x1874622881590784:12345-0@lo:502:llog_process_th.0 Request processed in 60us (108us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779961.990594:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00000100:00100000:2.0:1787779961.990621:0:13793:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0443d6e9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787779961.990634:0:13793:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04812aa580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f575176-36bc-4786-83ee-2fea064a12a9:13793:1874622881590784:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787779961.990653:0:13793:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787779961.990659:0:13793:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787779961.990661:0:13793:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787779961.990667:0:13793:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c04764fa000 00000020:00000080:2.0:1787779961.990669:0:13793:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787779961.990706:0:13793:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787779961.990710:0:13793:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787779961.990711:0:13793:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787779961.990714:0:13793:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787779961.990717:0:13793:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787779961.990718:0:13793:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1787779961.990722:0:13793:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c04764fa000 00000020:00000080:2.0:1787779961.990724:0:13793:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787779961.990754:0:13793:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04812aa580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f575176-36bc-4786-83ee-2fea064a12a9:13793:1874622881590912:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787779961.990788:0:13793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779961.990807:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881590912 00000100:00100000:2.0:1787779961.990811:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881590912 00000100:00100000:2.0:1787779961.990833:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:2.0:1787779961.990863:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046098d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+23:13793:x1874622881590912:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787779961.990925:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046098d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+23:13793:x1874622881590912:12345-0@lo:502:llog_process_th.0 Request processed in 84us (136us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779961.990930:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:2.0:1787779961.990954:0:13793:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0443d6e9c0 going to sleep for 11 seconds 00000040:00080000:3.0:1787779961.997697:0:13794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787779962.001069:0:13793:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04812aa580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f575176-36bc-4786-83ee-2fea064a12a9:13793:1874622881590912:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787779962.001208:0:13793:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787779962.001217:0:13793:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787779962.001219:0:13793:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1787779962.001224:0:13793:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1787779962.010663:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:3.0:1787779962.011424:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787779962.011439:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c0477a70800/0xc8fc0a5179960941 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a5179960948 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779962.011452:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff9c0477a70800/0xc8fc0a5179960941 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a5179960948 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787779962.013745:0:6509:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787779962.013749:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c044407a000 from 7 10000000:01000000:3.0:1787779962.013752:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787779962.013794:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c0440030200/0xc8fc0a517996094f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779962.013806:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff9c0440030200/0xc8fc0a517996094f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779962.013863:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff9c0440030200/0xc8fc0a517996094f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779962.013889:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347c35e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881591040:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787779962.013975:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779962.014015:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0346cc9840 going to sleep for 11 seconds 00010000:00010000:3.0:1787779962.014071:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787779962.018067:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881591040 00000100:00100000:2.0:1787779962.018082:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881591040 00000100:00100000:2.0:1787779962.018165:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00000100:00100000:2.0:1787779962.018175:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046098cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+23:6509:x1874622881591040:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787779962.018194:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787779962.018213:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0477a71e00/0xc8fc0a5179960956 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xc8fc0a517996094f expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779962.018243:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0477a71e00/0xc8fc0a5179960956 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc8fc0a517996094f expref: 24 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779962.018254:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0477a71e00/0xc8fc0a5179960956 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a517996094f expref: 24 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779962.018261:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0477a71e00, rc 0) 00000100:00100000:2.0:1787779962.018576:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046098cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+24:6509:x1874622881591040:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 401us (4599us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779962.018582:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00000100:00100000:3.0:1787779962.018713:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347c35e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881591040:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787779962.018729:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff9c0440030200/0xc8fc0a517996094f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a5179960956 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779962.018739:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff9c0440030200/0xc8fc0a517996094f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc8fc0a5179960956 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779962.018813:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347c35e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881591168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787779962.018885:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779962.018915:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0346cc9840 going to sleep for 11 seconds 00000100:00100000:2.0:1787779962.019934:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881591168 00000100:00100000:2.0:1787779962.019943:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881591168 00000100:00100000:2.0:1787779962.019994:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:2.0:1787779962.020003:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046098dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+24:6509:x1874622881591168:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787779962.020141:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046098dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+24:6509:x1874622881591168:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 140us (1256us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779962.020165:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:2.0:1787779962.020205:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347c35e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881591168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787779962.020240:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04812aa580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881591296:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787779962.020278:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779962.020294:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0341ce8000 going to sleep for 11 seconds 00000100:00100000:2.0:1787779962.020306:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881591296 00000100:00100000:2.0:1787779962.020539:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881591296 00000100:00100000:2.0:1787779962.020567:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:2.0:1787779962.020573:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046082b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+24:6509:x1874622881591296:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787779962.020646:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046082b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+24:6509:x1874622881591296:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 72us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779962.020653:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00000100:00100000:2.0:1787779962.020692:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04812aa580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f575176-36bc-4786-83ee-2fea064a12a9:6509:1874622881591296:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787779962.021022:0:13796:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04812aa580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f575176-36bc-4786-83ee-2fea064a12a9:13796:1874622881591424:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787779962.021058:0:13796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779962.021078:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881591424 00000100:00100000:2.0:1787779962.021081:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881591424 00000100:00100000:2.0:1787779962.021102:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:2.0:1787779962.021169:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0460828850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+24:13796:x1874622881591424:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787779962.021240:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0460828850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+24:13796:x1874622881591424:12345-0@lo:502:llog_process_th.0 Request processed in 131us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779962.021247:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00100000:2.0:1787779962.021277:0:13796:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0341ce8cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787779962.021288:0:13796:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04812aa580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f575176-36bc-4786-83ee-2fea064a12a9:13796:1874622881591424:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787779962.022144:0:13796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787779962.022156:0:13796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787779962.022159:0:13796:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787779962.022171:0:13796:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c044407a000 00000020:00000080:3.0:1787779962.022173:0:13796:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787779962.022233:0:13796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787779962.022237:0:13796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787779962.022239:0:13796:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787779962.022242:0:13796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787779962.022245:0:13796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787779962.022246:0:13796:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1787779962.022259:0:13796:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c044407a000 00000020:00000080:3.0:1787779962.022261:0:13796:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787779962.022307:0:13796:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347c36d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f575176-36bc-4786-83ee-2fea064a12a9:13796:1874622881591552:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787779962.022369:0:13796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779962.022385:0:13796:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0346cc9300 going to sleep for 11 seconds 00000100:00100000:2.0:1787779962.025576:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881591552 00000100:00100000:2.0:1787779962.025592:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881591552 00000100:00100000:2.0:1787779962.025653:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 375 00000100:00100000:2.0:1787779962.025664:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0448bf3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+24:13796:x1874622881591552:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787779962.025821:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0448bf3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+24:13796:x1874622881591552:12345-0@lo:502:llog_process_th.0 Request processed in 158us (3450us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779962.025861:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 375 00000100:00100000:3.0:1787779962.026366:0:13796:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347c36d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f575176-36bc-4786-83ee-2fea064a12a9:13796:1874622881591552:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787779962.026401:0:13796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787779962.026409:0:13796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787779962.026411:0:13796:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1787779962.026418:0:13796:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1787779962.026562:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:3.0:1787779962.026586:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787779962.026596:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c0440030200/0xc8fc0a517996094f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a5179960956 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779962.026607:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff9c0440030200/0xc8fc0a517996094f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a5179960956 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787779962.050167:0:13797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787779962.652310:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787779962.652337:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04812aa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881591680:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787779962.652415:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779962.652592:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881591680 00000100:00100000:2.0:1787779962.652600:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881591680 00000100:00100000:2.0:1787779962.652648:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1787779962.652658:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347dac3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881591680:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787779962.652688:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787779962.652742:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347dac3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881591680:12345-0@lo:41:osp-pre-0-1.0 Request processed in 86us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779962.652749:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1787779962.653682:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04812aa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881591680:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1787779963.036262:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787779963.036923:0:13794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1787779963.100521:0:13797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787779963.164300:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787779963.164326:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04812a8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881591808:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787779963.164397:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779963.164529:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881591808 00000100:00100000:2.0:1787779963.164536:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881591808 00000100:00100000:2.0:1787779963.164593:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1787779963.164604:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347c36d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881591808:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787779963.164639:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787779963.164704:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347c36d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881591808:12345-0@lo:41:osp-pre-1-0.0 Request processed in 101us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779963.164711:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1787779963.165046:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04812a8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881591808:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787779964.060040:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787779965.089138:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787779965.212859:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347daf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881591936:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787779965.212970:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779965.213114:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881591936 00000100:00100000:1.0:1787779965.213123:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881591936 00000100:00100000:1.0:1787779965.213193:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1787779965.213203:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347e5a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881591936:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787779965.213245:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787779965.213313:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347e5a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881591936:12345-0@lo:13:osp-pre-1-1.0 Request processed in 112us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779965.213321:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00080000:0.0:1787779965.213444:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787779965.213486:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347daf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881591936:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787779965.214628:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347c370c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1874622881592192:0@lo:400:kworker.0 00000100:00100000:3.0:1787779965.214690:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779965.214726:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347c37840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1874622881592704:0@lo:400:kworker.0 00000100:00100000:3.0:1787779965.214752:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779965.214780:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347c361c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1f575176-36bc-4786-83ee-2fea064a12a9:3642:1874622881592064:0@lo:400:kworker.0 00000100:00100000:3.0:1787779965.214809:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347c34780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1874622881593216:0@lo:400:kworker.0 00000100:00100000:3.0:1787779965.214877:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779965.214948:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1787779965.214957:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779965.214959:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347c352c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881592320:0@lo:400:kworker.0 00000100:00100000:0.0:1787779965.214964:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347c34b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874622881592448:0@lo:400:kworker.0 00000100:00100000:1.0:1787779965.215076:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881592192 00000100:00100000:1.0:1787779965.215094:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881592192 00000100:00100000:1.0:1787779965.215145:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881592704 00000100:00100000:1.0:1787779965.215148:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881592704 00000100:00100000:1.0:1787779965.215173:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881593216 00000100:00100000:1.0:1787779965.215175:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881593216 00000100:00100000:1.0:1787779965.215191:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1787779965.215199:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347c37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1874622881592192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787779965.215620:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779965.215653:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347c343c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881592960:0@lo:400:kworker.0 00000100:00100000:0.0:1787779965.215679:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779965.215697:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347c35a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881593472:0@lo:400:kworker.0 00000100:00100000:0.0:1787779965.215714:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779965.215748:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881592448 00000100:00100000:0.0:1787779965.215751:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881592448 00000100:00100000:0.0:1787779965.215773:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1787779965.215780:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347c35e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1874622881592704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787779965.215814:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347c35e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1874622881592704:12345-0@lo:400:kworker.0 Request processed in 34us (1061us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779965.215822:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1787779965.215861:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1787779965.215867:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346cfe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1874622881593216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787779965.215890:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346cfe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1874622881593216:12345-0@lo:400:kworker.0 Request processed in 24us (1013us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779965.215896:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1787779965.215907:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1787779965.215913:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347e5ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874622881592448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787779965.215964:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347e5ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874622881592448:12345-0@lo:400:kworker.0 Request processed in 51us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779965.215970:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00080000:0.0:1787779965.216042:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787779965.216078:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347c34b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874622881592448:0@lo:400:kworker.0 00000100:00100000:0.0:1787779965.216147:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881592960 00000100:00100000:0.0:1787779965.216151:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881592960 00000100:00100000:0.0:1787779965.216184:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881593472 00000100:00100000:0.0:1787779965.216194:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881593472 00000100:00100000:0.0:1787779965.216220:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1787779965.216226:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347e58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881592960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787779965.216264:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347e58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881592960:12345-0@lo:400:kworker.0 Request processed in 38us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779965.216270:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1787779965.216282:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1787779965.216287:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347e59e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3641:x1874622881593472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787779965.218721:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347e59e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3641:x1874622881593472:12345-0@lo:400:kworker.0 Request processed in 2424us (2996us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779965.218739:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00080000:0.0:1787779965.218791:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787779965.218797:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787779965.218852:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0347c343c0 x1874622881592960/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779981 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787779965.218868:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347c343c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881592960:0@lo:400:kworker.0 00000100:00100000:0.0:1787779965.218884:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347c35a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881593472:0@lo:400:kworker.0 00000100:00100000:0.0:1787779965.218975:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881592064 00000100:00100000:0.0:1787779965.218982:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881592064 00000100:00100000:0.0:1787779965.219036:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:0.0:1787779965.219046:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c045ab81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+24:3642:x1874622881592064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787779965.219083:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c045ab81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+24:3642:x1874622881592064:12345-0@lo:400:kworker.0 Request processed in 39us (4155us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779965.219088:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00100000:2.0:1787779965.223417:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347c361c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1f575176-36bc-4786-83ee-2fea064a12a9:3642:1874622881592064:0@lo:400:kworker.0 00000100:00100000:2.0:1787779965.223436:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347c36940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881592576:0@lo:400:kworker.0 00000100:00100000:2.0:1787779965.223499:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779965.223537:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347c34f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881593088:0@lo:400:kworker.0 00000100:00100000:2.0:1787779965.223562:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779965.223600:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881593088 00000100:00100000:2.0:1787779965.223604:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881593088 00000100:00100000:0.0:1787779965.223964:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881592576 00000100:00100000:0.0:1787779965.223978:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881592576 00000100:00100000:0.0:1787779965.224068:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1787779965.224079:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04812a8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1874622881592576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787779965.224182:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04812a8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1874622881592576:12345-0@lo:400:kworker.0 Request processed in 105us (682us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779965.224189:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00080000:0.0:1787779965.224243:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787779965.227607:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1787779965.227632:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04812a8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3642:x1874622881593088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779965.227728:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04812a8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3642:x1874622881593088:12345-0@lo:400:kworker.0 Request processed in 110us (4165us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779965.227736:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00010000:00080000:2.0:1787779965.227791:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0347c34f00 x1874622881593088/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779981 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787779965.227805:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347c34f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881593088:0@lo:400:kworker.0 00000100:00100000:2.0:1787779965.227858:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347c36940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881592576:0@lo:400:kworker.0 00000100:00100000:3.0:1787779965.228232:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779965.228287:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347c35680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1874622881592832:0@lo:400:kworker.0 00000100:00100000:3.0:1787779965.228360:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779965.228404:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881592832 00000100:00100000:3.0:1787779965.228412:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881592832 00000100:00100000:3.0:1787779965.228471:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1787779965.228480:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0348834000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1874622881592832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779965.228527:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0348834000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1874622881592832:12345-0@lo:400:kworker.0 Request processed in 48us (166us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779965.228534:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00080000:3.0:1787779965.228559:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1787779965.228584:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0347c35680 x1874622881592832/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779981 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779965.228598:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347c35680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1874622881592832:0@lo:400:kworker.0 00000100:00100000:3.0:1787779965.228606:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347c36580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1874622881593344:0@lo:400:kworker.0 00000100:00100000:3.0:1787779965.228630:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779965.228655:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881593344 00000100:00100000:3.0:1787779965.228659:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881593344 00000100:00100000:3.0:1787779965.228689:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1787779965.228695:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0348836d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1874622881593344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779965.228727:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0348836d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1874622881593344:12345-0@lo:400:kworker.0 Request processed in 32us (95us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779965.228745:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00080000:3.0:1787779965.228764:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1787779965.228780:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0347c36580 x1874622881593344/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779981 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779965.228789:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347c36580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1874622881593344:0@lo:400:kworker.0 00000100:00100000:3.0:1787779965.228804:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347c37840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1874622881592704:0@lo:400:kworker.0 00000100:00100000:3.0:1787779965.228819:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347c34780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1874622881593216:0@lo:400:kworker.0 00000100:00100000:2.0:1787779965.230109:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881592320 00000100:00100000:2.0:1787779965.230121:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881592320 00000100:00100000:2.0:1787779965.230306:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1787779965.230318:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346dac780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881592320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779965.230421:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346dac780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881592320:12345-0@lo:400:kworker.0 Request processed in 105us (2204us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779965.230429:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1787779965.232111:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347c352c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881592320:0@lo:400:kworker.0 00000100:00100000:1.0:1787779965.242728:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347c37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1874622881592192:12345-0@lo:400:kworker.0 Request processed in 27513us (28022us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779965.242745:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1787779965.242902:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347c370c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1874622881592192:0@lo:400:kworker.0 00000100:00100000:1.0:1787779965.725298:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787779965.725333:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347e5a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881593600:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787779965.725436:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779965.725652:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c03488361c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881593728:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787779965.725688:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779965.726105:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881593600 00000100:00100000:2.0:1787779965.726119:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881593600 00000100:00100000:2.0:1787779965.726217:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881593728 00000100:00100000:2.0:1787779965.726221:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881593728 00000100:00100000:2.0:1787779965.726242:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1787779965.726252:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347dae580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3641:x1874622881593600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787779965.726283:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787779965.726356:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347dae580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3641:x1874622881593600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (920us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779965.726364:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1787779965.726384:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1787779965.726390:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347e5b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881593728:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787779965.726407:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347e5a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881593600:0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787779965.726410:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787779965.726441:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347e5b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881593728:12345-0@lo:13:osp-pre-0-1.0 Request processed in 51us (752us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779965.726448:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00010000:00080000:1.0:1787779965.726462:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c03488361c0 x1874622881593728/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779981 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787779965.726478:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c03488361c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881593728:0@lo:13:osp-pre-0-1.0 00000001:00080000:2.0:1787779965.734666:0:9508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00010000:00010000:0.0:1787779966.109684:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787779966.240053:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787779966.240098:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c03488370c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881593856:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787779966.240211:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779966.240731:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881593856 00000100:00100000:3.0:1787779966.240743:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881593856 00000100:00100000:3.0:1787779966.240816:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1787779966.240829:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04812a9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881593856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787779966.240881:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787779966.240957:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04812a9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881593856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 131us (746us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779966.240965:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00010000:00080000:1.0:1787779966.241407:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c03488370c0 x1874622881593856/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779982 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787779966.241433:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c03488370c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881593856:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787779966.870222:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787779966.870271:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787779966.870322:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787779966.870361:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787779966.870381:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787779966.870402:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787779966.871023:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863669632 00000100:00100000:3.0:1787779966.871037:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863669632 00000100:00100000:3.0:1787779966.871120:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863670144 00000100:00100000:3.0:1787779966.871124:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863670144 00000100:00100000:3.0:1787779966.871141:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863669760 00000100:00100000:3.0:1787779966.871144:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863669760 00000100:00100000:3.0:1787779966.871176:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863670016 00000100:00100000:3.0:1787779966.871179:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863670016 00000100:00100000:3.0:1787779966.871229:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 271 00000100:00100000:3.0:1787779966.871242:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347dada40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:2410:x1874622863669632:12345-192.168.203.31@tcp:400:kworker.0 00000100:00080000:0.0:1787779966.871616:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787779966.871623:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787779966.871667:0:12488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 272 00000100:00100000:0.0:1787779966.871677:0:12488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347dafc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+5:2410:x1874622863670144:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1787779966.871740:0:12488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347dafc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+5:2410:x1874622863670144:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 65us (1376us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779966.871748:0:12488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 272 00000100:00100000:0.0:1787779966.871773:0:12488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 273 00000100:00100000:0.0:1787779966.871779:0:12488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347dade00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:2411:x1874622863669760:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1787779966.871805:0:12488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347dade00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:2411:x1874622863669760:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 27us (1424us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779966.871811:0:12488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 273 00000100:00100000:0.0:1787779966.871821:0:12488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 274 00000100:00100000:0.0:1787779966.871827:0:12488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347dac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+5:2411:x1874622863670016:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1787779966.871910:0:12488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347dac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+5:2411:x1874622863670016:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 82us (1506us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779966.871937:0:12488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 274 00000100:00100000:0.0:1787779966.871962:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863669504 00000100:00100000:0.0:1787779966.871968:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863669504 00000100:00100000:0.0:1787779966.872000:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 377 00000100:00100000:0.0:1787779966.872007:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c045ab83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+13:2411:x1874622863669504:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1787779966.872034:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c045ab83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+13:2411:x1874622863669504:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 29us (1712us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779966.872040:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 377 00000100:00100000:3.0:1787779966.872984:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347dada40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:2410:x1874622863669632:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 1737us (2785us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779966.872995:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 271 00000100:00100000:2.0:1787779966.874106:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863669888 00000100:00100000:2.0:1787779966.874120:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863669888 00000100:00100000:2.0:1787779966.874207:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 116 00000100:00100000:2.0:1787779966.874219:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347daf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:2410:x1874622863669888:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1787779966.874313:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347daf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:2410:x1874622863669888:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 96us (4040us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779966.874321:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 116 00000100:00080000:3.0:1787779966.874600:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1787779967.132031:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787779967.772262:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347daed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881593984:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787779967.772375:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779967.772672:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881593984 00000100:00100000:0.0:1787779967.772682:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881593984 00000100:00100000:0.0:1787779967.772754:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1787779967.772765:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03488352c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881593984:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787779967.772810:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787779967.773988:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03488352c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881593984:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1217us (1606us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779967.774002:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1787779967.774099:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347daed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881593984:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787779968.156833:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787779968.287317:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04812a8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881594112:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787779968.287428:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779968.289240:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881594112 00000100:00100000:2.0:1787779968.289282:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881594112 00000100:00100000:2.0:1787779968.289377:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1787779968.289390:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0348834b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1874622881594112:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787779968.289440:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787779968.289557:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0348834b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1874622881594112:12345-0@lo:41:osp-pre-1-0.0 Request processed in 170us (2131us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779968.289565:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1787779968.289704:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04812a8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881594112:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1787779969.187924:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787779970.205818:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787779970.333240:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348835680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881594496:0@lo:400:kworker.0 00000100:00100000:3.0:1787779970.333371:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779970.333443:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348836580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1874622881595008:0@lo:400:kworker.0 00000100:00100000:3.0:1787779970.333473:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779970.333497:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348835e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1874622881595520:0@lo:400:kworker.0 00000100:00100000:3.0:1787779970.333520:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779970.333553:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1787779970.333559:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c03488343c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874622881594624:0@lo:400:kworker.0 00000100:00100000:3.0:1787779970.333582:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779970.333600:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348835a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881595136:0@lo:400:kworker.0 00000100:00100000:3.0:1787779970.333638:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779970.333665:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c03488370c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881595648:0@lo:400:kworker.0 00000100:00100000:3.0:1787779970.333687:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779970.333799:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348836940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1f575176-36bc-4786-83ee-2fea064a12a9:3643:1874622881594240:0@lo:400:kworker.0 00000100:00100000:2.0:1787779970.333877:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779970.333912:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348834f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881594752:0@lo:400:kworker.0 00000100:00100000:2.0:1787779970.333940:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779970.333956:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348837480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881595264:0@lo:400:kworker.0 00000100:00100000:2.0:1787779970.333977:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779970.333995:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c03488361c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881595776:0@lo:400:kworker.0 00000100:00100000:2.0:1787779970.334018:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779970.334035:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1787779970.334041:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348837840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1874622881594368:0@lo:400:kworker.0 00000100:00100000:2.0:1787779970.334064:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779970.334079:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348834780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1874622881594880:0@lo:400:kworker.0 00000100:00100000:2.0:1787779970.334100:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779970.334114:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348837c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1874622881595392:0@lo:400:kworker.0 00000100:00100000:2.0:1787779970.334132:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779970.334159:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881594496 00000100:00100000:2.0:1787779970.334167:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881594496 00000100:00100000:2.0:1787779970.334225:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881594752 00000100:00100000:2.0:1787779970.334228:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881594752 00000100:00100000:2.0:1787779970.334249:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1787779970.334258:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0348801680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881594496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779970.334328:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0348801680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881594496:12345-0@lo:400:kworker.0 Request processed in 70us (957us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779970.334335:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1787779970.334355:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1787779970.334362:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04812aa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881594752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779970.334396:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04812aa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881594752:12345-0@lo:400:kworker.0 Request processed in 34us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779970.334403:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1787779970.334425:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881595136 00000100:00100000:2.0:1787779970.334428:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881595136 00000100:00100000:2.0:1787779970.334462:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881595648 00000100:00100000:2.0:1787779970.334465:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881595648 00000100:00100000:2.0:1787779970.334477:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881595264 00000100:00100000:2.0:1787779970.334480:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881595264 00000100:00100000:2.0:1787779970.334493:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881595776 00000100:00100000:2.0:1787779970.334496:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881595776 00000100:00100000:2.0:1787779970.334509:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1787779970.334515:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0348802580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881595136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779970.334561:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0348802580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881595136:12345-0@lo:400:kworker.0 Request processed in 45us (921us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779970.334568:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1787779970.334580:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1787779970.334586:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0348801a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881595648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779970.334613:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0348801a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881595648:12345-0@lo:400:kworker.0 Request processed in 27us (924us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779970.334625:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1787779970.334637:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1787779970.334643:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04812ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881595264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779970.334673:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04812ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881595264:12345-0@lo:400:kworker.0 Request processed in 30us (695us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779970.334678:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1787779970.334688:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1787779970.334694:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04812a8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881595776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779970.334720:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04812a8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881595776:12345-0@lo:400:kworker.0 Request processed in 27us (701us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779970.334726:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00080000:2.0:1787779970.334750:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787779970.334755:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787779970.334791:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348834f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881594752:0@lo:400:kworker.0 00010000:00080000:2.0:1787779970.334806:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0348837480 x1874622881595264/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779986 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787779970.334818:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348837480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881595264:0@lo:400:kworker.0 00000100:00100000:2.0:1787779970.334827:0:3643:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:2.0:1787779970.334834:0:3643:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c0346efe580, transno 4294967301 00000100:00100000:2.0:1787779970.334876:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c03488361c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881595776:0@lo:400:kworker.0 00010000:00080000:2.0:1787779970.334931:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0348835a40 x1874622881595136/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779986 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787779970.334941:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348835a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881595136:0@lo:400:kworker.0 00000100:00100000:2.0:1787779970.334965:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c03488370c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881595648:0@lo:400:kworker.0 00000100:00100000:2.0:1787779970.334975:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348835680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881594496:0@lo:400:kworker.0 00000100:00100000:0.0:1787779970.335230:0:12488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881595008 00000100:00100000:0.0:1787779970.335237:0:12488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881595008 00000100:00100000:0.0:1787779970.335287:0:12488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881595520 00000100:00100000:0.0:1787779970.335291:0:12488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881595520 00000100:00100000:0.0:1787779970.335308:0:12488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881594624 00000100:00100000:0.0:1787779970.335310:0:12488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881594624 00000100:00100000:0.0:1787779970.335320:0:12488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881594368 00000100:00100000:0.0:1787779970.335322:0:12488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881594368 00000100:00100000:0.0:1787779970.335331:0:12488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881594880 00000100:00100000:0.0:1787779970.335334:0:12488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881594880 00000100:00100000:0.0:1787779970.335347:0:12488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881595392 00000100:00100000:0.0:1787779970.335357:0:12488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881595392 00000100:00100000:0.0:1787779970.335379:0:12488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1787779970.335386:0:12488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03488003c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1874622881595008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787779970.335443:0:12488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03488003c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1874622881595008:12345-0@lo:400:kworker.0 Request processed in 58us (1969us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779970.335450:0:12488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1787779970.335466:0:12488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1787779970.335472:0:12488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0348800f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1874622881595520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787779970.335501:0:12488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0348800f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1874622881595520:12345-0@lo:400:kworker.0 Request processed in 30us (1980us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779970.335507:0:12488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1787779970.335518:0:12488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:0.0:1787779970.335525:0:12488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0348800780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874622881594624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787779970.335553:0:12488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0348800780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874622881594624:12345-0@lo:400:kworker.0 Request processed in 29us (1970us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779970.335559:0:12488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:0.0:1787779970.335570:0:12488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1787779970.335576:0:12488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0476494f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1874622881594368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787779970.335610:0:12488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0476494f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1874622881594368:12345-0@lo:400:kworker.0 Request processed in 35us (1545us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779970.335627:0:12488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1787779970.335638:0:12488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:0.0:1787779970.335644:0:12488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0476496d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1874622881594880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787779970.335673:0:12488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0476496d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1874622881594880:12345-0@lo:400:kworker.0 Request processed in 29us (1572us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779970.335689:0:12488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:0.0:1787779970.335702:0:12488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:0.0:1787779970.335708:0:12488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04764943c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1874622881595392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787779970.335737:0:12488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04764943c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1874622881595392:12345-0@lo:400:kworker.0 Request processed in 30us (1604us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779970.335743:0:12488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:0.0:1787779970.335806:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348837840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1874622881594368:0@lo:400:kworker.0 00000100:00100000:0.0:1787779970.335817:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348834780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1874622881594880:0@lo:400:kworker.0 00000100:00100000:0.0:1787779970.335827:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348837c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1874622881595392:0@lo:400:kworker.0 00000100:00100000:0.0:1787779970.335883:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c03488343c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874622881594624:0@lo:400:kworker.0 00010000:00080000:0.0:1787779970.335895:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0348836580 x1874622881595008/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779986 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787779970.335916:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348836580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1874622881595008:0@lo:400:kworker.0 00010000:00080000:0.0:1787779970.335927:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0348835e00 x1874622881595520/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779986 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787779970.335936:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348835e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1874622881595520:0@lo:400:kworker.0 00000100:00100000:3.0:1787779970.336090:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881594240 00000100:00100000:3.0:1787779970.336096:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881594240 00000100:00100000:3.0:1787779970.336141:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:3.0:1787779970.336158:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0478612050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+24:3643:x1874622881594240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779970.336202:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0478612050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+24:3643:x1874622881594240:12345-0@lo:400:kworker.0 Request processed in 46us (2325us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779970.336209:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00100000:1.0:1787779970.337151:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347dae1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881595904:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787779970.337210:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779970.337266:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881595904 00000100:00100000:1.0:1787779970.337272:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881595904 00000100:00100000:1.0:1787779970.337313:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1787779970.337321:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347daf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881595904:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787779970.337347:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787779970.337387:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347daf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881595904:12345-0@lo:13:osp-pre-1-1.0 Request processed in 67us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779970.337393:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1787779970.337440:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347dae1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881595904:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1787779970.338305:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787779970.338314:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787779970.338419:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348836940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1f575176-36bc-4786-83ee-2fea064a12a9:3643:1874622881594240:0@lo:400:kworker.0 00000100:00100000:3.0:1787779970.845317:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787779970.845355:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348803480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874622881596032:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787779970.845456:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779970.845548:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881596032 00000100:00100000:3.0:1787779970.845558:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881596032 00000100:00100000:3.0:1787779970.845626:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1787779970.845638:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0348803c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1874622881596032:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787779970.845679:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787779970.845724:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787779970.845739:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347e59680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881596160:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787779970.845744:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0348803c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1874622881596032:12345-0@lo:13:osp-pre-0-1.0 Request processed in 106us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779970.845753:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1787779970.845788:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1787779970.845804:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0348803480 x1874622881596032/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779986 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787779970.845827:0:8529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881596160 00000100:00100000:3.0:1787779970.845858:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348803480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874622881596032:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787779970.845874:0:8529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881596160 00000100:00100000:3.0:1787779970.845919:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1787779970.845932:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347e583c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874622881596160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787779970.845943:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787779970.845986:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347e583c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874622881596160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779970.846080:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347e59680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881596160:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787779970.848940:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00010000:00010000:1.0:1787779971.228113:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787779971.357068:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348803480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881596288:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787779971.357168:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779971.357327:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881596288 00000100:00100000:1.0:1787779971.357337:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881596288 00000100:00100000:1.0:1787779971.357417:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1787779971.357430:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347e58f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881596288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787779971.357461:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787779971.359106:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347e58f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881596288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1667us (1927us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779971.359124:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00010000:00080000:0.0:1787779971.364862:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0348803480 x1874622881596288/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779987 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787779971.364918:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348803480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881596288:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787779971.990534:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787779971.990588:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787779971.990633:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787779971.990656:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787779971.990680:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787779971.990715:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787779971.990746:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863670656 00000100:00100000:3.0:1787779971.990759:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863670656 00000100:00100000:1.0:1787779971.990865:0:12488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863670528 00000100:00100000:3.0:1787779971.990867:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 121 00000100:00100000:3.0:1787779971.990881:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03488021c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:2411:x1874622863670656:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1787779971.990881:0:12488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863670528 00000100:00100000:1.0:1787779971.990937:0:12488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863670784 00000100:00100000:1.0:1787779971.990942:0:12488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863670784 00000100:00100000:1.0:1787779971.990958:0:12488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863670400 00000100:00100000:1.0:1787779971.990969:0:12488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863670400 00000100:00100000:1.0:1787779971.990988:0:12488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863670912 00000100:00100000:3.0:1787779971.990989:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03488021c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:2411:x1874622863670656:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 110us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779971.990991:0:12488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863670912 00000100:00100000:3.0:1787779971.991002:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 121 00000100:00100000:1.0:1787779971.991013:0:12488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 281 00000100:00100000:1.0:1787779971.991024:0:12488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0348801e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:2411:x1874622863670528:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1787779971.991050:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 282 00000100:00100000:3.0:1787779971.991061:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0348800000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+5:2411:x1874622863670784:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1787779971.991066:0:12488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0348801e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:2411:x1874622863670528:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 44us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779971.991075:0:12488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 281 00000100:00100000:1.0:1787779971.991095:0:12488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 283 00000100:00100000:3.0:1787779971.991102:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0348800000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+5:2411:x1874622863670784:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 43us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779971.991106:0:12488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0348802d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:2411:x1874622863670400:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1787779971.991116:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 282 00000100:00100000:3.0:1787779971.991138:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 284 00000100:00100000:1.0:1787779971.991144:0:12488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0348802d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:2411:x1874622863670400:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 39us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779971.991153:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03488030c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+5:2411:x1874622863670912:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1787779971.991158:0:12488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 283 00000100:00100000:3.0:1787779971.991190:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03488030c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+5:2411:x1874622863670912:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 41us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779971.991209:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 284 00000100:00080000:3.0:1787779971.991230:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787779971.991235:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787779971.991237:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787779971.991324:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863670272 00000100:00100000:0.0:1787779971.991329:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863670272 00000100:00100000:0.0:1787779971.991367:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 379 00000100:00100000:0.0:1787779971.991375:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0478610450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+13:2411:x1874622863670272:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1787779971.991405:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0478610450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+13:2411:x1874622863670272:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 31us (886us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779971.991411:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 379 00010000:00010000:0.0:1787779972.256003:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787779972.892615:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347dae1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881596416:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787779972.892698:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779972.893207:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881596416 00000100:00100000:3.0:1787779972.893215:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881596416 00000100:00100000:3.0:1787779972.893420:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1787779972.893430:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0476496940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881596416:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787779972.893462:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787779972.893537:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0476496940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881596416:12345-0@lo:41:osp-pre-0-1.0 Request processed in 109us (839us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779972.893544:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1787779972.893621:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347dae1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881596416:0@lo:41:osp-pre-0-1.0 00000040:00080000:3.0:1787779973.276684:0:13794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787779973.277293:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787779973.341002:0:13797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787779973.408474:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0476494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881596544:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787779973.408544:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779973.408710:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881596544 00000100:00100000:0.0:1787779973.408717:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881596544 00000100:00100000:0.0:1787779973.408810:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1787779973.408820:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347dad2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874622881596544:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787779973.408899:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787779973.408961:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347dad2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874622881596544:12345-0@lo:41:osp-pre-1-0.0 Request processed in 142us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779973.408967:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1787779973.409039:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0476494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881596544:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787779974.300380:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787779975.324438:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787779975.453501:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787779975.453528:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347dacb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881596672:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787779975.453604:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779975.456176:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881596672 00000100:00100000:3.0:1787779975.456192:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881596672 00000100:00080000:2.0:1787779975.456404:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787779975.456525:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1787779975.456541:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347e59680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881596672:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787779975.456624:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787779975.456715:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347e59680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881596672:12345-0@lo:13:osp-pre-1-1.0 Request processed in 181us (3109us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779975.456722:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1787779975.456947:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347dacb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881596672:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787779975.457093:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347dae1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1f575176-36bc-4786-83ee-2fea064a12a9:3643:1874622881596800:0@lo:400:kworker.0 00000100:00100000:2.0:1787779975.457148:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779975.457182:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347dacf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881597312:0@lo:400:kworker.0 00000100:00100000:2.0:1787779975.457210:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779975.457238:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477aed2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881597824:0@lo:400:kworker.0 00000100:00100000:1.0:1787779975.457248:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347dad680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1874622881597184:0@lo:400:kworker.0 00000100:00100000:2.0:1787779975.457263:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779975.457293:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347daf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881597056:0@lo:400:kworker.0 00000100:00100000:0.0:1787779975.457321:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779975.457340:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0461befc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1874622881597568:0@lo:400:kworker.0 00000100:00100000:0.0:1787779975.457363:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779975.457401:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477aee940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1874622881598080:0@lo:400:kworker.0 00000100:00100000:1.0:1787779975.457430:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779975.457448:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881597312 00000100:00100000:0.0:1787779975.457453:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881597312 00000100:00100000:1.0:1787779975.457463:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346efe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874622881597696:0@lo:400:kworker.0 00000100:00100000:0.0:1787779975.457483:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881597056 00000100:00100000:0.0:1787779975.457487:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881597056 00000100:00100000:1.0:1787779975.457500:0:12488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881597568 00000100:00100000:0.0:1787779975.457504:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1787779975.457506:0:12488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881597568 00000100:00100000:0.0:1787779975.457513:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0476497c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881597312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787779975.457547:0:12488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881597184 00000100:00100000:1.0:1787779975.457552:0:12488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881597184 00000100:00100000:0.0:1787779975.457552:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0476497c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881597312:12345-0@lo:400:kworker.0 Request processed in 40us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779975.457559:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1787779975.457576:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1787779975.457582:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347e5a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881597056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787779975.457591:0:12488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1787779975.457600:0:12488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347e5b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1874622881597568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787779975.457633:0:12488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347e5b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1874622881597568:12345-0@lo:400:kworker.0 Request processed in 35us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779975.457638:0:12488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1787779975.457652:0:12488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1787779975.457657:0:12488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477aed680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1874622881597184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787779975.457686:0:12488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477aed680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1874622881597184:12345-0@lo:400:kworker.0 Request processed in 28us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779975.457692:0:12488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1787779975.457717:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1787779975.457749:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0461befc00 x1874622881597568/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779991 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787779975.457760:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0461befc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1874622881597568:0@lo:400:kworker.0 00000100:00100000:0.0:1787779975.457769:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347e5a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881597056:12345-0@lo:400:kworker.0 Request processed in 186us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779975.457777:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1787779975.457782:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347daf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881597056:0@lo:400:kworker.0 00000100:00100000:1.0:1787779975.457806:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881598080 00000100:00100000:1.0:1787779975.457810:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881598080 00000100:00100000:0.0:1787779975.457821:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881596800 00000100:00100000:0.0:1787779975.457827:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881596800 00000100:00100000:1.0:1787779975.457878:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1787779975.457886:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477aec3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1874622881598080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787779975.457906:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:0.0:1787779975.457915:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0478611450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+24:3643:x1874622881596800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787779975.457945:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0478611450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+24:3643:x1874622881596800:12345-0@lo:400:kworker.0 Request processed in 32us (796us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779975.457957:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00000100:00100000:2.0:1787779975.458552:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347dae1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1f575176-36bc-4786-83ee-2fea064a12a9:3643:1874622881596800:0@lo:400:kworker.0 00000100:00100000:2.0:1787779975.458563:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347dacf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881597312:0@lo:400:kworker.0 00000100:00100000:2.0:1787779975.458579:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1787779975.458586:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347daed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1874622881596928:0@lo:400:kworker.0 00000100:00100000:2.0:1787779975.458614:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779975.458632:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347dacb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1874622881597440:0@lo:400:kworker.0 00000100:00100000:2.0:1787779975.458652:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779975.458682:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477aecb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1874622881597952:0@lo:400:kworker.0 00000100:00100000:3.0:1787779975.458702:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881596928 00000100:00100000:3.0:1787779975.458708:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881596928 00000100:00100000:2.0:1787779975.458726:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779975.458740:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881597824 00000100:00100000:0.0:1787779975.458746:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881597824 00000100:00100000:0.0:1787779975.458779:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1787779975.458787:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04764961c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881597824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787779975.458827:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04764961c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881597824:12345-0@lo:400:kworker.0 Request processed in 41us (1563us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779975.458833:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1787779975.458995:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881597440 00000100:00100000:3.0:1787779975.458999:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881597440 00000100:00100000:3.0:1787779975.459027:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881597952 00000100:00100000:3.0:1787779975.459031:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881597952 00000100:00100000:3.0:1787779975.459047:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:3.0:1787779975.459063:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0476494780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1874622881596928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779975.459098:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0476494780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1874622881596928:12345-0@lo:400:kworker.0 Request processed in 37us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779975.459105:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:3.0:1787779975.459117:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:3.0:1787779975.459123:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0476494000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1874622881597440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779975.459149:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0476494000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1874622881597440:12345-0@lo:400:kworker.0 Request processed in 27us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779975.459155:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:3.0:1787779975.459166:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:3.0:1787779975.459171:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0348836940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1874622881597952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779975.459193:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0348836940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1874622881597952:12345-0@lo:400:kworker.0 Request processed in 22us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779975.459198:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:3.0:1787779975.459244:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347daed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1874622881596928:0@lo:400:kworker.0 00000100:00100000:3.0:1787779975.459253:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347dacb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1874622881597440:0@lo:400:kworker.0 00000100:00100000:3.0:1787779975.459819:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477aecb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1874622881597952:0@lo:400:kworker.0 00010000:00080000:3.0:1787779975.459831:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0477aed2c0 x1874622881597824/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779991 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779975.459874:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477aed2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881597824:0@lo:400:kworker.0 00000100:00100000:3.0:1787779975.459931:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779975.459962:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477aef840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881598208:0@lo:400:kworker.0 00000100:00100000:3.0:1787779975.459994:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779975.460048:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347dad680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1874622881597184:0@lo:400:kworker.0 00000100:00100000:3.0:1787779975.460070:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881597696 00000100:00100000:3.0:1787779975.460074:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881597696 00000100:00100000:3.0:1787779975.460102:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881598208 00000100:00100000:3.0:1787779975.460105:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881598208 00000100:00100000:3.0:1787779975.460123:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1787779975.460130:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03488012c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1874622881597696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779975.460167:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03488012c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1874622881597696:12345-0@lo:400:kworker.0 Request processed in 37us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779975.460173:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1787779975.460185:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1787779975.460191:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0348800b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3642:x1874622881598208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779975.460218:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0348800b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3642:x1874622881598208:12345-0@lo:400:kworker.0 Request processed in 26us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779975.460223:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00010000:00080000:3.0:1787779975.460253:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0346efe580 x1874622881597696/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779991 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779975.460320:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346efe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874622881597696:0@lo:400:kworker.0 00000100:00100000:3.0:1787779975.460332:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477aef840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881598208:0@lo:400:kworker.0 00000100:00080000:3.0:1787779975.460359:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787779975.460364:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787779975.460366:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787779975.460368:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787779975.460465:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477aec3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1874622881598080:12345-0@lo:400:kworker.0 Request processed in 2578us (2744us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779975.460473:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00010000:00080000:3.0:1787779975.460556:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0477aee940 x1874622881598080/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779991 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779975.460577:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477aee940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1874622881598080:0@lo:400:kworker.0 00000100:00100000:1.0:1787779975.964155:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787779975.964182:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347e5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881598336:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787779975.964261:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779975.964812:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881598336 00000100:00100000:0.0:1787779975.964821:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881598336 00000100:00100000:0.0:1787779975.964913:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1787779975.964924:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477aecf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881598336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787779975.964947:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787779975.965010:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477aecf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881598336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (748us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779975.965016:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1787779975.965103:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347e5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881598336:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787779975.967456:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787779975.967480:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348835e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881598464:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787779975.967563:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779975.970825:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881598464 00000100:00100000:0.0:1787779975.970878:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881598464 00000100:00100000:0.0:1787779975.970952:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1787779975.970963:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0348802940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881598464:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787779975.970996:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787779975.971085:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0348802940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881598464:12345-0@lo:13:osp-pre-0-1.0 Request processed in 124us (3520us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779975.971092:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00010000:00080000:3.0:1787779975.971618:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0348835e00 x1874622881598464/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779991 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779975.971639:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348835e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881598464:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1787779976.349419:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787779976.476147:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787779976.476171:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348803840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881598592:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787779976.476248:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779976.480610:0:8529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881598592 00000100:00100000:2.0:1787779976.480760:0:8529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881598592 00000100:00100000:2.0:1787779976.481582:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1787779976.481593:0:8529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347e5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1874622881598592:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787779976.481681:0:8529:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787779976.482083:0:8529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347e5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1874622881598592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 492us (5833us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779976.482092:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00010000:00080000:3.0:1787779976.482314:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0348803840 x1874622881598592/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779992 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779976.482334:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348803840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881598592:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787779977.112013:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787779977.112060:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787779977.112097:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787779977.112166:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863671040 00000100:00100000:1.0:1787779977.112175:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863671040 00000100:00100000:1.0:1787779977.112231:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 381 00000100:00100000:1.0:1787779977.112241:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0478610c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+13:2410:x1874622863671040:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1787779977.112311:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0478610c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+13:2410:x1874622863671040:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 71us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779977.112319:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 381 00000100:00100000:3.0:1787779977.113458:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863671168 00000100:00100000:3.0:1787779977.113467:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863671168 00000100:00100000:3.0:1787779977.113530:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863671296 00000100:00100000:3.0:1787779977.113534:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863671296 00000100:00100000:3.0:1787779977.113652:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 291 00000100:00100000:3.0:1787779977.113663:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347c370c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:2410:x1874622863671168:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1787779977.113725:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347c370c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:2410:x1874622863671168:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 64us (1721us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779977.113732:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 291 00000100:00100000:3.0:1787779977.113750:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 292 00000100:00100000:3.0:1787779977.113757:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347c352c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:2410:x1874622863671296:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1787779977.113798:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347c352c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:2410:x1874622863671296:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 41us (1700us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779977.113804:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 292 00000100:00080000:0.0:1787779977.113852:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787779977.113865:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787779977.125001:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787779977.125057:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787779977.125095:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787779977.125386:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863671680 00000100:00100000:1.0:1787779977.125398:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863671680 00000100:00100000:1.0:1787779977.125475:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863671552 00000100:00100000:1.0:1787779977.125478:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863671552 00000100:00100000:1.0:1787779977.125503:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 293 00000100:00100000:1.0:1787779977.125515:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347c37840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+5:2411:x1874622863671680:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1787779977.125603:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347c37840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+5:2411:x1874622863671680:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 90us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779977.125612:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 293 00000100:00100000:1.0:1787779977.125642:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 294 00000100:00100000:1.0:1787779977.125649:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347c36580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+5:2411:x1874622863671552:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1787779977.125676:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347c36580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+5:2411:x1874622863671552:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 27us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779977.125682:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 294 00000100:00100000:3.0:1787779977.125758:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863671424 00000100:00100000:3.0:1787779977.125779:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863671424 00000100:00100000:3.0:1787779977.125822:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 27 00000100:00100000:3.0:1787779977.125829:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347c34780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:2407:x1874622863671424:12345-192.168.203.31@tcp:9:kworker.0 00000020:00000080:3.0:1787779977.125885:0:9899:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc8fc0a517996087d 00000100:00080000:3.0:1787779977.125897:0:9899:0:(import.c:65:import_set_state_nolock()) ffff9c0347d2d800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787779977.125950:0:9899:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967301 00010000:00010000:2.0:1787779977.127283:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787779977.128992:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347c34780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+2:2407:x1874622863671424:12345-192.168.203.31@tcp:9:kworker.0 Request processed in 3153us (3997us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779977.129008:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 27 00000100:00080000:0.0:1787779977.129713:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787779977.129727:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787779977.129731:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1787779977.372964:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787779978.012682:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787779978.019887:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477aec780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881598720:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787779978.020007:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779978.028672:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881598720 00000100:00100000:0.0:1787779978.028686:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881598720 00000100:00100000:0.0:1787779978.028766:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1787779978.028775:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0348836580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881598720:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787779978.028813:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787779978.028950:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0348836580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881598720:12345-0@lo:41:osp-pre-0-1.0 Request processed in 175us (8943us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779978.028957:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1787779978.029076:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477aec780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881598720:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1787779978.397068:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787779978.527242:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787779978.527264:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c03488343c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881598848:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787779978.527331:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779978.527452:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881598848 00000100:00100000:2.0:1787779978.527459:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881598848 00000100:00100000:2.0:1787779978.527505:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1787779978.527512:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477aee580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881598848:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787779978.527545:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787779978.527588:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477aee580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881598848:12345-0@lo:41:osp-pre-1-0.0 Request processed in 76us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779978.527594:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1787779978.527709:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c03488343c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881598848:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787779979.421716:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787779980.444099:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787779980.572077:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477aeda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1f575176-36bc-4786-83ee-2fea064a12a9:3644:1874622881598976:0@lo:400:kworker.0 00000100:00100000:1.0:1787779980.572102:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477aefc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874622881599232:0@lo:400:kworker.0 00000100:00100000:2.0:1787779980.572160:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477aede00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874622881599360:0@lo:400:kworker.0 00000100:00100000:0.0:1787779980.572211:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477aef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874622881599104:0@lo:400:kworker.0 00000100:00100000:2.0:1787779980.574765:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779980.574858:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477aef0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881599872:0@lo:400:kworker.0 00000100:00100000:2.0:1787779980.574902:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779980.574925:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477aed2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881600384:0@lo:400:kworker.0 00000100:00100000:2.0:1787779980.574947:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779980.574975:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787779980.574981:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477aec780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881600000:0@lo:400:kworker.0 00000100:00100000:2.0:1787779980.575003:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779980.575022:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477aecb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881600512:0@lo:400:kworker.0 00000100:00100000:2.0:1787779980.575041:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779980.575080:0:12488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881599360 00000100:00100000:2.0:1787779980.575088:0:12488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881599360 00000100:00100000:2.0:1787779980.575133:0:12488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:2.0:1787779980.575141:0:12488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0348837c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1874622881599360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779980.575191:0:12488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0348837c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1874622881599360:12345-0@lo:400:kworker.0 Request processed in 50us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779980.575199:0:12488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:2.0:1787779980.575221:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881599872 00000100:00100000:2.0:1787779980.575224:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881599872 00000100:00100000:2.0:1787779980.575256:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881600384 00000100:00100000:2.0:1787779980.575260:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881600384 00000100:00100000:2.0:1787779980.575270:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881600000 00000100:00100000:2.0:1787779980.575273:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881600000 00000100:00100000:2.0:1787779980.575284:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881600512 00000100:00100000:2.0:1787779980.575286:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881600512 00000100:00100000:2.0:1787779980.575297:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1787779980.575317:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0348834780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881599872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779980.575347:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0348834780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881599872:12345-0@lo:400:kworker.0 Request processed in 31us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779980.575353:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1787779980.575364:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1787779980.575369:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0348837840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881600384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779980.575391:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0348837840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881600384:12345-0@lo:400:kworker.0 Request processed in 22us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779980.575397:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1787779980.575407:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1787779980.575412:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0348835680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881600000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779980.575434:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0348835680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881600000:12345-0@lo:400:kworker.0 Request processed in 22us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779980.575440:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1787779980.575449:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1787779980.575454:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03488370c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881600512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779980.575478:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03488370c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881600512:12345-0@lo:400:kworker.0 Request processed in 23us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779980.575483:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00010000:00080000:2.0:1787779980.575518:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0477aec780 x1874622881600000/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779996 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787779980.575531:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477aec780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881600000:0@lo:400:kworker.0 00000100:00100000:2.0:1787779980.575542:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477aecb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881600512:0@lo:400:kworker.0 00000100:00100000:2.0:1787779980.575552:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477aede00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874622881599360:0@lo:400:kworker.0 00010000:00080000:2.0:1787779980.575569:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0477aef0c0 x1874622881599872/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787779996 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787779980.575578:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477aef0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881599872:0@lo:400:kworker.0 00000100:00100000:2.0:1787779980.575586:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477aed2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881600384:0@lo:400:kworker.0 00000100:00080000:2.0:1787779980.575644:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787779980.575648:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787779980.577008:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779980.577059:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477aeed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1874622881599616:0@lo:400:kworker.0 00000100:00100000:0.0:1787779980.577089:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779980.577120:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881599104 00000100:00100000:0.0:1787779980.577127:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881599104 00000100:00100000:0.0:1787779980.577164:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881599616 00000100:00100000:0.0:1787779980.577166:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881599616 00000100:00100000:0.0:1787779980.577208:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:0.0:1787779980.577216:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347c35680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874622881599104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787779980.577258:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347c35680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874622881599104:12345-0@lo:400:kworker.0 Request processed in 44us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779980.577265:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:0.0:1787779980.577279:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:0.0:1787779980.577285:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347c36940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874622881599616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787779980.577316:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347c36940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874622881599616:12345-0@lo:400:kworker.0 Request processed in 32us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779980.577321:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00080000:0.0:1787779980.577339:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787779980.577370:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477aeed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1874622881599616:0@lo:400:kworker.0 00000100:00100000:0.0:1787779980.577678:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477aee940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1874622881600128:0@lo:400:kworker.0 00000100:00100000:3.0:1787779980.578035:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779980.578078:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477aec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881599488:0@lo:400:kworker.0 00000100:00100000:3.0:1787779980.578107:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779980.578145:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881599488 00000100:00100000:3.0:1787779980.578150:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881599488 00000100:00100000:3.0:1787779980.578177:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1787779980.578184:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0348803840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881599488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779980.578224:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0348803840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881599488:12345-0@lo:400:kworker.0 Request processed in 40us (116us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779980.578231:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1787779980.578272:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477aec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881599488:0@lo:400:kworker.0 00000100:00100000:0.0:1787779980.578298:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779980.578324:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881600128 00000100:00100000:3.0:1787779980.578329:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881600128 00000100:00100000:0.0:1787779980.578334:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348835a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881600640:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787779980.578367:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779980.578370:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:3.0:1787779980.578379:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347c34f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1874622881600128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779980.578444:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881598976 00000100:00100000:2.0:1787779980.578448:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881598976 00000100:00100000:2.0:1787779980.578486:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:2.0:1787779980.578492:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0478611c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+24:3644:x1874622881598976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779980.579327:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347c34f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1874622881600128:12345-0@lo:400:kworker.0 Request processed in 946us (1027us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779980.579349:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00080000:3.0:1787779980.579375:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787779980.579402:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881600640 00000100:00100000:3.0:1787779980.579407:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881600640 00000100:00100000:3.0:1787779980.579436:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1787779980.579443:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347c361c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881600640:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787779980.579467:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787779980.579504:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347c361c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881600640:12345-0@lo:13:osp-pre-1-1.0 Request processed in 62us (1139us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779980.579511:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1787779980.579686:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348835a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881600640:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787779980.579703:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477aef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874622881599104:0@lo:400:kworker.0 00000100:00100000:1.0:1787779980.580036:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779980.580066:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477aee1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1874622881599744:0@lo:400:kworker.0 00000100:00100000:1.0:1787779980.580099:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779980.580120:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477aef840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1874622881600256:0@lo:400:kworker.0 00000100:00100000:1.0:1787779980.580138:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779980.580159:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881599744 00000100:00100000:1.0:1787779980.580163:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881599744 00000100:00100000:2.0:1787779980.580190:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0478611c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+24:3644:x1874622881598976:12345-0@lo:400:kworker.0 Request processed in 1697us (2155us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779980.580196:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881600256 00000100:00100000:2.0:1787779980.580198:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00000100:00100000:1.0:1787779980.580199:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881600256 00000100:00100000:1.0:1787779980.580216:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:1.0:1787779980.580223:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477aec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1874622881599744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779980.580239:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881599232 00000100:00100000:2.0:1787779980.580243:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881599232 00000100:00100000:1.0:1787779980.580255:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477aec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1874622881599744:12345-0@lo:400:kworker.0 Request processed in 33us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779980.580261:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:1.0:1787779980.580275:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:1.0:1787779980.580280:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477aed2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1874622881600256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787779980.580308:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477aed2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1874622881600256:12345-0@lo:400:kworker.0 Request processed in 28us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779980.580313:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:2.0:1787779980.580341:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00010000:00080000:1.0:1787779980.580342:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0477aef840 x1874622881600256/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779996 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787779980.580347:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477aeed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1874622881599232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787779980.580352:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477aef840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1874622881600256:0@lo:400:kworker.0 00000100:00100000:2.0:1787779980.580379:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477aeed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1874622881599232:12345-0@lo:400:kworker.0 Request processed in 32us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779980.580385:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00080000:2.0:1787779980.580400:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787779980.580466:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477aeda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1f575176-36bc-4786-83ee-2fea064a12a9:3644:1874622881598976:0@lo:400:kworker.0 00000100:00100000:0.0:1787779980.580996:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477aee940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1874622881600128:0@lo:400:kworker.0 00010000:00080000:1.0:1787779980.582480:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0477aee1c0 x1874622881599744/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787779996 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787779980.582513:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477aee1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1874622881599744:0@lo:400:kworker.0 00000100:00100000:1.0:1787779980.582549:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477aefc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874622881599232:0@lo:400:kworker.0 00000100:00100000:1.0:1787779981.084213:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347c35a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881600768:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787779981.084293:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779981.085610:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881600768 00000100:00100000:0.0:1787779981.085621:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881600768 00000100:00100000:2.0:1787779981.089689:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787779981.089718:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c03488361c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881600896:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787779981.089801:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779981.090316:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1787779981.090338:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477aefc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1874622881600768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787779981.090364:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787779981.090443:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477aefc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1874622881600768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 115us (6149us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779981.090452:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1787779981.090592:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347c35a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881600768:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787779981.099700:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881600896 00000100:00100000:0.0:1787779981.103118:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881600896 00000100:00100000:0.0:1787779981.103196:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1787779981.103206:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0348837480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881600896:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787779981.103239:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787779981.103323:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0348837480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881600896:12345-0@lo:13:osp-pre-0-1.0 Request processed in 119us (13521us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779981.103330:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00010000:00080000:2.0:1787779981.103584:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c03488361c0 x1874622881600896/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779997 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787779981.103735:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c03488361c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881600896:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1787779981.468328:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787779981.597868:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477aef840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881601024:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787779981.597938:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779981.598101:0:8529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881601024 00000100:00100000:2.0:1787779981.598108:0:8529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881601024 00000100:00100000:2.0:1787779981.598154:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1787779981.598163:0:8529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0348803480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881601024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787779981.598184:0:8529:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787779981.604888:0:8529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0348803480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881601024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 6714us (6938us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779981.604902:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00010000:00080000:3.0:1787779981.612456:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0477aef840 x1874622881601024/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787779997 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779981.612484:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477aef840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881601024:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787779982.231375:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787779982.231414:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787779982.231472:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863671808 00000100:00100000:1.0:1787779982.231482:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863671808 00000100:00100000:1.0:1787779982.231531:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 383 00000100:00100000:1.0:1787779982.231539:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0478610050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+13:2409:x1874622863671808:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1787779982.231604:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0478610050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+13:2409:x1874622863671808:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 66us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779982.231611:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 383 00000100:00100000:3.0:1787779982.233731:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787779982.246929:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787779982.247016:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863672064 00000100:00100000:2.0:1787779982.247025:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863672064 00000100:00100000:2.0:1787779982.247108:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863672320 00000100:00100000:2.0:1787779982.247112:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863672320 00000100:00080000:3.0:1787779982.247121:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787779982.247137:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 301 00000100:00100000:2.0:1787779982.247147:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346efe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:2409:x1874622863672064:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1787779982.247557:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346efe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:2409:x1874622863672064:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 410us (16141us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779982.247566:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 301 00000100:00100000:2.0:1787779982.247585:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 302 00000100:00100000:2.0:1787779982.247592:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347fa8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+5:2409:x1874622863672320:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1787779982.247618:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347fa8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+5:2409:x1874622863672320:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 27us (13894us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779982.247625:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 302 00000100:00100000:1.0:1787779982.262273:0:12488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863671936 00000100:00100000:1.0:1787779982.262291:0:12488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863671936 00000100:00100000:1.0:1787779982.262365:0:12488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 303 00000100:00100000:1.0:1787779982.262376:0:12488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477aede00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:2409:x1874622863671936:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1787779982.262458:0:12488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477aede00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:2409:x1874622863671936:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 83us (15538us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779982.262464:0:12488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 303 00000100:00080000:1.0:1787779982.262486:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787779982.262536:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787779982.264263:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863672192 00000100:00100000:2.0:1787779982.264283:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863672192 00000100:00100000:2.0:1787779982.264354:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 304 00000100:00100000:2.0:1787779982.264364:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477aecb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+5:2409:x1874622863672192:12345-192.168.203.31@tcp:400:kworker.0 00000100:00080000:1.0:1787779982.264416:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787779982.264441:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477aecb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+5:2409:x1874622863672192:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 80us (1904us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779982.264449:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 304 00010000:00010000:1.0:1787779982.493140:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787779983.135560:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477aec780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881601152:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787779983.135631:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779983.135707:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881601152 00000100:00100000:1.0:1787779983.135715:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881601152 00000100:00100000:1.0:1787779983.135760:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1787779983.135769:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477aef0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881601152:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787779983.135803:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1787779983.135886:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477aef0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881601152:12345-0@lo:41:osp-pre-0-1.0 Request processed in 117us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779983.135893:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1787779983.135939:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477aec780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881601152:0@lo:41:osp-pre-0-1.0 00000001:00100000:0.0:1787779983.149380:0:9508:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 781d29bb-23d2-48e3-b16d-c29e52cd5375 00000020:00000080:0.0:1787779983.149390:0:9508:0:(genops.c:885:class_export_put()) final put ffff9c0347d28800/781d29bb-23d2-48e3-b16d-c29e52cd5375 00000020:00000080:1.0:1787779983.152922:0:2253:0:(genops.c:844:class_export_destroy()) destroying export ffff9c0347d28800/781d29bb-23d2-48e3-b16d-c29e52cd5375 for lustre-OST0001 00000020:00000080:1.0:1787779983.152998:0:2253:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c0347d2d800 for lustre-OST0001 00000040:00080000:0.0:1787779983.517652:0:13794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787779983.517899:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787779983.592367:0:13797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787779983.645270:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787779983.645296:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348835a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881601280:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787779983.645364:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779983.645505:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881601280 00000100:00100000:1.0:1787779983.645513:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881601280 00000100:00100000:1.0:1787779983.645577:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1787779983.645587:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347c34b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874622881601280:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787779983.645621:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787779983.645679:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347c34b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874622881601280:12345-0@lo:41:osp-pre-1-0.0 Request processed in 94us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779983.645685:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1787779983.645891:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348835a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881601280:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787779984.541883:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787779985.586270:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787779985.693057:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348834f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881601408:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787779985.693207:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779985.694433:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348835e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874622881601664:0@lo:400:kworker.0 00000100:00100000:0.0:1787779985.694511:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779985.694564:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c03488be580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1874622881602176:0@lo:400:kworker.0 00000100:00100000:0.0:1787779985.694596:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779985.694598:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881601664 00000100:00100000:2.0:1787779985.694608:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881601664 00000100:00100000:0.0:1787779985.694625:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c03488bde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1874622881602688:0@lo:400:kworker.0 00000100:00100000:0.0:1787779985.694647:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779985.694658:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881602176 00000100:00100000:2.0:1787779985.694662:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881602176 00000100:00100000:0.0:1787779985.694674:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1787779985.694681:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348835a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881601792:0@lo:400:kworker.0 00000100:00100000:2.0:1787779985.694693:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881602688 00000100:00100000:2.0:1787779985.694698:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881602688 00000100:00100000:0.0:1787779985.694732:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779985.694733:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:2.0:1787779985.694746:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347c35a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874622881601664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787779985.694753:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c03488bda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1874622881602304:0@lo:400:kworker.0 00000100:00100000:0.0:1787779985.694775:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779985.694789:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c03488bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1874622881602816:0@lo:400:kworker.0 00000100:00100000:2.0:1787779985.694818:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347c35a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874622881601664:12345-0@lo:400:kworker.0 Request processed in 74us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779985.694830:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:0.0:1787779985.694831:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779985.694882:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881602304 00000100:00100000:2.0:1787779985.694885:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881602304 00000100:00100000:2.0:1787779985.694900:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881602816 00000100:00100000:2.0:1787779985.694903:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881602816 00000100:00100000:2.0:1787779985.694916:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:2.0:1787779985.694922:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347c343c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874622881602176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779985.694991:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c03488343c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1f575176-36bc-4786-83ee-2fea064a12a9:3644:1874622881601536:0@lo:400:kworker.0 00000100:00100000:0.0:1787779985.695583:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348835e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874622881601664:0@lo:400:kworker.0 00000100:00100000:0.0:1787779985.695619:0:12488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:0.0:1787779985.695628:0:12488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0345e77c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1874622881602688:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1787779985.695700:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787779985.695704:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787779985.695718:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c03488bcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874622881601920:0@lo:400:kworker.0 00000100:00100000:2.0:1787779985.699161:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347c343c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874622881602176:12345-0@lo:400:kworker.0 Request processed in 4228us (4555us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779985.700091:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779985.700293:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:2.0:1787779985.700344:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:2.0:1787779985.700356:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0345e76580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1874622881602304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779985.700631:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c03488bc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881602048:0@lo:400:kworker.0 00000100:00100000:2.0:1787779985.701447:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0345e76580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1874622881602304:12345-0@lo:400:kworker.0 Request processed in 1090us (6666us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779985.701459:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:2.0:1787779985.701485:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:3.0:1787779985.701618:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779985.701663:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c03488bfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881602560:0@lo:400:kworker.0 00000100:00100000:0.0:1787779985.701719:0:12488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0345e77c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1874622881602688:12345-0@lo:400:kworker.0 Request processed in 6091us (7068us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779985.701729:0:12488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:0.0:1787779985.701768:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881601792 00000100:00100000:0.0:1787779985.701777:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881601792 00000100:00100000:0.0:1787779985.701820:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881602048 00000100:00100000:0.0:1787779985.701823:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881602048 00000100:00100000:0.0:1787779985.701854:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1787779985.701862:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0345e761c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881601792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779985.702318:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0345e77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1874622881602816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779985.702364:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0345e77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1874622881602816:12345-0@lo:400:kworker.0 Request processed in 872us (7536us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779985.702371:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:3.0:1787779985.702485:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779985.702531:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881601408 00000100:00100000:3.0:1787779985.702536:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881601408 00000100:00100000:3.0:1787779985.702580:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1787779985.702587:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477aec780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881601408:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787779985.702610:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787779985.702647:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477aec780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881601408:12345-0@lo:13:osp-pre-1-1.0 Request processed in 62us (9442us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779985.702653:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1787779985.702673:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881601536 00000100:00100000:3.0:1787779985.702677:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881601536 00000100:00100000:3.0:1787779985.702746:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:3.0:1787779985.702754:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0442d5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+24:3644:x1874622881601536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779985.702868:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881602560 00000100:00100000:2.0:1787779985.702873:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881602560 00000100:00100000:2.0:1787779985.702901:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1787779985.702908:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347fa8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881602560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779985.702940:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347fa8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881602560:12345-0@lo:400:kworker.0 Request processed in 34us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779985.702946:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00080000:2.0:1787779985.703144:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787779985.703149:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787779985.703317:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0442d5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+24:3644:x1874622881601536:12345-0@lo:400:kworker.0 Request processed in 563us (3226us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779985.703324:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00000100:00100000:3.0:1787779985.703370:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c03488343c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1f575176-36bc-4786-83ee-2fea064a12a9:3644:1874622881601536:0@lo:400:kworker.0 00010000:00080000:3.0:1787779985.703383:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c03488bfc00 x1874622881602560/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787780001 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779985.703394:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c03488bfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881602560:0@lo:400:kworker.0 00000100:00100000:1.0:1787779985.703622:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779985.703663:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c03488bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881602432:0@lo:400:kworker.0 00000100:00100000:1.0:1787779985.703693:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779985.703876:0:12488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881601920 00000100:00100000:2.0:1787779985.703882:0:12488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881601920 00000100:00100000:2.0:1787779985.703921:0:12488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:2.0:1787779985.703929:0:12488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477aef840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1874622881601920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787779985.703937:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c03488bed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881602944:0@lo:400:kworker.0 00000100:00100000:1.0:1787779985.703976:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779985.703981:0:12488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477aef840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1874622881601920:12345-0@lo:400:kworker.0 Request processed in 52us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779985.703989:0:12488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:1.0:1787779985.704219:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348834f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881601408:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787779985.704246:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c03488bcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874622881601920:0@lo:400:kworker.0 00000100:00100000:1.0:1787779985.704273:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881602432 00000100:00100000:1.0:1787779985.704277:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881602432 00000100:00100000:3.0:1787779985.704300:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881602944 00000100:00100000:3.0:1787779985.704306:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881602944 00000100:00100000:1.0:1787779985.704324:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1787779985.704333:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477aee940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881602432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779985.704351:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1787779985.704361:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477aef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881602944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787779985.704378:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477aee940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881602432:12345-0@lo:400:kworker.0 Request processed in 45us (683us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779985.704385:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1787779985.704408:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477aef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881602944:12345-0@lo:400:kworker.0 Request processed in 48us (430us total) trans 0 rc 0/0 00010000:00080000:1.0:1787779985.704421:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c03488bf480 x1874622881602432/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787780001 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779985.704437:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1787779985.704441:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c03488bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881602432:0@lo:400:kworker.0 00000100:00100000:1.0:1787779985.704458:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c03488bed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881602944:0@lo:400:kworker.0 00000100:00080000:2.0:1787779985.704884:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787779985.704895:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787779985.705255:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c03488bda40 x1874622881602304/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787780001 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787779985.705266:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c03488bda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1874622881602304:0@lo:400:kworker.0 00010000:00080000:2.0:1787779985.705278:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c03488bc000 x1874622881602816/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787780001 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787779985.705285:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c03488bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1874622881602816:0@lo:400:kworker.0 00000100:00100000:2.0:1787779985.705295:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c03488be580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1874622881602176:0@lo:400:kworker.0 00000100:00100000:2.0:1787779985.705304:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c03488bde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1874622881602688:0@lo:400:kworker.0 00000100:00100000:0.0:1787779985.705522:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0345e761c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881601792:12345-0@lo:400:kworker.0 Request processed in 3659us (10792us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779985.705533:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1787779985.705555:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1787779985.705564:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347fa8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881602048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787779985.705680:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347fa8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881602048:12345-0@lo:400:kworker.0 Request processed in 118us (4063us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779985.705685:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1787779985.705746:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c03488bc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881602048:0@lo:400:kworker.0 00000100:00100000:2.0:1787779985.707907:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348835a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881601792:0@lo:400:kworker.0 00000100:00100000:2.0:1787779986.204686:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c03488bde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881603072:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787779986.204757:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779986.204949:0:8529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881603072 00000100:00100000:2.0:1787779986.204957:0:8529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881603072 00000100:00100000:2.0:1787779986.205002:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1787779986.205010:0:8529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03488be580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881603072:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787779986.205042:0:8529:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787779986.205085:0:8529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03488be580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881603072:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779986.205092:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00010000:00080000:2.0:1787779986.207800:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c03488bde00 x1874622881603072/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787780002 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787779986.207828:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c03488bde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881603072:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787779986.208422:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477aeda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881603200:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787779986.208482:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779986.209597:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881603200 00000100:00100000:1.0:1787779986.209605:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881603200 00000100:00100000:1.0:1787779986.210475:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1787779986.210560:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477aee1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874622881603200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787779986.210599:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787779986.210674:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477aee1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874622881603200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 190us (2191us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779986.210681:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1787779986.210736:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477aeda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881603200:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787779986.589903:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787779986.719244:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477aeda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881603328:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787779986.719320:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779986.719529:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881603328 00000100:00100000:0.0:1787779986.719537:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881603328 00000100:00100000:0.0:1787779986.719592:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1787779986.719601:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347fa9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1874622881603328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787779986.719622:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787779986.719674:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347fa9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1874622881603328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779986.719681:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00010000:00080000:3.0:1787779986.719798:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0477aeda40 x1874622881603328/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787780002 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779986.719817:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477aeda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881603328:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787779987.360945:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787779987.360989:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787779987.361021:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787779987.361040:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787779987.361059:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787779987.361132:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863672576 00000100:00100000:0.0:1787779987.361141:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863672576 00000100:00100000:0.0:1787779987.361197:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863672704 00000100:00100000:0.0:1787779987.361200:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863672704 00000100:00100000:0.0:1787779987.361210:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863672832 00000100:00100000:0.0:1787779987.361212:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863672832 00000100:00100000:0.0:1787779987.361222:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863672960 00000100:00100000:0.0:1787779987.361224:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863672960 00000100:00100000:0.0:1787779987.361237:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 311 00000100:00100000:0.0:1787779987.361245:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477aeda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:2411:x1874622863672576:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1787779987.361311:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477aeda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:2411:x1874622863672576:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 66us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779987.361318:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 311 00000100:00100000:0.0:1787779987.361332:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 312 00000100:00100000:0.0:1787779987.361337:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347dad680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:2410:x1874622863672704:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1787779987.361355:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347dad680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:2410:x1874622863672704:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 18us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779987.361361:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 312 00000100:00100000:0.0:1787779987.361385:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 313 00000100:00100000:0.0:1787779987.361390:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347dacb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+5:2411:x1874622863672832:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1787779987.361408:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347dacb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+5:2411:x1874622863672832:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 19us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779987.361414:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 313 00000100:00100000:0.0:1787779987.361422:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 314 00000100:00100000:0.0:1787779987.361427:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347daed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+5:2410:x1874622863672960:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1787779987.361443:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347daed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+5:2410:x1874622863672960:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 16us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779987.361448:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 314 00000100:00100000:3.0:1787779987.361614:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863672448 00000100:00100000:3.0:1787779987.361618:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863672448 00000100:00100000:3.0:1787779987.361652:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 385 00000100:00100000:3.0:1787779987.361659:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0442d58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+13:2410:x1874622863672448:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1787779987.361685:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0442d58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+13:2410:x1874622863672448:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 27us (750us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779987.361691:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 385 00000100:00080000:1.0:1787779987.361862:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787779987.361866:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:3.0:1787779987.569695:0:14056:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 17:33:06 (1787779986) 00010000:00010000:0.0:1787779987.612189:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787779988.252195:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347dacf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881603456:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787779988.252265:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779988.252514:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881603456 00000100:00100000:0.0:1787779988.252521:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881603456 00000100:00100000:0.0:1787779988.252981:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1787779988.252994:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03488bda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881603456:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787779988.253027:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787779988.253091:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03488bda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881603456:12345-0@lo:41:osp-pre-0-1.0 Request processed in 100us (824us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779988.253155:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347dacf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881603456:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787779988.253423:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00010000:00010000:1.0:1787779988.636106:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787779988.764589:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c03488be1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881603584:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787779988.764660:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779988.764794:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881603584 00000100:00100000:0.0:1787779988.764801:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881603584 00000100:00100000:0.0:1787779988.764873:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1787779988.764883:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347fab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881603584:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787779988.764918:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787779988.764979:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347fab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881603584:12345-0@lo:41:osp-pre-1-0.0 Request processed in 97us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779988.765001:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1787779988.765141:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c03488be1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881603584:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787779989.603396:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787779989.603541:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863673088 00000100:00100000:0.0:1787779989.603550:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863673088 00000100:00100000:0.0:1787779989.603629:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 40 00000100:00100000:0.0:1787779989.603641:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347dae1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:11117:x1874622863673088:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787779989.603661:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787779989.603742:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868800/0xc8fc0a517996095d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea1dad expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779989.603814:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868c00/0xc8fc0a5179960964 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779989.603828:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868c00/0xc8fc0a5179960964 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779989.603883:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868c00/0xc8fc0a5179960964 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787779989.603929:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787779989.603933:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787779989.603970:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868c00/0xc8fc0a5179960964 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779989.603994:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868800/0xc8fc0a517996095d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1dad expref: 7 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779989.604022:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868c00/0xc8fc0a5179960964 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1dad expref: 6 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779989.604048:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c0347beca00) 00010000:00010000:0.0:1787779989.604051:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787779989.604055:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0477868c00, rc 0) 00000100:00100000:0.0:1787779989.604106:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347dae1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+6:11117:x1874622863673088:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 468us (718us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779989.604113:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 40 00000100:00080000:1.0:1787779989.604220:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787779989.629019:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787779989.630436:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863673216 00000100:00100000:2.0:1787779989.630448:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863673216 00000100:00100000:2.0:1787779989.630527:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 41 00000100:00100000:2.0:1787779989.630538:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0348835a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+6:11118:x1874622863673216:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787779989.630559:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787779989.630579:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71800/0xc8fc0a517996096b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea1db4 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779989.630643:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70600/0xc8fc0a5179960972 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779989.630659:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70600/0xc8fc0a5179960972 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779989.630670:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70600/0xc8fc0a5179960972 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779989.630685:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71600/0xc8fc0a5179960979 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779989.630692:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71600/0xc8fc0a5179960979 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779989.630699:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71600/0xc8fc0a5179960979 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779989.630785:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70e00/0xc8fc0a5179960980 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779989.630794:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70e00/0xc8fc0a5179960980 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779989.630801:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70e00/0xc8fc0a5179960980 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787779989.630875:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787779989.630879:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787779989.630901:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70e00/0xc8fc0a5179960980 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779989.630912:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70600/0xc8fc0a5179960972 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779989.630918:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70600/0xc8fc0a5179960972 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779989.630925:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70600/0xc8fc0a5179960972 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779989.630931:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0477a70600 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:2.0:1787779989.630935:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70600/0xc8fc0a5179960972 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779989.630944:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70600/0xc8fc0a5179960972 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779989.630956:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c0347beca00) 00010000:00010000:2.0:1787779989.630965:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787779989.630970:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70600/0xc8fc0a5179960972 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779989.630976:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70600/0xc8fc0a5179960972 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779989.630990:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71600/0xc8fc0a5179960979 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779989.630997:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71600/0xc8fc0a5179960979 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779989.631004:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71600/0xc8fc0a5179960979 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779989.631009:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0477a71600 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:2.0:1787779989.631013:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71600/0xc8fc0a5179960979 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779989.631019:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71600/0xc8fc0a5179960979 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779989.631027:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9c0347a50f00) 00010000:00010000:2.0:1787779989.631030:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787779989.631033:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71600/0xc8fc0a5179960979 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779989.631039:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71600/0xc8fc0a5179960979 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779989.631067:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71800/0xc8fc0a517996096b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1db4 expref: 8 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779989.631094:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70e00/0xc8fc0a5179960980 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1db4 expref: 7 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779989.631100:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9c0347a50600) 00010000:00010000:2.0:1787779989.631102:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787779989.631104:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0477a70e00, rc 0) 00000100:00100000:2.0:1787779989.631172:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0348835a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+7:11118:x1874622863673216:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 636us (2163us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779989.631180:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 41 00000100:00100000:0.0:1787779989.635783:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787779989.635903:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863673344 00000100:00100000:1.0:1787779989.635915:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863673344 00000100:00100000:1.0:1787779989.635989:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 7 00000100:00100000:1.0:1787779989.636000:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0348834f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:781d29bb-23d2-48e3-b16d-c29e52cd5375+7:11118:x1874622863673344:12345-192.168.203.31@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1787779989.636116:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0348834f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:781d29bb-23d2-48e3-b16d-c29e52cd5375+7:11118:x1874622863673344:12345-192.168.203.31@tcp:900:lhsmtool_posix.0 Request processed in 117us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779989.636133:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 7 00000100:00100000:1.0:1787779989.640071:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787779989.640161:0:12488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863673600 00000100:00100000:2.0:1787779989.640175:0:12488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863673600 00000100:00100000:2.0:1787779989.640240:0:12488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 42 00000100:00100000:2.0:1787779989.640251:0:12488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347daf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:781d29bb-23d2-48e3-b16d-c29e52cd5375+7:11118:x1874622863673600:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787779989.640271:0:12488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787779989.640291:0:12488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71400/0xc8fc0a5179960987 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea1dbb expref: -99 pid: 12488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779989.640363:0:12488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71a00/0xc8fc0a517996098e lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779989.640377:0:12488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71a00/0xc8fc0a517996098e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779989.640388:0:12488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71a00/0xc8fc0a517996098e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779989.640460:0:12488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70a00/0xc8fc0a5179960995 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779989.640481:0:12488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70a00/0xc8fc0a5179960995 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779989.640489:0:12488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70a00/0xc8fc0a5179960995 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779989.640599:0:12488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70200/0xc8fc0a517996099c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779989.640609:0:12488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70200/0xc8fc0a517996099c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779989.640616:0:12488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70200/0xc8fc0a517996099c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787779989.640626:0:12488:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1787779989.640703:0:12488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71a00/0xc8fc0a517996098e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779989.640711:0:12488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71a00/0xc8fc0a517996098e lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779989.640717:0:12488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71a00/0xc8fc0a517996098e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779989.640723:0:12488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0477a71a00 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:2.0:1787779989.640727:0:12488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71a00/0xc8fc0a517996098e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779989.640734:0:12488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71a00/0xc8fc0a517996098e lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779989.640756:0:12488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9c0347a50600) 00010000:00010000:2.0:1787779989.640759:0:12488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787779989.640763:0:12488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71a00/0xc8fc0a517996098e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779989.640780:0:12488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71a00/0xc8fc0a517996098e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779989.640794:0:12488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70a00/0xc8fc0a5179960995 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779989.640800:0:12488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70a00/0xc8fc0a5179960995 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779989.640806:0:12488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70a00/0xc8fc0a5179960995 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779989.640811:0:12488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0477a70a00 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:2.0:1787779989.640814:0:12488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70a00/0xc8fc0a5179960995 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779989.640819:0:12488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70a00/0xc8fc0a5179960995 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779989.640826:0:12488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9c0347a50500) 00010000:00010000:2.0:1787779989.640829:0:12488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787779989.640831:0:12488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70a00/0xc8fc0a5179960995 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779989.640907:0:12488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70a00/0xc8fc0a5179960995 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779989.641157:0:12488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71400/0xc8fc0a5179960987 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1dbb expref: 10 pid: 12488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779989.641171:0:12488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70200/0xc8fc0a517996099c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1dbb expref: 9 pid: 12488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779989.641179:0:12488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c0347a50800) 00010000:00010000:2.0:1787779989.641181:0:12488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787779989.641183:0:12488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0477a70200, rc 0) 00000100:00100000:2.0:1787779989.641243:0:12488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347daf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:781d29bb-23d2-48e3-b16d-c29e52cd5375+9:11118:x1874622863673600:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 994us (1187us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1787779989.641251:0:12488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 42 00000100:00100000:0.0:1787779989.647227:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787779989.647309:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863673728 00000100:00100000:2.0:1787779989.647324:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863673728 00000100:00100000:2.0:1787779989.647406:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 43 00000100:00100000:2.0:1787779989.647415:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03488343c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+9:11118:x1874622863673728:12345-192.168.203.31@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1787779989.647541:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03488343c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+9:11118:x1874622863673728:12345-192.168.203.31@tcp:59:lhsmtool_posix.0 Request processed in 126us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779989.647548:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 43 00010000:00010000:0.0:1787779989.660281:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787779989.661296:0:13794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787779989.669190:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787779989.671722:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863673856 00000100:00100000:2.0:1787779989.671736:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863673856 00000100:00100000:2.0:1787779989.671829:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 44 00000100:00100000:2.0:1787779989.671888:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0348835e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:11118:x1874622863673856:12345-192.168.203.31@tcp:59:lhsmtool_posix.0 00000004:00080000:0.0:1787779989.672615:0:7821:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 684us 00000100:00080000:1.0:1787779989.673326:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787779989.697822:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0348835e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:11118:x1874622863673856:12345-192.168.203.31@tcp:59:lhsmtool_posix.0 Request processed in 25975us (28641us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779989.697835:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 44 00000040:00080000:3.0:1787779989.724982:0:13797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787779990.686226:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787779990.815919:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c03488bf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881603712:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787779990.817073:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779990.817225:0:8529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881603712 00000100:00100000:2.0:1787779990.817235:0:8529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881603712 00000100:00100000:2.0:1787779990.817312:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1787779990.817324:0:8529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03488bd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881603712:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787779990.817364:0:8529:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787779990.817427:0:8529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03488bd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881603712:12345-0@lo:13:osp-pre-1-1.0 Request processed in 106us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779990.817436:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1787779990.817494:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c03488bf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881603712:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1787779990.818463:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787779990.820187:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347fabc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1f575176-36bc-4786-83ee-2fea064a12a9:3642:1874622881603840:0@lo:400:kworker.0 00000100:00100000:2.0:1787779990.820277:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779990.820324:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347faa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881604352:0@lo:400:kworker.0 00000100:00100000:2.0:1787779990.820355:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779990.820387:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787779990.820393:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347faad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1874622881604224:0@lo:400:kworker.0 00000100:00100000:2.0:1787779990.820420:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779990.820451:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881604352 00000100:00100000:2.0:1787779990.820460:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881604352 00000100:00100000:2.0:1787779990.820511:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1787779990.820521:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03488bf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1874622881604352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779990.820719:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03488bf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1874622881604352:12345-0@lo:400:kworker.0 Request processed in 61us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779990.820728:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1787779990.820771:0:12488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881604224 00000100:00100000:2.0:1787779990.820775:0:12488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881604224 00000100:00100000:2.0:1787779990.820832:0:12488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:2.0:1787779990.820957:0:12488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03488bcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1874622881604224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779990.820995:0:12488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03488bcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1874622881604224:12345-0@lo:400:kworker.0 Request processed in 158us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779990.821450:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347fa9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1874622881603968:0@lo:400:kworker.0 00000100:00100000:3.0:1787779990.821517:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779990.821559:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347fab0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1874622881604480:0@lo:400:kworker.0 00000100:00100000:2.0:1787779990.822121:0:12488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:2.0:1787779990.822147:0:12488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881603968 00000100:00100000:2.0:1787779990.822154:0:12488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881603968 00000100:00100000:2.0:1787779990.822196:0:12488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:2.0:1787779990.822205:0:12488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c048131c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1874622881603968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779990.824961:0:12488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c048131c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1874622881603968:12345-0@lo:400:kworker.0 Request processed in 2747us (3434us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779990.824980:0:12488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:2.0:1787779990.825106:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347faa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881604864:0@lo:400:kworker.0 00000100:00100000:2.0:1787779990.825159:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779990.825224:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347faad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1874622881604224:0@lo:400:kworker.0 00000100:00100000:2.0:1787779990.825242:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347faa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881604352:0@lo:400:kworker.0 00000100:00100000:2.0:1787779990.825272:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787779990.825279:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347fa83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874622881604736:0@lo:400:kworker.0 00000100:00100000:2.0:1787779990.825305:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779990.825325:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347faa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881605248:0@lo:400:kworker.0 00000100:00100000:2.0:1787779990.825348:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779990.825417:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881603840 00000100:00100000:2.0:1787779990.825425:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881603840 00000100:00100000:2.0:1787779990.825477:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:2.0:1787779990.825487:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0442d59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+24:3642:x1874622881603840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779990.825565:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0442d59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+24:3642:x1874622881603840:12345-0@lo:400:kworker.0 Request processed in 79us (5288us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779990.825573:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00000100:00100000:2.0:1787779990.825622:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347fa8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881604096:0@lo:400:kworker.0 00000100:00100000:2.0:1787779990.825653:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779990.825674:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347fa92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1874622881604608:0@lo:400:kworker.0 00000100:00100000:2.0:1787779990.825701:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779990.825720:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347fab840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1874622881605120:0@lo:400:kworker.0 00000100:00100000:2.0:1787779990.825742:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779990.825786:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881604096 00000100:00100000:2.0:1787779990.825790:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881604096 00000100:00100000:2.0:1787779990.825814:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1787779990.825820:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03488bc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881604096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779990.825955:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03488bc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881604096:12345-0@lo:400:kworker.0 Request processed in 135us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779990.825961:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1787779990.825990:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347fa8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881604096:0@lo:400:kworker.0 00000100:00100000:2.0:1787779990.826024:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347fabc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1f575176-36bc-4786-83ee-2fea064a12a9:3642:1874622881603840:0@lo:400:kworker.0 00000100:00100000:2.0:1787779990.826052:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881604864 00000100:00100000:2.0:1787779990.826056:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881604864 00000100:00100000:2.0:1787779990.826095:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881604736 00000100:00100000:2.0:1787779990.826098:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881604736 00000100:00100000:2.0:1787779990.826112:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881605248 00000100:00100000:2.0:1787779990.826115:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881605248 00000100:00100000:2.0:1787779990.826130:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1787779990.826135:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03488be940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1874622881604864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779990.826181:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03488be940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1874622881604864:12345-0@lo:400:kworker.0 Request processed in 46us (1023us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779990.826187:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1787779990.826199:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1787779990.826204:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03488bf840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1874622881604736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779990.826231:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03488bf840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1874622881604736:12345-0@lo:400:kworker.0 Request processed in 27us (926us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779990.826237:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1787779990.826248:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1787779990.826254:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03488bd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1874622881605248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779990.826280:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03488bd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1874622881605248:12345-0@lo:400:kworker.0 Request processed in 26us (931us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779990.826286:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00010000:00080000:2.0:1787779990.826314:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0347fa83c0 x1874622881604736/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787780006 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787779990.826326:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347fa83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874622881604736:0@lo:400:kworker.0 00000100:00100000:2.0:1787779990.826337:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347faa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881605248:0@lo:400:kworker.0 00010000:00080000:2.0:1787779990.826347:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0347faa580 x1874622881604864/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787780006 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787779990.827342:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347faa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881604864:0@lo:400:kworker.0 00000100:00100000:3.0:1787779990.827535:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779990.827609:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347fa9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1874622881604992:0@lo:400:kworker.0 00000100:00100000:3.0:1787779990.827662:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779990.827693:0:12488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881604608 00000100:00100000:3.0:1787779990.827700:0:12488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881604608 00000100:00100000:3.0:1787779990.827746:0:12488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881605120 00000100:00100000:3.0:1787779990.827750:0:12488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881605120 00000100:00100000:3.0:1787779990.827780:0:12488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881604480 00000100:00100000:3.0:1787779990.827783:0:12488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881604480 00000100:00100000:3.0:1787779990.827795:0:12488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881604992 00000100:00100000:3.0:1787779990.827797:0:12488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881604992 00000100:00100000:3.0:1787779990.827812:0:12488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:3.0:1787779990.827821:0:12488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03488be1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874622881604608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779990.827894:0:12488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03488be1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874622881604608:12345-0@lo:400:kworker.0 Request processed in 73us (2192us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779990.827902:0:12488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:3.0:1787779990.827919:0:12488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:3.0:1787779990.827925:0:12488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03488bde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1874622881605120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779990.827953:0:12488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03488bde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1874622881605120:12345-0@lo:400:kworker.0 Request processed in 28us (2210us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779990.827959:0:12488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:3.0:1787779990.827969:0:12488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:3.0:1787779990.827974:0:12488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c048131ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1874622881604480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779990.828017:0:12488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c048131ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1874622881604480:12345-0@lo:400:kworker.0 Request processed in 42us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779990.828023:0:12488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:3.0:1787779990.828034:0:12488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:3.0:1787779990.828040:0:12488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c048131e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1874622881604992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779990.828080:0:12488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c048131e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1874622881604992:12345-0@lo:400:kworker.0 Request processed in 40us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779990.828086:0:12488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00010000:00080000:3.0:1787779990.828132:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0347fa92c0 x1874622881604608/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787780006 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779990.828145:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347fa92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1874622881604608:0@lo:400:kworker.0 00010000:00080000:3.0:1787779990.828157:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0347fab840 x1874622881605120/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787780006 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787779990.828166:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347fab840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1874622881605120:0@lo:400:kworker.0 00000100:00100000:3.0:1787779990.828196:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347fa9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1874622881604992:0@lo:400:kworker.0 00000100:00100000:3.0:1787779990.828216:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347fa9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1874622881603968:0@lo:400:kworker.0 00000100:00100000:3.0:1787779990.828227:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347fab0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1874622881604480:0@lo:400:kworker.0 00000100:00080000:1.0:1787779990.831304:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787779990.831317:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787779990.831322:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787779990.831325:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787779991.324411:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787779991.324445:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c03488bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881605376:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787779991.324547:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779991.324656:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881605376 00000100:00100000:2.0:1787779991.324665:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881605376 00000100:00100000:2.0:1787779991.324723:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1787779991.324733:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046f3d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881605376:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787779991.324787:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787779991.324874:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046f3d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881605376:12345-0@lo:13:osp-pre-0-1.0 Request processed in 141us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779991.324882:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00010000:00080000:2.0:1787779991.328067:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c03488bc000 x1874622881605376/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787780007 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787779991.328102:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c03488bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881605376:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787779991.338256:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348837480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881605504:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787779991.338361:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779991.338494:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881605504 00000100:00100000:0.0:1787779991.338506:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881605504 00000100:00100000:0.0:1787779991.338568:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1787779991.338578:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c048131f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881605504:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787779991.338608:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787779991.338657:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c048131f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881605504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779991.338665:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1787779991.338752:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348837480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881605504:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787779991.709636:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787779991.849338:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0461bec780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881605632:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787779991.849440:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779991.849651:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881605632 00000100:00100000:1.0:1787779991.849662:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881605632 00000100:00100000:1.0:1787779991.849729:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1787779991.849930:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03488bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881605632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787779991.849966:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787779991.850043:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03488bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881605632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 304us (603us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779991.850052:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00010000:00080000:2.0:1787779991.850248:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0461bec780 x1874622881605632/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787780007 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787779991.850285:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0461bec780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881605632:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787779992.272701:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787779992.276651:0:12488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863673984 00000100:00100000:3.0:1787779992.276666:0:12488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863673984 00000100:00100000:3.0:1787779992.276760:0:12488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 45 00000100:00100000:3.0:1787779992.276773:0:12488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0348837480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:781d29bb-23d2-48e3-b16d-c29e52cd5375+9:11160:x1874622863673984:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:3.0:1787779992.276792:0:12488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787779992.276813:0:12488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0440031200/0xc8fc0a51799609aa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea1dc2 expref: -99 pid: 12488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787779992.277134:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787779992.277429:0:12488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0440030400/0xc8fc0a51799609b1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779992.277577:0:12488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0440030400/0xc8fc0a51799609b1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779992.277592:0:12488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0440030400/0xc8fc0a51799609b1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779992.277608:0:12488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0440031e00/0xc8fc0a51799609b8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779992.277615:0:12488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0440031e00/0xc8fc0a51799609b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779992.277622:0:12488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0440031e00/0xc8fc0a51799609b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779992.277660:0:12488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0440030400/0xc8fc0a51799609b1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779992.277668:0:12488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0440030400/0xc8fc0a51799609b1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779992.277673:0:12488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0440030400/0xc8fc0a51799609b1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779992.277679:0:12488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0440030400 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:3.0:1787779992.277683:0:12488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0440030400/0xc8fc0a51799609b1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779992.277701:0:12488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0440030400/0xc8fc0a51799609b1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779992.277713:0:12488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c0347beca00) 00010000:00010000:3.0:1787779992.277716:0:12488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787779992.277720:0:12488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0440030400/0xc8fc0a51799609b1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779992.277727:0:12488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0440030400/0xc8fc0a51799609b1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779992.277738:0:12488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0440031e00/0xc8fc0a51799609b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779992.277743:0:12488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0440031e00/0xc8fc0a51799609b8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779992.277761:0:12488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0440031e00/0xc8fc0a51799609b8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779992.277766:0:12488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0440031e00 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:3.0:1787779992.277769:0:12488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0440031e00/0xc8fc0a51799609b8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779992.277774:0:12488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0440031e00/0xc8fc0a51799609b8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779992.277781:0:12488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9c0443d81000) 00010000:00010000:3.0:1787779992.277783:0:12488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787779992.277786:0:12488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0440031e00/0xc8fc0a51799609b8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779992.277801:0:12488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0440031e00/0xc8fc0a51799609b8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779992.277834:0:12488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0440031200/0xc8fc0a51799609aa lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1dc2 expref: 10 pid: 12488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779992.277864:0:12488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c0347beca00) 00010000:00010000:3.0:1787779992.277866:0:12488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787779992.277870:0:12488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0440031200/0xc8fc0a51799609aa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1dc2 expref: 10 pid: 12488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779992.277879:0:12488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0440031200, rc 0) 00000100:00100000:3.0:1787779992.278044:0:12488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0348837480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:781d29bb-23d2-48e3-b16d-c29e52cd5375+9:11160:x1874622863673984:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 1274us (5351us total) trans 0 rc 301/301 00000100:00100000:3.0:1787779992.278052:0:12488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 45 00000100:00100000:3.0:1787779992.298184:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787779992.298216:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863674240 00000100:00100000:3.0:1787779992.298225:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863674240 00000100:00100000:3.0:1787779992.298275:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 46 00000100:00100000:3.0:1787779992.298283:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c048131d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+9:11160:x1874622863674240:12345-192.168.203.31@tcp:36:lfs.0 00010000:00010000:3.0:1787779992.298330:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787779992.298354:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868c00/0xc8fc0a5179960964 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1dad expref: 9 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779992.298370:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c0347beca00) 00010000:00010000:3.0:1787779992.298378:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787779992.298440:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc000/0xc8fc0a51799609bf lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779992.298454:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc000/0xc8fc0a51799609bf lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779992.298463:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc000/0xc8fc0a51799609bf lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779992.298610:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd600/0xc8fc0a51799609c6 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779992.298620:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd600/0xc8fc0a51799609c6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779992.298628:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd600/0xc8fc0a51799609c6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779992.299257:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc200/0xc8fc0a51799609cd lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779992.299267:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc200/0xc8fc0a51799609cd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779992.299274:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc200/0xc8fc0a51799609cd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787779992.299287:0:6513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004207cbd3 reply state 000000001e48ca60 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc200/0xc8fc0a51799609cd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779992.299297:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc200/0xc8fc0a51799609cd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779992.299303:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c0443d81900) 00010000:00010000:3.0:1787779992.299313:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787779992.299316:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1787779992.299321:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1787779992.299329:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc000/0xc8fc0a51799609bf lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779992.299335:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc000/0xc8fc0a51799609bf lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779992.299341:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc000/0xc8fc0a51799609bf lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779992.299346:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c04766dc000 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:3.0:1787779992.299350:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc000/0xc8fc0a51799609bf lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779992.299357:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc000/0xc8fc0a51799609bf lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779992.299365:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c0443d81000) 00010000:00010000:3.0:1787779992.299367:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787779992.299370:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc000/0xc8fc0a51799609bf lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779992.299375:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc000/0xc8fc0a51799609bf lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787779992.299386:0:6513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004207cbd3 reply state 000000001e48ca60 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd600/0xc8fc0a51799609c6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779992.299393:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd600/0xc8fc0a51799609c6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779992.299408:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9c0443d81300) 00010000:00010000:3.0:1787779992.299410:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787779992.299412:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1787779992.302155:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c048131d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+10:11160:x1874622863674240:12345-192.168.203.31@tcp:36:lfs.0 Request processed in 2181us (2288us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1787779992.302173:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 46 00000100:00100000:3.0:1787779992.464639:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787779992.464805:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863674368 00000100:00100000:1.0:1787779992.464816:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863674368 00000100:00100000:1.0:1787779992.464911:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 47 00000100:00100000:1.0:1787779992.464922:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c048131cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+10:11168:x1874622863674368:12345-192.168.203.31@tcp:101:lctl.0 00010000:00010000:1.0:1787779992.464946:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787779992.464971:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd7c00/0xc8fc0a51799609d4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea1dc9 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779992.465046:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd7600/0xc8fc0a51799609db lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779992.465073:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd7600/0xc8fc0a51799609db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779992.465084:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd7600/0xc8fc0a51799609db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787779992.465132:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787779992.465136:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787779992.465176:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd7600/0xc8fc0a51799609db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779992.465203:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd7c00/0xc8fc0a51799609d4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1dc9 expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779992.465222:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd7600/0xc8fc0a51799609db lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1dc9 expref: 11 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779992.465230:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c0341cd4600) 00010000:00010000:1.0:1787779992.465233:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787779992.465236:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0346dd7600, rc 0) 00000100:00100000:1.0:1787779992.465293:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c048131cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+11:11168:x1874622863674368:12345-192.168.203.31@tcp:101:lctl.0 Request processed in 373us (663us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779992.465301:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 47 00000100:00100000:3.0:1787779992.496319:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787779992.496361:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787779992.496387:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787779992.496422:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787779992.496463:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863674752 00000100:00100000:3.0:1787779992.496472:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863674752 00000100:00100000:3.0:1787779992.496528:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863674624 00000100:00100000:3.0:1787779992.496531:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863674624 00000100:00100000:3.0:1787779992.496550:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863674880 00000100:00100000:3.0:1787779992.496552:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863674880 00000100:00100000:3.0:1787779992.496570:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 321 00000100:00100000:3.0:1787779992.496579:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c048131e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+5:2411:x1874622863674752:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1787779992.496650:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c048131e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+5:2411:x1874622863674752:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 72us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779992.496658:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 321 00000100:00100000:3.0:1787779992.496676:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 322 00000100:00100000:3.0:1787779992.496684:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c048131f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:2411:x1874622863674624:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1787779992.496710:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c048131f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:2411:x1874622863674624:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 28us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779992.496754:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 322 00000100:00100000:3.0:1787779992.496768:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 323 00000100:00100000:3.0:1787779992.496776:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c048131d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+5:2411:x1874622863674880:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1787779992.496804:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c048131d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+5:2411:x1874622863674880:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 30us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779992.496811:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 323 00000100:00080000:3.0:1787779992.496830:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787779992.496834:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787779992.497072:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863674496 00000100:00100000:0.0:1787779992.497078:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863674496 00000100:00100000:0.0:1787779992.497114:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 387 00000100:00100000:0.0:1787779992.497122:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0442d58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+13:2411:x1874622863674496:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1787779992.497169:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0442d58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+13:2411:x1874622863674496:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 48us (858us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779992.497176:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 387 00000100:00100000:3.0:1787779992.570303:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787779992.570799:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863675008 00000100:00100000:1.0:1787779992.570810:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863675008 00000100:00100000:1.0:1787779992.570911:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 48 00000100:00100000:1.0:1787779992.570921:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c048131c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+11:11174:x1874622863675008:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:1.0:1787779992.570942:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787779992.570977:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd7c00/0xc8fc0a51799609e2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea1dd0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779992.571039:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6a00/0xc8fc0a51799609e9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779992.571052:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6a00/0xc8fc0a51799609e9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779992.571062:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6a00/0xc8fc0a51799609e9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779992.571072:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6e00/0xc8fc0a51799609f0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779992.571079:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6e00/0xc8fc0a51799609f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779992.571085:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6e00/0xc8fc0a51799609f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779992.571157:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd7400/0xc8fc0a51799609f7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779992.571166:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd7400/0xc8fc0a51799609f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779992.571174:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd7400/0xc8fc0a51799609f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787779992.571209:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1787779992.571213:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787779992.571254:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd7400/0xc8fc0a51799609f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779992.571274:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6a00/0xc8fc0a51799609e9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779992.571281:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6a00/0xc8fc0a51799609e9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779992.571287:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6a00/0xc8fc0a51799609e9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779992.571294:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0346dd6a00 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:1.0:1787779992.571298:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6a00/0xc8fc0a51799609e9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779992.571305:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6a00/0xc8fc0a51799609e9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779992.571316:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c0341cd4600) 00010000:00010000:1.0:1787779992.571319:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787779992.571323:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6a00/0xc8fc0a51799609e9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779992.571330:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6a00/0xc8fc0a51799609e9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779992.571342:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6e00/0xc8fc0a51799609f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779992.571348:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6e00/0xc8fc0a51799609f0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779992.571353:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6e00/0xc8fc0a51799609f0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779992.571365:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0346dd6e00 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:1.0:1787779992.571368:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6e00/0xc8fc0a51799609f0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779992.571374:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6e00/0xc8fc0a51799609f0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779992.571383:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9c0443d81300) 00010000:00010000:1.0:1787779992.571385:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787779992.571388:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6e00/0xc8fc0a51799609f0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779992.571393:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6e00/0xc8fc0a51799609f0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779992.571417:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd7c00/0xc8fc0a51799609e2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1dd0 expref: 13 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779992.571429:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd7400/0xc8fc0a51799609f7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1dd0 expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779992.571435:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c0443d81900) 00010000:00010000:1.0:1787779992.571438:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787779992.571440:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0346dd7400, rc 0) 00000100:00100000:1.0:1787779992.571508:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c048131c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+12:11174:x1874622863675008:12345-192.168.203.31@tcp:101:bash.0 Request processed in 587us (1213us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779992.571516:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 48 00000100:00100000:3.0:1787779992.577299:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787779992.577432:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863675264 00000100:00100000:2.0:1787779992.577454:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863675264 00000100:00100000:2.0:1787779992.577513:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 49 00000100:00100000:2.0:1787779992.577522:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c048131cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+12:11174:x1874622863675264:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:2.0:1787779992.577541:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787779992.577560:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71400/0xc8fc0a51799609fe lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea1dd7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779992.577655:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70a00/0xc8fc0a5179960a05 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779992.577682:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70a00/0xc8fc0a5179960a05 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779992.577693:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70a00/0xc8fc0a5179960a05 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779992.577772:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71a00/0xc8fc0a5179960a0c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779992.577781:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71a00/0xc8fc0a5179960a0c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779992.577788:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71a00/0xc8fc0a5179960a0c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787779992.578140:0:6514:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2:0x0], index 0: 0 00010000:00010000:2.0:1787779992.578288:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71800/0xc8fc0a5179960a13 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779992.578298:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71800/0xc8fc0a5179960a13 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779992.578306:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71800/0xc8fc0a5179960a13 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779992.578338:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70a00/0xc8fc0a5179960a05 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779992.578344:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70a00/0xc8fc0a5179960a05 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779992.578352:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70a00/0xc8fc0a5179960a05 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779992.578366:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0477a70a00 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:2.0:1787779992.578370:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70a00/0xc8fc0a5179960a05 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779992.578378:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70a00/0xc8fc0a5179960a05 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779992.578390:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c0443d81900) 00010000:00010000:2.0:1787779992.578393:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787779992.578397:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70a00/0xc8fc0a5179960a05 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779992.578403:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70a00/0xc8fc0a5179960a05 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787779992.578416:0:6514:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003bee584b reply state 00000000edb76f7c transno 4294967313 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71a00/0xc8fc0a5179960a0c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779992.578427:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71a00/0xc8fc0a5179960a0c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779992.578432:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9c04621c0d00) 00010000:00010000:2.0:1787779992.578435:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787779992.578438:0:6514:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787779992.578468:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71400/0xc8fc0a51799609fe lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1dd7 expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779992.578483:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71800/0xc8fc0a5179960a13 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1dd7 expref: 14 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779992.578502:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c04621c0300) 00010000:00010000:2.0:1787779992.578505:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787779992.578507:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0477a71800, rc 0) 00000100:00100000:2.0:1787779992.578573:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c048131cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+15:11174:x1874622863675264:12345-192.168.203.31@tcp:101:bash.0 Request processed in 1051us (1282us total) trans 4294967313 rc 0/0 00000100:00100000:2.0:1787779992.578580:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 49 00000100:00100000:2.0:1787779992.581717:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787779992.581801:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863675392 00000100:00100000:3.0:1787779992.581810:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863675392 00000100:00100000:3.0:1787779992.581880:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 28 00000100:00100000:3.0:1787779992.581888:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03488be580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2407:x1874622863675392:12345-192.168.203.31@tcp:8:bash.0 00010000:00080000:3.0:1787779992.581921:0:8427:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 781d29bb-23d2-48e3-b16d-c29e52cd5375@192.168.203.31@tcp t0 exp 0000000000000000 cur 400 last 0 00000020:00000080:3.0:1787779992.581957:0:8427:0:(genops.c:1385:class_connect()) connect: client 781d29bb-23d2-48e3-b16d-c29e52cd5375, cookie 0xc8fc0a5179960a21 00002000:00100000:3.0:1787779992.581969:0:8427:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 781d29bb-23d2-48e3-b16d-c29e52cd5375/ffff9c044963a800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113939 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787779992.581981:0:8427:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787779992.582080:0:8427:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787779992.582116:0:8427:0:(import.c:65:import_set_state_nolock()) ffff9c044963f800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787779992.582176:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03488be580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+6:2407:x1874622863675392:12345-192.168.203.31@tcp:8:bash.0 Request processed in 287us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779992.582184:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 28 00000100:00100000:3.0:1787779992.586807:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787779992.587671:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863675520 00000100:00100000:1.0:1787779992.587688:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863675520 00000100:00080000:3.0:1787779992.587826:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787779992.588034:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 29 00000100:00100000:1.0:1787779992.588044:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c048131c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+6:0:x1874622863675520:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:1.0:1787779992.588062:0:9899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787779992.588084:0:9899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a16e8e76/0xc8fc0a5179960a28 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea1dde expref: -99 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787779992.588109:0:9899:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787779992.588129:0:9899:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=400s v=(0 0) 00010000:00010000:1.0:1787779992.588133:0:9899:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787779992.588142:0:9899:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a16e8e76/0xc8fc0a5179960a28 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1dde expref: 7 pid: 9899 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779992.588163:0:9899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a16e8e76/0xc8fc0a5179960a28 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1dde expref: 7 pid: 9899 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779992.588176:0:9899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0346dd7c00, rc 0) 00000100:00100000:1.0:1787779992.588240:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c048131c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+7:0:x1874622863675520:12345-192.168.203.31@tcp:101:bash.0 Request processed in 197us (1517us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779992.588249:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 29 00000100:00100000:0.0:1787779992.593519:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787779992.593651:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863675648 00000100:00100000:3.0:1787779992.593660:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863675648 00000100:00100000:3.0:1787779992.593718:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 30 00000100:00100000:3.0:1787779992.593737:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347feb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+7:11174:x1874622863675648:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:3.0:1787779992.593761:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787779992.593782:0:8427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cc29d83e/0xc8fc0a5179960a2f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea1de5 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779992.593813:0:8427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a16e8e76/0xc8fc0a5179960a28 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1dde expref: 8 pid: 9899 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779992.593823:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787779992.593827:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787779992.593833:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cc29d83e/0xc8fc0a5179960a2f lrc: 4/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1de5 expref: 8 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779992.593902:0:8427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a16e8e76/0xc8fc0a5179960a28 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1dde expref: 8 pid: 9899 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779992.593916:0:8427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a16e8e76/0xc8fc0a5179960a28 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1dde expref: 8 pid: 9899 timeout: 500 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779992.593930:0:8427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c048131e580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1874622881605760:192.168.203.31@tcp:104: 00000100:00100000:3.0:1787779992.594022:0:8427:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c046ef9c480 going to sleep for 11 seconds 00000100:00100000:2.0:1787779992.597446:0:8427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c048131e580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1874622881605760:192.168.203.31@tcp:104: 00010000:00010000:2.0:1787779992.597483:0:8427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000cc29d83e/0xc8fc0a5179960a2f lrc: 3/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1de5 expref: 8 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779992.597502:0:8427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c04766dd400, rc 0) 00000100:00100000:2.0:1787779992.597555:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347feb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+8:11174:x1874622863675648:12345-192.168.203.31@tcp:101:bash.0 Request processed in 3819us (4045us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779992.597563:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 30 00000100:00100000:0.0:1787779992.607524:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787779992.607631:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863675776 00000100:00100000:1.0:1787779992.607641:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863675776 00010000:00010000:1.0:1787779992.607683:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a16e8e76/0xc8fc0a5179960a28 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1dde expref: 8 pid: 9899 timeout: 500 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779992.607827:0:7921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 52 00000100:00100000:3.0:1787779992.607862:0:7921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046099e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+8:2410:x1874622863675776:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787779992.607890:0:7921:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787779992.607910:0:7921:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a16e8e76/0xc8fc0a5179960a28 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1dde expref: 8 pid: 9899 timeout: 500 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779992.607924:0:7921:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a16e8e76/0xc8fc0a5179960a28 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1dde expref: 8 pid: 9899 timeout: 500 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779992.607949:0:7921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a16e8e76/0xc8fc0a5179960a28 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1dde expref: 8 pid: 9899 timeout: 500 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779992.607967:0:7921:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787779992.607971:0:7921:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787779992.607979:0:7921:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000cc29d83e/0xc8fc0a5179960a2f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1de5 expref: 7 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779992.608001:0:7921:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cc29d83e/0xc8fc0a5179960a2f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1de5 expref: 7 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779992.608038:0:7921:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000cc29d83e/0xc8fc0a5179960a2f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1de5 expref: 7 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779992.608051:0:7921:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c048131da40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7921:1874622881605888:192.168.203.31@tcp:105: 00000100:00100000:3.0:1787779992.608140:0:7921:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c046ef9c480 going to sleep for 11 seconds 00000100:00100000:3.0:1787779992.613907:0:7921:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c048131da40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7921:1874622881605888:192.168.203.31@tcp:105: 00010000:00010000:3.0:1787779992.613937:0:7921:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787779992.614009:0:7921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046099e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+7:2410:x1874622863675776:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 6172us (6492us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779992.614019:0:7921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 52 00000100:00100000:3.0:1787779992.615050:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787779992.615236:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863676032 00000100:00100000:1.0:1787779992.615245:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863676032 00000100:00100000:1.0:1787779992.615320:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 6 00000100:00100000:1.0:1787779992.615331:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c048131da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+15:11174:x1874622863676032:12345-192.168.203.31@tcp:35:bash.0 00000100:00100000:1.0:1787779992.615600:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c048131da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+16:11174:x1874622863676032:12345-192.168.203.31@tcp:35:bash.0 Request processed in 270us (552us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1787779992.615606:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 6 00000100:00100000:0.0:1787779992.674535:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787779992.674633:0:12488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863676288 00000100:00100000:3.0:1787779992.674643:0:12488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863676288 00000100:00100000:3.0:1787779992.674714:0:12488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 50 00000100:00100000:3.0:1787779992.674733:0:12488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347fead00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:781d29bb-23d2-48e3-b16d-c29e52cd5375+16:11184:x1874622863676288:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:3.0:1787779992.674769:0:12488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787779992.674791:0:12488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766ddc00/0xc8fc0a5179960a36 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea1dec expref: -99 pid: 12488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787779992.674927:0:12488:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1787779992.675025:0:12488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766ddc00/0xc8fc0a5179960a36 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1dec expref: 18 pid: 12488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779992.675039:0:12488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c0341cd4600) 00010000:00010000:3.0:1787779992.675042:0:12488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787779992.675048:0:12488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766ddc00/0xc8fc0a5179960a36 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1dec expref: 18 pid: 12488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779992.675061:0:12488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c04766ddc00, rc 0) 00000100:00100000:3.0:1787779992.675116:0:12488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347fead00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:781d29bb-23d2-48e3-b16d-c29e52cd5375+17:11184:x1874622863676288:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 394us (591us total) trans 4294967315 rc 301/301 00000100:00100000:3.0:1787779992.675124:0:12488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 50 00000100:00100000:0.0:1787779992.680117:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787779992.684058:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863676544 00000100:00100000:1.0:1787779992.684071:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863676544 00000100:00100000:1.0:1787779992.684176:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 7 00000100:00100000:1.0:1787779992.684186:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347fe8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+17:11184:x1874622863676544:12345-192.168.203.31@tcp:35:lfs.0 00000100:00100000:1.0:1787779992.684426:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347fe8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+18:11184:x1874622863676544:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 240us (4318us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1787779992.684434:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 7 00010000:00010000:0.0:1787779992.732204:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787779992.775299:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787779992.775528:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863676672 00000100:00100000:3.0:1787779992.775545:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863676672 00000100:00100000:3.0:1787779992.775633:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 51 00000100:00100000:3.0:1787779992.775665:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0461becb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+18:11190:x1874622863676672:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:3.0:1787779992.775701:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787779992.775731:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc000/0xc8fc0a5179960a44 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea1df3 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779992.775833:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766ddc00/0xc8fc0a5179960a4b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779992.775909:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766ddc00/0xc8fc0a5179960a4b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779992.775924:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766ddc00/0xc8fc0a5179960a4b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787779992.775992:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1787779992.775997:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787779992.776026:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766ddc00/0xc8fc0a5179960a4b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779992.776059:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc000/0xc8fc0a5179960a44 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1df3 expref: 20 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779992.776083:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766ddc00/0xc8fc0a5179960a4b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1df3 expref: 19 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779992.776094:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c0443d81900) 00010000:00010000:3.0:1787779992.776098:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787779992.776102:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c04766ddc00, rc 0) 00000100:00100000:3.0:1787779992.776191:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0461becb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+19:11190:x1874622863676672:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 529us (902us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779992.776214:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 51 00000100:00100000:3.0:1787779992.783346:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787779992.783512:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863676928 00000100:00100000:1.0:1787779992.783528:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863676928 00000100:00100000:1.0:1787779992.783611:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 52 00000100:00100000:1.0:1787779992.783621:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c048131f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+19:11190:x1874622863676928:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:1.0:1787779992.783640:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787779992.783660:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6a00/0xc8fc0a5179960a52 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea1dfa expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779992.783775:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6600/0xc8fc0a5179960a59 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779992.783789:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6600/0xc8fc0a5179960a59 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779992.783818:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6600/0xc8fc0a5179960a59 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787779992.783831:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:1.0:1787779992.783997:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6a00/0xc8fc0a5179960a52 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1dfa expref: 22 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779992.784017:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6600/0xc8fc0a5179960a59 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1dfa expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779992.784025:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c04621c0300) 00010000:00010000:1.0:1787779992.784028:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787779992.784030:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0346dd6600, rc 0) 00000100:00100000:1.0:1787779992.784114:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c048131f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+21:11190:x1874622863676928:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 494us (784us total) trans 4294967317 rc 0/0 00000100:00100000:1.0:1787779992.784122:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 52 00000100:00100000:0.0:1787779992.789173:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787779992.789298:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787779992.789441:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863677184 00000100:00100000:2.0:1787779992.789458:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863677312 00000100:00100000:3.0:1787779992.789460:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863677184 00000100:00100000:2.0:1787779992.789471:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863677312 00000100:00100000:2.0:1787779992.789574:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 3 00000100:00100000:3.0:1787779992.789575:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 53 00000100:00100000:2.0:1787779992.789598:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347fe9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+22:2408:x1874622863677312:12345-192.168.203.31@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787779992.789599:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347fe8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+22:11190:x1874622863677184:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:2.0:1787779992.789626:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787779992.789638:0:7821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787779992.789655:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6600/0xc8fc0a5179960a59 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1dfa expref: 22 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779992.789688:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c04621c0300) 00010000:00010000:2.0:1787779992.789706:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787779992.789770:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347fe9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+21:2408:x1874622863677312:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 184us (607us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779992.789779:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 3 00010000:00010000:3.0:1787779992.789951:0:7821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc000/0xc8fc0a5179960a67 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea1e01 expref: -99 pid: 7821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779992.790202:0:7821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc600/0xc8fc0a5179960a6e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779992.790221:0:7821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc600/0xc8fc0a5179960a6e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779992.790236:0:7821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc600/0xc8fc0a5179960a6e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787779992.790252:0:7821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1787779992.790622:0:7821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc000/0xc8fc0a5179960a67 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1e01 expref: 23 pid: 7821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779992.790641:0:7821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc600/0xc8fc0a5179960a6e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1e01 expref: 22 pid: 7821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779992.790650:0:7821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c04621c0300) 00010000:00010000:3.0:1787779992.790653:0:7821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787779992.790985:0:7821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c04766dc600, rc 0) 00000100:00100000:3.0:1787779992.791070:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347fe8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+22:11190:x1874622863677184:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 1481us (1771us total) trans 4294967318 rc 0/0 00000100:00100000:3.0:1787779992.791080:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 53 00000100:00100000:0.0:1787779992.800696:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787779992.802178:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863677440 00000100:00100000:2.0:1787779992.802249:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863677440 00000100:00100000:2.0:1787779992.802334:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 31 00000100:00100000:2.0:1787779992.802343:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347feb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+7:2411:x1874622863677440:12345-192.168.203.31@tcp:1:lfs.0 00010000:00010000:2.0:1787779992.802389:0:8428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027232fd7/0xc8fc0a5179960a7c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779992.802410:0:8428:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000cc29d83e/0xc8fc0a5179960a2f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1de5 expref: 7 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779992.802420:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787779992.802424:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787779992.802429:0:8428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027232fd7/0xc8fc0a5179960a7c lrc: 4/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779992.802462:0:8428:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000cc29d83e/0xc8fc0a5179960a2f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1de5 expref: 7 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779992.802475:0:8428:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000cc29d83e/0xc8fc0a5179960a2f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1de5 expref: 7 pid: 8427 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779992.802489:0:8428:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c03488bd2c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1874622881606016:192.168.203.31@tcp:104: 00000100:00100000:2.0:1787779992.802592:0:8428:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0449743cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787779992.812530:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787779992.812660:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863677568 00000100:00100000:3.0:1787779992.812679:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863677568 00000100:00100000:1.0:1787779992.812728:0:8428:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c03488bd2c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1874622881606016:192.168.203.31@tcp:104: 00010000:00010000:1.0:1787779992.812770:0:8428:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000027232fd7/0xc8fc0a5179960a7c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00100000:3.0:1787779992.812773:0:8433:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x2:0x0] (0->12) req@ffff9c03488bc780 x1874622863677568/t0(0) o4->781d29bb-23d2-48e3-b16d-c29e52cd5375@192.168.203.31@tcp:403/0 lens 504/0 e 0 to 0 dl 1787780003 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787779992.812817:0:8433:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c03488bc780 with x1874622863677568 ext(0->12) 00010000:00010000:3.0:1787779992.812830:0:8433:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000cc29d83e/0xc8fc0a5179960a2f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1de5 expref: 8 pid: 8427 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779992.812900:0:8433:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000cc29d83e/0xc8fc0a5179960a2f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1de5 expref: 8 pid: 8427 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787779992.812909:0:8433:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9c03488bc780 00000100:00100000:3.0:1787779992.812947:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 0 00000100:00100000:3.0:1787779992.813169:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03488bc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+8:2410:x1874622863677568:12345-192.168.203.31@tcp:4:lfs.0 00000001:00100000:2.0:1787779992.821710:0:8423:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 781d29bb-23d2-48e3-b16d-c29e52cd5375 00000100:00100000:3.0:1787779992.823069:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03488bc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+9:2410:x1874622863677568:12345-192.168.203.31@tcp:4:lfs.0 Request processed in 10103us (10540us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1787779992.823082:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 0 00002000:00100000:3.0:1787779992.823095:0:8433:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x2:0x0] (0->12) req@ffff9c03488bc780 x1874622863677568/t4294967300(0) o4->781d29bb-23d2-48e3-b16d-c29e52cd5375@192.168.203.31@tcp:403/0 lens 504/448 e 0 to 0 dl 1787780003 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787779992.823106:0:8433:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c03488bc780 with x1874622863677568 ext(0->12) 00010000:00010000:3.0:1787779992.823116:0:8433:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000cc29d83e/0xc8fc0a5179960a2f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1de5 expref: 9 pid: 8427 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779992.823148:0:8433:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000cc29d83e/0xc8fc0a5179960a2f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1de5 expref: 9 pid: 8427 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787779992.823157:0:8433:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9c03488bc780 00000100:00100000:0.0:1787779992.826916:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787779992.827214:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863677696 00000100:00100000:3.0:1787779992.827229:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863677696 00010000:00010000:3.0:1787779992.827288:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000cc29d83e/0xc8fc0a5179960a2f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1de5 expref: 9 pid: 8427 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779992.827337:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 53 00000100:00100000:3.0:1787779992.827350:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347fe9680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+9:2411:x1874622863677696:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787779992.827372:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1787779992.827398:0:6498:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1787779992.827402:0:6498:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb mtime from disk: 0 -> 1787779993 00002000:00010000:3.0:1787779992.827405:0:6498:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb atime from disk: 0 -> 1787779993 00002000:00010000:3.0:1787779992.827407:0:6498:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb ctime from disk: 0 -> 1787779993 00002000:00010000:3.0:1787779992.827410:0:6498:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1787779992.827417:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000cc29d83e/0xc8fc0a5179960a2f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1de5 expref: 9 pid: 8427 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779992.827434:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000cc29d83e/0xc8fc0a5179960a2f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1de5 expref: 9 pid: 8427 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779992.827466:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cc29d83e/0xc8fc0a5179960a2f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1de5 expref: 9 pid: 8427 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779992.827511:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787779992.827516:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787779992.827523:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000027232fd7/0xc8fc0a5179960a7c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779992.827535:0:6498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027232fd7/0xc8fc0a5179960a7c lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779992.827648:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787779992.827729:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347fe9680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+8:2411:x1874622863677696:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 381us (830us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779992.827738:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 53 00010000:00010000:2.0:1787779992.829686:0:8428:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000027232fd7/0xc8fc0a5179960a7c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779992.829711:0:8428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027232fd7/0xc8fc0a5179960a7c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779992.829826:0:8428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027232fd7/0xc8fc0a5179960a7c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779992.829861:0:8428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000027232fd7/0xc8fc0a5179960a7c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779992.829871:0:8428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000027232fd7/0xc8fc0a5179960a7c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779992.829879:0:8428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0477a70600 already unused, calling callback (ffffffffc0d97420) 00010000:00010000:2.0:1787779992.829883:0:8428:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000027232fd7/0xc8fc0a5179960a7c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779992.829893:0:8428:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000027232fd7/0xc8fc0a5179960a7c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779992.829922:0:8428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000027232fd7/0xc8fc0a5179960a7c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779992.829957:0:8428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027232fd7/0xc8fc0a5179960a7c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779992.830080:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347feb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+7:2411:x1874622863677440:12345-192.168.203.31@tcp:1:lfs.0 Request processed in 27730us (29393us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779992.830092:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 31 00000100:00100000:0.0:1787779992.833081:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787779992.833273:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863677952 00000100:00100000:3.0:1787779992.833286:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863677952 00000100:00100000:3.0:1787779992.833347:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 8 00000100:00100000:3.0:1787779992.833358:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347febc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+22:11190:x1874622863677952:12345-192.168.203.31@tcp:35:lfs.0 00000004:00010000:3.0:1787779992.833439:0:6515:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc600/0xc8fc0a5179960a6e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1e01 expref: 22 pid: 7821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787779992.833735:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00000001:00080000:3.0:1787779992.833808:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:3.0:1787779992.834596:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00010000:00010000:3.0:1787779992.834649:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc000/0xc8fc0a5179960a83 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779992.834669:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71800/0xc8fc0a5179960a13 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1dd7 expref: 26 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779992.834689:0:6515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc000/0xc8fc0a5179960a83 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779992.834735:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71800/0xc8fc0a5179960a13 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1dd7 expref: 26 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779992.834764:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71800/0xc8fc0a5179960a13 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1dd7 expref: 26 pid: 6514 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779992.834782:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c048131fc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6515:1874622881606144:192.168.203.31@tcp:104: 00000100:00100000:3.0:1787779992.834925:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0444f62300 going to sleep for 11 seconds 00000100:00100000:3.0:1787779992.844321:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787779992.844521:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863678080 00000100:00100000:2.0:1787779992.844535:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863678080 00010000:00010000:2.0:1787779992.844589:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71800/0xc8fc0a5179960a13 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1dd7 expref: 27 pid: 6514 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779992.844644:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 54 00000100:00100000:2.0:1787779992.844655:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c048131de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+27:2411:x1874622863678080:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787779992.844676:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787779992.844684:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71800/0xc8fc0a5179960a13 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1dd7 expref: 27 pid: 6514 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779992.844699:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71800/0xc8fc0a5179960a13 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1dd7 expref: 27 pid: 6514 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779992.844730:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c04621c0300) 00010000:00010000:2.0:1787779992.844737:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc000/0xc8fc0a5179960a83 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779992.844759:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc000/0xc8fc0a5179960a83 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779992.844791:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc000/0xc8fc0a5179960a83 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779992.844816:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787779992.844936:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c048131de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+27:2411:x1874622863678080:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 282us (631us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779992.844944:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 54 00010000:00010000:0.0:1787779992.845129:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71800/0xc8fc0a5179960a13 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1dd7 expref: 26 pid: 6514 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779992.845150:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c048131fc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6515:1874622881606144:192.168.203.31@tcp:104: 00010000:00010000:0.0:1787779992.845179:0:6515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc000/0xc8fc0a5179960a83 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779992.845189:0:6515:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc000/0xc8fc0a5179960a83 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779992.845195:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc000/0xc8fc0a5179960a83 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787779992.845343:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000001:00080000:0.0:1787779992.845485:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00000100:00100000:0.0:1787779992.845607:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347feb0c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6515:1874622881606272:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787779992.845676:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779992.845715:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0347d45a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787779992.849010:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881606272 00000100:00100000:2.0:1787779992.849031:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881606272 00000100:00100000:2.0:1787779992.849137:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1787779992.849151:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04618eb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6515:x1874622881606272:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787779992.849353:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04618eb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6515:x1874622881606272:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 205us (3677us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779992.849361:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00080000:3.0:1787779992.849538:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787779992.850075:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347feb0c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6515:1874622881606272:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1787779992.850335:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00000100:00100000:1.0:1787779992.850439:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0461befc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6515:1874622881606400:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787779992.850510:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779992.850558:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c04428f7cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787779992.850699:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881606400 00000100:00100000:0.0:1787779992.850707:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881606400 00000100:00100000:0.0:1787779992.850760:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1787779992.850770:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0461bec780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6515:x1874622881606400:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787779992.850939:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0461bec780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6515:x1874622881606400:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 170us (429us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1787779992.850948:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1787779992.851030:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0461befc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6515:1874622881606400:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1787779992.851087:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967325 00010000:00010000:1.0:1787779992.851132:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc000/0xc8fc0a5179960a83 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779992.851143:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc000/0xc8fc0a5179960a83 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779992.851153:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc000/0xc8fc0a5179960a83 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779992.851159:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c04766dc000 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:1.0:1787779992.851165:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc000/0xc8fc0a5179960a83 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779992.851175:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc000/0xc8fc0a5179960a83 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779992.851195:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c04621c0300) 00010000:00010000:1.0:1787779992.851199:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1787779992.851205:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc000/0xc8fc0a5179960a83 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779992.851226:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc000/0xc8fc0a5179960a83 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787779992.851349:0:6515:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1787779992.851431:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:1.0:1787779992.851445:0:6515:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 400855605741ns, next at 401855603093ns, rc = 0 00000001:00080000:1.0:1787779992.851452:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967326 00010000:00010000:1.0:1787779992.851476:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c04621c0300) 00010000:00010000:1.0:1787779992.851488:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787779992.851496:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc600/0xc8fc0a5179960a6e lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1e01 expref: 30 pid: 7821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779992.851617:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347febc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+29:11190:x1874622863677952:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 18259us (18548us total) trans 4294967327 rc 0/0 00000100:00100000:1.0:1787779992.851627:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 8 00000020:00080000:1.0:1787779992.851632:0:6515:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1787779992.853772:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787779992.853900:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863678208 00000100:00100000:2.0:1787779992.853912:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863678208 00000100:00100000:2.0:1787779992.853989:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 54 00000100:00100000:2.0:1787779992.854002:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c048131fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+29:11190:x1874622863678208:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:2.0:1787779992.854034:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787779992.854062:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70600/0xc8fc0a5179960a8a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea1e08 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779992.854147:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70600/0xc8fc0a5179960a8a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1e08 expref: 30 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779992.854165:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70600/0xc8fc0a5179960a8a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1e08 expref: 30 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779992.854212:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c04621c0900) 00010000:00010000:2.0:1787779992.854216:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787779992.854220:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0477a70600, rc 0) 00000100:00100000:2.0:1787779992.854292:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c048131fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+30:11190:x1874622863678208:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 293us (644us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779992.854301:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 54 00000100:00100000:0.0:1787779992.862634:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787779992.863272:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863678464 00000100:00100000:1.0:1787779992.863285:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863678464 00000100:00100000:1.0:1787779992.863353:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 9 00000100:00100000:1.0:1787779992.863365:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c044361bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+30:11190:x1874622863678464:12345-192.168.203.31@tcp:35:lfs.0 00000100:00100000:1.0:1787779992.863735:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c044361bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+31:11190:x1874622863678464:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 371us (1117us total) trans 4294967328 rc 0/0 00000100:00100000:1.0:1787779992.863760:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 9 00000100:00100000:0.0:1787779992.950398:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787779992.950790:0:12488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863678720 00000100:00100000:3.0:1787779992.950802:0:12488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863678720 00000100:00100000:3.0:1787779992.950975:0:12488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 55 00000100:00100000:1.0:1787779992.951292:0:12488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347bce580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:781d29bb-23d2-48e3-b16d-c29e52cd5375+31:11200:x1874622863678720:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:1.0:1787779992.951388:0:12488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787779992.951416:0:12488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6a00/0xc8fc0a5179960a91 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea1e0f expref: -99 pid: 12488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787779992.951545:0:12488:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1787779992.951673:0:12488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6a00/0xc8fc0a5179960a91 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1e0f expref: 33 pid: 12488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779992.951691:0:12488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c0341cd4600) 00010000:00010000:1.0:1787779992.951694:0:12488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787779992.951717:0:12488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6a00/0xc8fc0a5179960a91 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1e0f expref: 33 pid: 12488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779992.951757:0:12488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0346dd6a00, rc 0) 00000100:00100000:1.0:1787779992.951949:0:12488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347bce580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:781d29bb-23d2-48e3-b16d-c29e52cd5375+32:11200:x1874622863678720:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 963us (1561us total) trans 4294967329 rc 301/301 00000100:00100000:1.0:1787779992.951958:0:12488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 55 00000100:00100000:3.0:1787779992.954594:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787779992.954786:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863678848 00000100:00100000:0.0:1787779992.954799:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863678848 00000100:00100000:0.0:1787779992.954923:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 56 00000100:00100000:0.0:1787779992.954935:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c048131e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+32:11200:x1874622863678848:12345-192.168.203.31@tcp:34:lfs.0 00010000:00010000:0.0:1787779992.955046:0:7821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869400/0xc8fc0a5179960a9f lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779992.955067:0:7821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869400/0xc8fc0a5179960a9f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779992.955080:0:7821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869400/0xc8fc0a5179960a9f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779992.955103:0:7821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869000/0xc8fc0a5179960aa6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779992.955111:0:7821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869000/0xc8fc0a5179960aa6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779992.955130:0:7821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869000/0xc8fc0a5179960aa6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779992.955229:0:7821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868400/0xc8fc0a5179960aad lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779992.955238:0:7821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868400/0xc8fc0a5179960aad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779992.955245:0:7821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868400/0xc8fc0a5179960aad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787779992.955590:0:7821:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868400/0xc8fc0a5179960aad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779992.955609:0:7821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869400/0xc8fc0a5179960a9f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779992.955615:0:7821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869400/0xc8fc0a5179960a9f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779992.955620:0:7821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869400/0xc8fc0a5179960a9f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779992.955624:0:7821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0477869400 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:0.0:1787779992.955627:0:7821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869400/0xc8fc0a5179960a9f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779992.955633:0:7821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869400/0xc8fc0a5179960a9f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779992.955644:0:7821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c0443d81900) 00010000:00010000:0.0:1787779992.955652:0:7821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787779992.955707:0:7821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869400/0xc8fc0a5179960a9f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779992.955712:0:7821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869400/0xc8fc0a5179960a9f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779992.955725:0:7821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869000/0xc8fc0a5179960aa6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779992.955728:0:7821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869000/0xc8fc0a5179960aa6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779992.955732:0:7821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869000/0xc8fc0a5179960aa6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779992.955736:0:7821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0477869000 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:0.0:1787779992.955737:0:7821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869000/0xc8fc0a5179960aa6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779992.955752:0:7821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869000/0xc8fc0a5179960aa6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779992.955759:0:7821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9c04621c0d00) 00010000:00010000:0.0:1787779992.955762:0:7821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787779992.955765:0:7821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869000/0xc8fc0a5179960aa6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779992.955769:0:7821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869000/0xc8fc0a5179960aa6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779992.955775:0:7821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868400/0xc8fc0a5179960aad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779992.955784:0:7821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868400/0xc8fc0a5179960aad lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779992.955788:0:7821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868400/0xc8fc0a5179960aad lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779992.955791:0:7821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0477868400 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:0.0:1787779992.955792:0:7821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868400/0xc8fc0a5179960aad lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779992.955796:0:7821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868400/0xc8fc0a5179960aad lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779992.955800:0:7821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c04621c0900) 00010000:00010000:0.0:1787779992.955801:0:7821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787779992.955802:0:7821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868400/0xc8fc0a5179960aad lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779992.955805:0:7821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868400/0xc8fc0a5179960aad lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779992.956173:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c048131e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+32:11200:x1874622863678848:12345-192.168.203.31@tcp:34:lfs.0 Request processed in 1236us (1589us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779992.956184:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 56 00000100:00100000:0.0:1787779992.958497:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787779992.958591:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863679104 00000100:00100000:1.0:1787779992.958603:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863679104 00000100:00100000:1.0:1787779992.958671:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 10 00000100:00100000:1.0:1787779992.958683:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347bcc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+32:11200:x1874622863679104:12345-192.168.203.31@tcp:35:lfs.0 00000100:00100000:1.0:1787779992.959030:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347bcc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+33:11200:x1874622863679104:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 347us (540us total) trans 4294967330 rc 0/0 00000100:00100000:1.0:1787779992.959039:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 10 00000100:00100000:1.0:1787779993.016664:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787779993.016799:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863679360 00000100:00100000:2.0:1787779993.016812:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863679360 00000100:00100000:2.0:1787779993.016943:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 57 00000100:00100000:2.0:1787779993.016956:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347ee0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+33:11203:x1874622863679360:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:2.0:1787779993.017000:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787779993.017031:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71400/0xc8fc0a5179960ab4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea1e16 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779993.017154:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70a00/0xc8fc0a5179960abb lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779993.017173:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70a00/0xc8fc0a5179960abb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779993.017190:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70a00/0xc8fc0a5179960abb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779993.017204:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71800/0xc8fc0a5179960ac2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779993.017212:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71800/0xc8fc0a5179960ac2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779993.017243:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71800/0xc8fc0a5179960ac2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779993.017615:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71600/0xc8fc0a5179960ac9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779993.017626:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71600/0xc8fc0a5179960ac9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779993.017634:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71600/0xc8fc0a5179960ac9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787779993.017647:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1787779993.017787:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70a00/0xc8fc0a5179960abb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779993.017795:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70a00/0xc8fc0a5179960abb lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779993.017802:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70a00/0xc8fc0a5179960abb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779993.017808:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0477a70a00 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:2.0:1787779993.017812:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70a00/0xc8fc0a5179960abb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779993.017821:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70a00/0xc8fc0a5179960abb lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779993.017835:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c0443d81900) 00010000:00010000:2.0:1787779993.017879:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787779993.017893:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70a00/0xc8fc0a5179960abb lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779993.017900:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70a00/0xc8fc0a5179960abb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779993.017917:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71800/0xc8fc0a5179960ac2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779993.017923:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71800/0xc8fc0a5179960ac2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779993.017929:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71800/0xc8fc0a5179960ac2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779993.017935:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0477a71800 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:2.0:1787779993.017938:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71800/0xc8fc0a5179960ac2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779993.017944:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71800/0xc8fc0a5179960ac2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779993.017953:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9c04621c0d00) 00010000:00010000:2.0:1787779993.017955:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787779993.017959:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71800/0xc8fc0a5179960ac2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779993.017965:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71800/0xc8fc0a5179960ac2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779993.018029:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71400/0xc8fc0a5179960ab4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1e16 expref: 36 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779993.018058:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71600/0xc8fc0a5179960ac9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1e16 expref: 35 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779993.018066:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c04621c0900) 00010000:00010000:2.0:1787779993.018068:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787779993.018070:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0477a71600, rc 0) 00000100:00100000:2.0:1787779993.018164:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347ee0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+35:11203:x1874622863679360:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 1209us (1517us total) trans 4294967331 rc 0/0 00000100:00100000:2.0:1787779993.018173:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 57 00000100:00100000:2.0:1787779993.022038:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787779993.022349:0:12488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863679488 00000100:00100000:1.0:1787779993.022363:0:12488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863679488 00000100:00100000:1.0:1787779993.022445:0:12488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 58 00000100:00100000:1.0:1787779993.022458:0:12488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03488bed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:781d29bb-23d2-48e3-b16d-c29e52cd5375+35:11203:x1874622863679488:12345-192.168.203.31@tcp:54:lfs.0 00010000:00010000:1.0:1787779993.022548:0:12488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6e00/0xc8fc0a5179960ad7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779993.022568:0:12488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6e00/0xc8fc0a5179960ad7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779993.022582:0:12488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6e00/0xc8fc0a5179960ad7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779993.022651:0:12488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6e00/0xc8fc0a5179960ad7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779993.022659:0:12488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6e00/0xc8fc0a5179960ad7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779993.022666:0:12488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6e00/0xc8fc0a5179960ad7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779993.022672:0:12488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0346dd6e00 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:1.0:1787779993.022677:0:12488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6e00/0xc8fc0a5179960ad7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779993.022686:0:12488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6e00/0xc8fc0a5179960ad7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779993.022701:0:12488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c04621c0900) 00010000:00010000:1.0:1787779993.022705:0:12488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787779993.022710:0:12488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6e00/0xc8fc0a5179960ad7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779993.022717:0:12488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6e00/0xc8fc0a5179960ad7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779993.022827:0:12488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03488bed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:781d29bb-23d2-48e3-b16d-c29e52cd5375+35:11203:x1874622863679488:12345-192.168.203.31@tcp:54:lfs.0 Request processed in 370us (804us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779993.022871:0:12488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 58 00000100:00100000:1.0:1787779993.032928:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787779993.033106:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863679744 00000100:00100000:0.0:1787779993.033120:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863679744 00000100:00100000:0.0:1787779993.033197:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 11 00000100:00100000:0.0:1787779993.033210:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347fe8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+35:11203:x1874622863679744:12345-192.168.203.31@tcp:35:lfs.0 00000100:00100000:0.0:1787779993.033560:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347fe8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+36:11203:x1874622863679744:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 352us (646us total) trans 4294967332 rc 0/0 00000100:00100000:0.0:1787779993.033569:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 11 00000100:00100000:0.0:1787779993.312349:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787779993.312610:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863680000 00000100:00100000:3.0:1787779993.312623:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863680000 00000100:00100000:3.0:1787779993.312696:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 59 00000100:00100000:3.0:1787779993.312712:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347bcde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+36:11234:x1874622863680000:12345-192.168.203.31@tcp:101:cat.0 00010000:00010000:3.0:1787779993.312755:0:7821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787779993.312782:0:7821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd400/0xc8fc0a5179960ade lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea1e1d expref: -99 pid: 7821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779993.312948:0:7821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a5179960ae5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779993.312980:0:7821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a5179960ae5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779993.312994:0:7821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a5179960ae5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787779993.313007:0:7821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1787779993.313154:0:7821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd400/0xc8fc0a5179960ade lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1e1d expref: 39 pid: 7821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779993.313177:0:7821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a5179960ae5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1e1d expref: 38 pid: 7821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779993.313187:0:7821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c04621c0900) 00010000:00010000:3.0:1787779993.313190:0:7821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787779993.313194:0:7821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c04766dc400, rc 0) 00000100:00100000:3.0:1787779993.313296:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347bcde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+38:11234:x1874622863680000:12345-192.168.203.31@tcp:101:cat.0 Request processed in 591us (969us total) trans 4294967333 rc 0/0 00000100:00100000:3.0:1787779993.313305:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 59 00000100:00100000:2.0:1787779993.317676:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787779993.318049:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787779993.318118:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863680384 00000100:00100000:0.0:1787779993.318131:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863680384 00000100:00100000:0.0:1787779993.318206:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 12 00000100:00100000:0.0:1787779993.318217:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03488bcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+38:11234:x1874622863680384:12345-192.168.203.31@tcp:35:cat.0 00000100:00100000:0.0:1787779993.318717:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03488bcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+39:11234:x1874622863680384:12345-192.168.203.31@tcp:35:cat.0 Request processed in 498us (664us total) trans 4294967334 rc 0/0 00000100:00100000:0.0:1787779993.318727:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 12 00000100:00100000:3.0:1787779993.319184:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863680128 00000100:00100000:3.0:1787779993.319191:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863680128 00000100:00100000:3.0:1787779993.319249:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 4 00000100:00100000:3.0:1787779993.319257:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03488bf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+39:2411:x1874622863680128:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787779993.319277:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787779993.319306:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a5179960ae5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1e1d expref: 39 pid: 7821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779993.319350:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c04621c0900) 00010000:00010000:3.0:1787779993.319356:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787779993.319394:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03488bf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+38:2411:x1874622863680128:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 138us (1732us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779993.319401:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 4 00000100:00100000:3.0:1787779993.372482:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787779993.372517:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347febc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874622881606528:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787779993.372617:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779993.372881:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881606528 00000100:00100000:1.0:1787779993.372893:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881606528 00000100:00100000:1.0:1787779993.372973:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1787779993.372992:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c048131da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1874622881606528:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787779993.373037:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446301696 avail 1300062208 00000100:00100000:1.0:1787779993.373403:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c048131da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1874622881606528:12345-0@lo:41:osp-pre-0-1.0 Request processed in 419us (784us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779993.373412:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1787779993.373501:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347febc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874622881606528:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787779993.403219:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787779993.403386:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863680640 00000100:00100000:0.0:1787779993.403399:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863680640 00000100:00100000:0.0:1787779993.403479:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 60 00000100:00100000:0.0:1787779993.403491:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03488bfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+38:11240:x1874622863680640:12345-192.168.203.31@tcp:101:dd.0 00010000:00010000:0.0:1787779993.403525:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787779993.403529:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787779993.403566:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766ddc00/0xc8fc0a5179960a4b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1df3 expref: 38 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779993.403590:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c0443d81900) 00010000:00010000:0.0:1787779993.403596:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787779993.403631:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869400/0xc8fc0a5179960af3 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea1e24 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779993.403786:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868e00/0xc8fc0a5179960afa lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779993.403823:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71600/0xc8fc0a5179960ac9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1e16 expref: 38 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779993.403834:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868e00/0xc8fc0a5179960afa lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779993.403921:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71600/0xc8fc0a5179960ac9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1e16 expref: 38 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779993.403939:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71600/0xc8fc0a5179960ac9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1e16 expref: 38 pid: 6512 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779993.403956:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347bced00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1874622881606656:192.168.203.31@tcp:104: 00000100:00100000:0.0:1787779993.404212:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0347d45600 going to sleep for 11 seconds 00000100:00100000:3.0:1787779993.411180:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787779993.411476:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863680768 00000100:00100000:2.0:1787779993.411487:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863680768 00010000:00010000:2.0:1787779993.411539:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71600/0xc8fc0a5179960ac9 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1e16 expref: 39 pid: 6512 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779993.411585:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 55 00000100:00100000:2.0:1787779993.411596:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347dac780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+39:2411:x1874622863680768:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787779993.411631:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787779993.411639:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71600/0xc8fc0a5179960ac9 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1e16 expref: 39 pid: 6512 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779993.411656:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71600/0xc8fc0a5179960ac9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1e16 expref: 39 pid: 6512 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779993.411704:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c04621c0900) 00010000:00010000:2.0:1787779993.411711:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868e00/0xc8fc0a5179960afa lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779993.411722:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868e00/0xc8fc0a5179960afa lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779993.411731:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868e00/0xc8fc0a5179960afa lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779993.411771:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787779993.411833:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347dac780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+39:2411:x1874622863680768:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 239us (668us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779993.411865:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 55 00010000:00010000:1.0:1787779993.412629:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71600/0xc8fc0a5179960ac9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1e16 expref: 38 pid: 6512 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779993.412652:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347bced00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1874622881606656:192.168.203.31@tcp:104: 00010000:00010000:1.0:1787779993.412677:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868e00/0xc8fc0a5179960afa lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779993.412689:0:6513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868e00/0xc8fc0a5179960afa lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779993.412696:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868e00/0xc8fc0a5179960afa lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787779993.412720:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:1.0:1787779993.412968:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869400/0xc8fc0a5179960af3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1e24 expref: 39 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779993.412987:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868e00/0xc8fc0a5179960afa lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1e24 expref: 38 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779993.412998:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c04621c0900) 00010000:00010000:1.0:1787779993.413001:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787779993.413020:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0477868e00, rc 0) 00000100:00100000:1.0:1787779993.413071:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03488bfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+38:11240:x1874622863680640:12345-192.168.203.31@tcp:101:dd.0 Request processed in 9582us (9868us total) trans 4294967335 rc 0/0 00000100:00100000:1.0:1787779993.413081:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 60 00000100:00100000:0.0:1787779993.422393:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787779993.427353:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863680896 00000100:00100000:3.0:1787779993.427376:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863680896 00000100:00100000:3.0:1787779993.427470:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 61 00000100:00100000:3.0:1787779993.427482:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347bced00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+38:11240:x1874622863680896:12345-192.168.203.31@tcp:101:dd.0 00010000:00010000:3.0:1787779993.427515:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787779993.427542:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd400/0xc8fc0a5179960b08 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea1e2b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779993.427590:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a5179960b0f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779993.427924:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a5179960b0f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779993.427941:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a5179960b0f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779993.428167:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd400/0xc8fc0a5179960b08 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1e2b expref: 40 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779993.428189:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a5179960b0f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1e2b expref: 39 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779993.428199:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c04621c0900) 00010000:00010000:3.0:1787779993.428203:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787779993.428207:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c04766dc400, rc 0) 00000100:00100000:3.0:1787779993.428346:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347bced00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+39:11240:x1874622863680896:12345-192.168.203.31@tcp:101:dd.0 Request processed in 865us (5967us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779993.428355:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 61 00000100:00100000:3.0:1787779993.438078:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787779993.438953:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863681152 00000100:00100000:2.0:1787779993.438980:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863681152 00000100:00100000:2.0:1787779993.439070:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 62 00000100:00100000:2.0:1787779993.439082:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347dae580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+39:11240:x1874622863681152:12345-192.168.203.31@tcp:36:dd.0 00010000:00010000:2.0:1787779993.439394:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71800/0xc8fc0a5179960b16 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779993.439416:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71800/0xc8fc0a5179960b16 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779993.439429:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71800/0xc8fc0a5179960b16 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787779993.439483:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967336 00000004:00010000:2.0:1787779993.439505:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000031a21a32 reply state 00000000beffeef4 transno 4294967337 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71800/0xc8fc0a5179960b16 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779993.439538:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71800/0xc8fc0a5179960b16 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779993.439545:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c04621c0900) 00010000:00010000:2.0:1787779993.439548:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787779993.439552:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787779993.439679:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347dae580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+42:11240:x1874622863681152:12345-192.168.203.31@tcp:36:dd.0 Request processed in 598us (1614us total) trans 4294967337 rc 0/0 00000100:00100000:2.0:1787779993.439688:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 62 00000020:00080000:2.0:1787779993.439694:0:6512:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000040:00080000:1.0:1787779993.757035:0:13794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787779993.757562:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787779993.782014:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787779993.782157:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863681280 00000100:00100000:0.0:1787779993.782171:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863681280 00000100:00100000:0.0:1787779993.782265:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 63 00000100:00100000:0.0:1787779993.782277:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347feb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+42:11255:x1874622863681280:12345-192.168.203.31@tcp:101:stat.0 00010000:00010000:0.0:1787779993.782320:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787779993.782349:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868800/0xc8fc0a5179960b1d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea1e32 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779993.782723:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869200/0xc8fc0a5179960b24 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779993.782779:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869200/0xc8fc0a5179960b24 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779993.782792:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869200/0xc8fc0a5179960b24 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779993.782807:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869800/0xc8fc0a5179960b2b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779993.782814:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869800/0xc8fc0a5179960b2b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779993.782820:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869800/0xc8fc0a5179960b2b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779993.782956:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869c00/0xc8fc0a5179960b32 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779993.782968:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868e00/0xc8fc0a5179960afa lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1e24 expref: 43 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779993.782979:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869c00/0xc8fc0a5179960b32 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779993.783023:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868e00/0xc8fc0a5179960afa lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1e24 expref: 43 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779993.783040:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868e00/0xc8fc0a5179960afa lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1e24 expref: 43 pid: 6513 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779993.783070:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0476443840 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1874622881606784:192.168.203.31@tcp:104: 00000100:00100000:0.0:1787779993.783193:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0347d45cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787779993.789634:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787779993.789769:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0476443840 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1874622881606784:192.168.203.31@tcp:104: 00010000:00010000:1.0:1787779993.789805:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869c00/0xc8fc0a5179960b32 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779993.790043:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863681536 00000100:00100000:3.0:1787779993.790052:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863681536 00000100:00100000:3.0:1787779993.790124:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 13 00000100:00100000:3.0:1787779993.790136:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0476441a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+44:6177:x1874622863681536:12345-192.168.203.31@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1787779993.792180:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0476441a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+45:6177:x1874622863681536:12345-192.168.203.31@tcp:35:ldlm_bl.0 Request processed in 2034us (2549us total) trans 4294967338 rc 0/0 00000100:00100000:3.0:1787779993.792196:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 13 00000100:00100000:1.0:1787779993.799381:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787779993.799494:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863681664 00000100:00100000:3.0:1787779993.799507:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863681664 00010000:00010000:3.0:1787779993.799565:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868e00/0xc8fc0a5179960afa lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1e24 expref: 45 pid: 6513 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779993.799614:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 56 00000100:00100000:3.0:1787779993.799644:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347febc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+45:2411:x1874622863681664:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787779993.799664:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787779993.799672:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868e00/0xc8fc0a5179960afa lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1e24 expref: 45 pid: 6513 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779993.799688:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868e00/0xc8fc0a5179960afa lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1e24 expref: 45 pid: 6513 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779993.799718:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868e00/0xc8fc0a5179960afa lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1e24 expref: 45 pid: 6513 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779993.800412:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c04621c0900) 00010000:00010000:3.0:1787779993.800419:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869c00/0xc8fc0a5179960b32 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779993.800431:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869c00/0xc8fc0a5179960b32 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779993.800440:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869c00/0xc8fc0a5179960b32 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779993.800480:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787779993.800603:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347febc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+44:2411:x1874622863681664:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 960us (1237us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779993.800613:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 56 00010000:00010000:1.0:1787779993.800691:0:6513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869c00/0xc8fc0a5179960b32 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779993.800701:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869c00/0xc8fc0a5179960b32 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787779993.800793:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:1.0:1787779993.800798:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787779993.800889:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869c00/0xc8fc0a5179960b32 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779993.800905:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869c00/0xc8fc0a5179960b32 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779993.800916:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869200/0xc8fc0a5179960b24 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779993.800922:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869200/0xc8fc0a5179960b24 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779993.800928:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869200/0xc8fc0a5179960b24 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779993.800960:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0477869200 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:1.0:1787779993.800965:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869200/0xc8fc0a5179960b24 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779993.800973:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869200/0xc8fc0a5179960b24 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779993.800994:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c0443d81900) 00010000:00010000:1.0:1787779993.800997:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787779993.801001:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869200/0xc8fc0a5179960b24 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779993.801014:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869200/0xc8fc0a5179960b24 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779993.801027:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869800/0xc8fc0a5179960b2b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779993.801033:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869800/0xc8fc0a5179960b2b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779993.801038:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869800/0xc8fc0a5179960b2b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779993.801043:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0477869800 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:1.0:1787779993.801045:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869800/0xc8fc0a5179960b2b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779993.801051:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869800/0xc8fc0a5179960b2b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779993.801070:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9c04621c0d00) 00010000:00010000:1.0:1787779993.801072:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787779993.801076:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869800/0xc8fc0a5179960b2b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779993.801082:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869800/0xc8fc0a5179960b2b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779993.801121:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868800/0xc8fc0a5179960b1d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1e32 expref: 44 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779993.801135:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869c00/0xc8fc0a5179960b32 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1e32 expref: 43 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779993.801142:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c04621c0900) 00010000:00010000:1.0:1787779993.801144:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787779993.801147:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0477869c00, rc 0) 00000100:00100000:1.0:1787779993.801181:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347feb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+43:11255:x1874622863681280:12345-192.168.203.31@tcp:101:stat.0 Request processed in 18907us (19206us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779993.801190:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 63 00000040:00080000:3.0:1787779993.822532:0:13797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787779993.884393:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787779993.891550:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347daf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881606912:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787779993.891672:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779993.892900:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881606912 00000100:00100000:3.0:1787779993.892917:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881606912 00000100:00100000:3.0:1787779993.893376:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1787779993.893413:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346d4cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874622881606912:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787779993.893465:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787779993.893582:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346d4cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874622881606912:12345-0@lo:41:osp-pre-1-0.0 Request processed in 175us (1910us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779993.893591:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1787779993.893692:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347daf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881606912:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787779993.894308:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787779993.894446:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863681920 00000100:00100000:3.0:1787779993.894453:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863681920 00000100:00100000:3.0:1787779993.894542:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 64 00000100:00100000:3.0:1787779993.894553:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04812a9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+43:11261:x1874622863681920:12345-192.168.203.31@tcp:36:truncate.0 00010000:00010000:3.0:1787779993.894624:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787779993.894660:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869c00/0xc8fc0a5179960b32 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1e32 expref: 43 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779993.894683:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c04621c0900) 00010000:00010000:3.0:1787779993.894689:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787779993.894964:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd400/0xc8fc0a5179960b39 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779993.895086:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd400/0xc8fc0a5179960b39 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779993.895099:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd400/0xc8fc0a5179960b39 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787779993.895152:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967339 00000004:00010000:3.0:1787779993.895178:0:6514:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fabcbff3 reply state 0000000011170979 transno 4294967340 ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd400/0xc8fc0a5179960b39 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779993.895192:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd400/0xc8fc0a5179960b39 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779993.895216:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c04621c0900) 00010000:00010000:3.0:1787779993.895219:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787779993.895222:0:6514:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787779993.895354:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04812a9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+45:11261:x1874622863681920:12345-192.168.203.31@tcp:36:truncate.0 Request processed in 801us (1053us total) trans 4294967340 rc 0/0 00000100:00100000:3.0:1787779993.895363:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 64 00000020:00080000:3.0:1787779993.895381:0:6514:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787779994.131437:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787779994.131541:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863682048 00000100:00100000:2.0:1787779994.131552:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863682048 00000100:00100000:2.0:1787779994.131632:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 65 00000100:00100000:2.0:1787779994.131643:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0476442940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+45:11275:x1874622863682048:12345-192.168.203.31@tcp:101:stat.0 00010000:00010000:2.0:1787779994.131668:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787779994.131691:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70a00/0xc8fc0a5179960b40 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea1e39 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779994.131772:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71600/0xc8fc0a5179960b47 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779994.131787:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71600/0xc8fc0a5179960b47 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779994.131800:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71600/0xc8fc0a5179960b47 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779994.131812:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71400/0xc8fc0a5179960b4e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779994.132165:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71400/0xc8fc0a5179960b4e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779994.132176:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71400/0xc8fc0a5179960b4e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779994.132615:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19000/0xc8fc0a5179960b55 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779994.132626:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19000/0xc8fc0a5179960b55 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779994.132634:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19000/0xc8fc0a5179960b55 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787779994.132677:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00000004:00200000:2.0:1787779994.132682:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787779994.132705:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19000/0xc8fc0a5179960b55 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779994.132717:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19000/0xc8fc0a5179960b55 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779994.132726:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71600/0xc8fc0a5179960b47 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779994.132746:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71600/0xc8fc0a5179960b47 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779994.132753:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71600/0xc8fc0a5179960b47 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779994.132770:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0477a71600 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:2.0:1787779994.132775:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71600/0xc8fc0a5179960b47 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779994.132784:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71600/0xc8fc0a5179960b47 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779994.132797:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c0443d81900) 00010000:00010000:2.0:1787779994.132800:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787779994.132804:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71600/0xc8fc0a5179960b47 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779994.132810:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71600/0xc8fc0a5179960b47 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779994.132823:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71400/0xc8fc0a5179960b4e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779994.132829:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71400/0xc8fc0a5179960b4e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779994.132834:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71400/0xc8fc0a5179960b4e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787779994.132958:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787779994.133097:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0477a71400 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:2.0:1787779994.133101:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71400/0xc8fc0a5179960b4e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779994.133107:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71400/0xc8fc0a5179960b4e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779994.133137:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9c04621c0d00) 00010000:00010000:2.0:1787779994.133139:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787779994.133143:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71400/0xc8fc0a5179960b4e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779994.133149:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71400/0xc8fc0a5179960b4e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779994.133178:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70a00/0xc8fc0a5179960b40 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1e39 expref: 47 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779994.133192:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19000/0xc8fc0a5179960b55 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1e39 expref: 46 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779994.133199:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c04621c0900) 00010000:00010000:2.0:1787779994.133201:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787779994.133204:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0444c19000, rc 0) 00000100:00100000:2.0:1787779994.133330:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0476442940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+46:11275:x1874622863682048:12345-192.168.203.31@tcp:101:stat.0 Request processed in 1687us (1902us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779994.133339:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 65 00000100:00100000:2.0:1787779994.262399:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787779994.262490:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863682304 00000100:00100000:1.0:1787779994.262499:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863682304 00000100:00100000:1.0:1787779994.262560:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 66 00000100:00100000:1.0:1787779994.262570:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03488bd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+46:11285:x1874622863682304:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:1.0:1787779994.262603:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787779994.262623:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6600/0xc8fc0a5179960b5c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea1e40 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787779994.262723:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1787779994.262832:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6600/0xc8fc0a5179960b5c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1e40 expref: 48 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779994.262877:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c0341cd4600) 00010000:00010000:1.0:1787779994.262881:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787779994.262886:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6600/0xc8fc0a5179960b5c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1e40 expref: 48 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779994.262899:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0346dd6600, rc 0) 00000100:00100000:1.0:1787779994.262960:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03488bd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+47:11285:x1874622863682304:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 391us (569us total) trans 4294967341 rc 301/301 00000100:00100000:1.0:1787779994.262967:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 66 00000100:00100000:1.0:1787779994.270524:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787779994.273066:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863682560 00000100:00100000:0.0:1787779994.273079:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863682560 00000100:00100000:0.0:1787779994.273154:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 14 00000100:00100000:0.0:1787779994.273164:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347a87c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+47:11285:x1874622863682560:12345-192.168.203.31@tcp:35:lfs.0 00000100:00100000:0.0:1787779994.273392:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347a87c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+48:11285:x1874622863682560:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 229us (2876us total) trans 4294967342 rc 0/0 00000100:00100000:0.0:1787779994.273400:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 14 00000100:00100000:0.0:1787779994.370981:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787779994.371092:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863682816 00000100:00100000:3.0:1787779994.371102:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863682816 00000100:00100000:3.0:1787779994.371166:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 67 00000100:00100000:3.0:1787779994.371177:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0476443840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+48:11291:x1874622863682816:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:3.0:1787779994.371202:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787779994.371223:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd200/0xc8fc0a5179960b6a lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea1e47 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779994.371368:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dca00/0xc8fc0a5179960b71 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779994.371384:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19000/0xc8fc0a5179960b55 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1e39 expref: 49 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779994.371394:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dca00/0xc8fc0a5179960b71 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779994.371426:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19000/0xc8fc0a5179960b55 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1e39 expref: 49 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779994.371451:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19000/0xc8fc0a5179960b55 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1e39 expref: 49 pid: 6512 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779994.371466:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347dacf00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1874622881607040:192.168.203.31@tcp:104: 00000100:00100000:3.0:1787779994.371563:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0444f62840 going to sleep for 11 seconds 00000100:00100000:3.0:1787779994.375267:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347dacf00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1874622881607040:192.168.203.31@tcp:104: 00010000:00010000:3.0:1787779994.375297:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dca00/0xc8fc0a5179960b71 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779994.376294:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787779994.379209:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863682944 00000100:00100000:2.0:1787779994.379224:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863682944 00010000:00010000:2.0:1787779994.379275:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19000/0xc8fc0a5179960b55 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1e39 expref: 50 pid: 6512 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779994.379325:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 57 00000100:00100000:2.0:1787779994.379336:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046099fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+50:2410:x1874622863682944:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787779994.379368:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787779994.379375:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19000/0xc8fc0a5179960b55 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1e39 expref: 50 pid: 6512 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779994.379389:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19000/0xc8fc0a5179960b55 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1e39 expref: 50 pid: 6512 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779994.379412:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19000/0xc8fc0a5179960b55 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1e39 expref: 50 pid: 6512 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779994.379429:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c04621c0900) 00010000:00010000:2.0:1787779994.379435:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dca00/0xc8fc0a5179960b71 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779994.379444:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dca00/0xc8fc0a5179960b71 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779994.379451:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dca00/0xc8fc0a5179960b71 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779994.379481:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787779994.379544:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046099fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+49:2410:x1874622863682944:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 210us (3253us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779994.379552:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 57 00010000:00010000:3.0:1787779994.379674:0:6514:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dca00/0xc8fc0a5179960b71 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779994.379682:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dca00/0xc8fc0a5179960b71 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787779994.379701:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00010000:00010000:3.0:1787779994.379871:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd200/0xc8fc0a5179960b6a lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1e47 expref: 50 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779994.379886:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dca00/0xc8fc0a5179960b71 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1e47 expref: 49 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779994.379893:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c04621c0900) 00010000:00010000:3.0:1787779994.379896:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787779994.379898:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c04766dca00, rc 0) 00000100:00100000:3.0:1787779994.379926:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0476443840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+49:11291:x1874622863682816:12345-192.168.203.31@tcp:101:bash.0 Request processed in 8752us (8956us total) trans 4294967343 rc 0/0 00000100:00100000:3.0:1787779994.379941:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 67 00000100:00100000:2.0:1787779994.389502:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787779994.389660:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863683200 00000100:00100000:1.0:1787779994.389670:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863683200 00000100:00100000:1.0:1787779994.389743:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 68 00000100:00100000:1.0:1787779994.389755:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03488bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+49:11291:x1874622863683200:12345-192.168.203.31@tcp:36:bash.0 00010000:00010000:1.0:1787779994.390243:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6a00/0xc8fc0a5179960b7f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779994.390261:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6a00/0xc8fc0a5179960b7f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779994.390287:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6a00/0xc8fc0a5179960b7f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787779994.390329:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967344 00000004:00010000:1.0:1787779994.390350:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002b09e865 reply state 00000000a1bd2aa8 transno 4294967345 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6a00/0xc8fc0a5179960b7f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779994.390363:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6a00/0xc8fc0a5179960b7f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779994.390371:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c04621c0900) 00010000:00010000:1.0:1787779994.390374:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787779994.390377:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787779994.390465:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03488bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+52:11291:x1874622863683200:12345-192.168.203.31@tcp:36:bash.0 Request processed in 712us (971us total) trans 4294967345 rc 0/0 00000100:00100000:1.0:1787779994.390472:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 68 00000020:00080000:1.0:1787779994.390477:0:6512:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787779994.400374:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787779994.400455:0:12488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863683328 00000100:00100000:3.0:1787779994.400464:0:12488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863683328 00000100:00100000:3.0:1787779994.400527:0:12488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 69 00000100:00100000:3.0:1787779994.400538:0:12488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0345e74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:781d29bb-23d2-48e3-b16d-c29e52cd5375+52:11291:x1874622863683328:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:3.0:1787779994.400561:0:12488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787779994.400582:0:12488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd200/0xc8fc0a5179960b86 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea1e4e expref: -99 pid: 12488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779994.400673:0:12488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766ddc00/0xc8fc0a5179960b8d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779994.400689:0:12488:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dca00/0xc8fc0a5179960b71 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1e47 expref: 53 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779994.400697:0:12488:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766ddc00/0xc8fc0a5179960b8d lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779994.400729:0:12488:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dca00/0xc8fc0a5179960b71 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1e47 expref: 53 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779994.400755:0:12488:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dca00/0xc8fc0a5179960b71 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1e47 expref: 53 pid: 6514 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779994.400768:0:12488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347dacf00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12488:1874622881607168:192.168.203.31@tcp:104: 00000100:00100000:3.0:1787779994.400897:0:12488:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0444f62840 going to sleep for 11 seconds 00000100:00100000:3.0:1787779994.403995:0:12488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347dacf00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12488:1874622881607168:192.168.203.31@tcp:104: 00010000:00010000:3.0:1787779994.404040:0:12488:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766ddc00/0xc8fc0a5179960b8d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779994.408168:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787779994.408253:0:7921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863683456 00000100:00100000:3.0:1787779994.408261:0:7921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863683456 00010000:00010000:3.0:1787779994.408303:0:7921:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dca00/0xc8fc0a5179960b71 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1e47 expref: 54 pid: 6514 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779994.408351:0:7921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 58 00000100:00100000:3.0:1787779994.408362:0:7921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0345e770c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+54:2410:x1874622863683456:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787779994.408377:0:7921:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787779994.408384:0:7921:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dca00/0xc8fc0a5179960b71 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1e47 expref: 54 pid: 6514 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779994.408397:0:7921:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dca00/0xc8fc0a5179960b71 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1e47 expref: 54 pid: 6514 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779994.408419:0:7921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dca00/0xc8fc0a5179960b71 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1e47 expref: 54 pid: 6514 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779994.408435:0:7921:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c04621c0900) 00010000:00010000:3.0:1787779994.408440:0:7921:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766ddc00/0xc8fc0a5179960b8d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779994.408449:0:7921:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766ddc00/0xc8fc0a5179960b8d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779994.408456:0:7921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766ddc00/0xc8fc0a5179960b8d lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779994.408504:0:7921:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787779994.408560:0:7921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0345e770c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+53:2410:x1874622863683456:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 199us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779994.408567:0:7921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 58 00010000:00010000:0.0:1787779994.408878:0:12488:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766ddc00/0xc8fc0a5179960b8d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779994.408888:0:12488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766ddc00/0xc8fc0a5179960b8d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787779994.408941:0:12488:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:0.0:1787779994.408946:0:12488:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787779994.408967:0:12488:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766ddc00/0xc8fc0a5179960b8d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779994.409008:0:12488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd200/0xc8fc0a5179960b86 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1e4e expref: 53 pid: 12488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779994.409031:0:12488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766ddc00/0xc8fc0a5179960b8d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1e4e expref: 52 pid: 12488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779994.409039:0:12488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c04621c0900) 00010000:00010000:0.0:1787779994.409041:0:12488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787779994.409044:0:12488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c04766ddc00, rc 0) 00000100:00100000:0.0:1787779994.409084:0:12488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0345e74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:781d29bb-23d2-48e3-b16d-c29e52cd5375+52:11291:x1874622863683328:12345-192.168.203.31@tcp:101:bash.0 Request processed in 8548us (8719us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779994.409091:0:12488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 69 00000100:00100000:1.0:1787779994.417473:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787779994.417552:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863683712 00000100:00100000:3.0:1787779994.417561:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863683712 00000100:00100000:3.0:1787779994.417616:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 15 00000100:00100000:3.0:1787779994.417625:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c044361ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+52:11291:x1874622863683712:12345-192.168.203.31@tcp:35:bash.0 00000100:00100000:3.0:1787779994.417998:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c044361ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+53:11291:x1874622863683712:12345-192.168.203.31@tcp:35:bash.0 Request processed in 373us (534us total) trans 4294967346 rc 0/0 00000100:00100000:3.0:1787779994.418006:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 15 00000100:00100000:2.0:1787779994.539914:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787779994.546023:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863683968 00000100:00100000:3.0:1787779994.546038:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863683968 00000100:00100000:0.0:1787779994.546304:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 70 00000100:00100000:0.0:1787779994.546316:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03488bcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+53:11301:x1874622863683968:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:0.0:1787779994.546340:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787779994.546361:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869600/0xc8fc0a5179960b94 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea1e55 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787779994.546455:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1787779994.546551:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869600/0xc8fc0a5179960b94 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1e55 expref: 55 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779994.546565:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c0341cd4600) 00010000:00010000:0.0:1787779994.546567:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787779994.546572:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869600/0xc8fc0a5179960b94 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1e55 expref: 55 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779994.546587:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0477869600, rc 0) 00000100:00100000:0.0:1787779994.546667:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03488bcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+54:11301:x1874622863683968:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 353us (6764us total) trans 4294967347 rc 301/301 00000100:00100000:0.0:1787779994.546674:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 70 00000100:00100000:2.0:1787779994.551779:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787779994.551889:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863684096 00000100:00100000:1.0:1787779994.551898:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863684096 00000100:00100000:1.0:1787779994.551950:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 71 00000100:00100000:1.0:1787779994.551960:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c048131de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+54:11301:x1874622863684096:12345-192.168.203.31@tcp:34:lfs.0 00010000:00010000:1.0:1787779994.552052:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6e00/0xc8fc0a5179960ba2 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779994.552070:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6e00/0xc8fc0a5179960ba2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779994.552098:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6e00/0xc8fc0a5179960ba2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779994.552110:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd7c00/0xc8fc0a5179960ba9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779994.552118:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd7c00/0xc8fc0a5179960ba9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779994.552124:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd7c00/0xc8fc0a5179960ba9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779994.552193:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6000/0xc8fc0a5179960bb0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779994.552202:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6000/0xc8fc0a5179960bb0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779994.552209:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6000/0xc8fc0a5179960bb0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787779994.552252:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6000/0xc8fc0a5179960bb0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779994.552279:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6e00/0xc8fc0a5179960ba2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779994.552285:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6e00/0xc8fc0a5179960ba2 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779994.552290:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6e00/0xc8fc0a5179960ba2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779994.552305:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0346dd6e00 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:1.0:1787779994.552309:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6e00/0xc8fc0a5179960ba2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779994.552315:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6e00/0xc8fc0a5179960ba2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779994.552326:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c0443d81900) 00010000:00010000:1.0:1787779994.552329:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787779994.552333:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6e00/0xc8fc0a5179960ba2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779994.552339:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6e00/0xc8fc0a5179960ba2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779994.552353:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd7c00/0xc8fc0a5179960ba9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779994.552358:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd7c00/0xc8fc0a5179960ba9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779994.552364:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd7c00/0xc8fc0a5179960ba9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779994.552369:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0346dd7c00 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:1.0:1787779994.552372:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd7c00/0xc8fc0a5179960ba9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779994.552377:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd7c00/0xc8fc0a5179960ba9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779994.552393:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9c04621c0d00) 00010000:00010000:1.0:1787779994.552395:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787779994.552398:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd7c00/0xc8fc0a5179960ba9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779994.552404:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd7c00/0xc8fc0a5179960ba9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779994.552412:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6000/0xc8fc0a5179960bb0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779994.552417:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6000/0xc8fc0a5179960bb0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779994.552422:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6000/0xc8fc0a5179960bb0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779994.552436:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0346dd6000 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:1.0:1787779994.552439:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6000/0xc8fc0a5179960bb0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779994.552444:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6000/0xc8fc0a5179960bb0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779994.552450:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c04621c0900) 00010000:00010000:1.0:1787779994.552451:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787779994.552454:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6000/0xc8fc0a5179960bb0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779994.552458:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6000/0xc8fc0a5179960bb0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779994.552535:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c048131de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+54:11301:x1874622863684096:12345-192.168.203.31@tcp:34:lfs.0 Request processed in 576us (766us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779994.552550:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 71 00000100:00100000:3.0:1787779994.554967:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787779994.557632:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863684352 00000100:00100000:0.0:1787779994.557646:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863684352 00000100:00100000:0.0:1787779994.557715:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 16 00000100:00100000:0.0:1787779994.557726:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347dacf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+54:11301:x1874622863684352:12345-192.168.203.31@tcp:35:lfs.0 00000100:00100000:0.0:1787779994.557964:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347dacf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+55:11301:x1874622863684352:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 240us (3003us total) trans 4294967348 rc 0/0 00000100:00100000:0.0:1787779994.557972:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 16 00000100:00100000:2.0:1787779994.633569:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787779994.633981:0:12488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863684608 00000100:00100000:0.0:1787779994.633997:0:12488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863684608 00000100:00100000:0.0:1787779994.634963:0:12488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 72 00000100:00100000:0.0:1787779994.634980:0:12488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347fe8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:781d29bb-23d2-48e3-b16d-c29e52cd5375+55:11304:x1874622863684608:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:0.0:1787779994.635003:0:12488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787779994.635025:0:12488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869600/0xc8fc0a5179960bb7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea1e5c expref: -99 pid: 12488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779994.635558:0:12488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868c00/0xc8fc0a5179960bbe lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779994.635575:0:12488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868c00/0xc8fc0a5179960bbe lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779994.635588:0:12488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868c00/0xc8fc0a5179960bbe lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779994.635601:0:12488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868a00/0xc8fc0a5179960bc5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779994.635622:0:12488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868a00/0xc8fc0a5179960bc5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779994.635632:0:12488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868a00/0xc8fc0a5179960bc5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779994.635749:0:12488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869c00/0xc8fc0a5179960bcc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779994.635760:0:12488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869c00/0xc8fc0a5179960bcc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779994.635767:0:12488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869c00/0xc8fc0a5179960bcc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787779994.635776:0:12488:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:0.0:1787779994.635871:0:12488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868c00/0xc8fc0a5179960bbe lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779994.635879:0:12488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868c00/0xc8fc0a5179960bbe lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779994.635885:0:12488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868c00/0xc8fc0a5179960bbe lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779994.635891:0:12488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0477868c00 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:0.0:1787779994.635895:0:12488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868c00/0xc8fc0a5179960bbe lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779994.635902:0:12488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868c00/0xc8fc0a5179960bbe lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779994.635924:0:12488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c0443d81900) 00010000:00010000:0.0:1787779994.635927:0:12488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787779994.635931:0:12488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868c00/0xc8fc0a5179960bbe lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779994.635937:0:12488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868c00/0xc8fc0a5179960bbe lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779994.635952:0:12488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868a00/0xc8fc0a5179960bc5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779994.635958:0:12488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868a00/0xc8fc0a5179960bc5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779994.635963:0:12488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868a00/0xc8fc0a5179960bc5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779994.635968:0:12488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0477868a00 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:0.0:1787779994.635970:0:12488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868a00/0xc8fc0a5179960bc5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779994.635976:0:12488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868a00/0xc8fc0a5179960bc5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779994.635983:0:12488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9c04621c0d00) 00010000:00010000:0.0:1787779994.635985:0:12488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787779994.635988:0:12488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868a00/0xc8fc0a5179960bc5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779994.635993:0:12488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868a00/0xc8fc0a5179960bc5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779994.636038:0:12488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869600/0xc8fc0a5179960bb7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1e5c expref: 58 pid: 12488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779994.637047:0:12488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869c00/0xc8fc0a5179960bcc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1e5c expref: 57 pid: 12488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779994.637056:0:12488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c04621c0900) 00010000:00010000:0.0:1787779994.637058:0:12488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787779994.637061:0:12488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0477869c00, rc 0) 00000100:00100000:0.0:1787779994.637134:0:12488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347fe8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:781d29bb-23d2-48e3-b16d-c29e52cd5375+57:11304:x1874622863684608:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 2159us (3581us total) trans 4294967349 rc 0/0 00000100:00100000:0.0:1787779994.637143:0:12488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 72 00000100:00100000:2.0:1787779994.649952:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787779994.650478:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787779994.650621:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863684736 00000100:00100000:1.0:1787779994.650637:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863684736 00000100:00100000:1.0:1787779994.650785:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 73 00000100:00100000:1.0:1787779994.650797:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347fe9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+57:11304:x1874622863684736:12345-192.168.203.31@tcp:54:lfs.0 00010000:00010000:1.0:1787779994.650895:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6000/0xc8fc0a5179960bda lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779994.650913:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6000/0xc8fc0a5179960bda lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779994.650926:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6000/0xc8fc0a5179960bda lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779994.650959:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6000/0xc8fc0a5179960bda lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779994.650967:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6000/0xc8fc0a5179960bda lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779994.650975:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6000/0xc8fc0a5179960bda lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779994.650981:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0346dd6000 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:1.0:1787779994.650986:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6000/0xc8fc0a5179960bda lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779994.650994:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6000/0xc8fc0a5179960bda lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779994.651033:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c04621c0900) 00010000:00010000:1.0:1787779994.651040:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787779994.651045:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6000/0xc8fc0a5179960bda lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779994.651053:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6000/0xc8fc0a5179960bda lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779994.651139:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347fe9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+57:11304:x1874622863684736:12345-192.168.203.31@tcp:54:lfs.0 Request processed in 343us (1204us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779994.651147:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 73 00000100:00100000:3.0:1787779994.657066:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863684864 00000100:00100000:3.0:1787779994.657087:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863684864 00000100:00100000:3.0:1787779994.657247:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 5 00000100:00100000:3.0:1787779994.657261:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347fe9680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+57:2411:x1874622863684864:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787779994.657283:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787779994.657318:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869c00/0xc8fc0a5179960bcc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1e5c expref: 57 pid: 12488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779994.657355:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c04621c0900) 00010000:00010000:3.0:1787779994.657361:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787779994.657475:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347fe9680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+56:2411:x1874622863684864:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 218us (6999us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779994.657506:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 5 00000100:00100000:2.0:1787779994.660658:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787779994.660780:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863685120 00000100:00100000:0.0:1787779994.660793:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863685120 00000100:00100000:0.0:1787779994.660980:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 17 00000100:00100000:0.0:1787779994.660992:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347febc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+56:11304:x1874622863685120:12345-192.168.203.31@tcp:35:lfs.0 00000100:00100000:0.0:1787779994.661561:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347febc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+57:11304:x1874622863685120:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 570us (915us total) trans 4294967350 rc 0/0 00000100:00100000:0.0:1787779994.661572:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 17 00000001:00080000:1.0:1787779994.668743:0:6491:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967350 is committed 00000004:00080000:1.0:1787779994.668814:0:6491:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:1.0:1787779994.668875:0:6491:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9c04458d6540 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:1.0:1787779994.668882:0:6491:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c0446131300 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9c04619b1780 00000020:00080000:1.0:1787779994.668885:0:6491:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c0446131d00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9c0346b79a00 00010000:00010000:2.0:1787779994.669395:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd600/0xc8fc0a51799609c6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779994.669410:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd600/0xc8fc0a51799609c6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779994.669419:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd600/0xc8fc0a51799609c6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779994.669426:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c04766dd600 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:2.0:1787779994.669431:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd600/0xc8fc0a51799609c6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779994.669440:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd600/0xc8fc0a51799609c6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779994.669464:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9c0443d81300) 00010000:00010000:2.0:1787779994.669467:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787779994.669474:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd600/0xc8fc0a51799609c6 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779994.669480:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd600/0xc8fc0a51799609c6 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779994.669503:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc200/0xc8fc0a51799609cd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779994.669508:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc200/0xc8fc0a51799609cd lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779994.669538:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc200/0xc8fc0a51799609cd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779994.669543:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c04766dc200 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:2.0:1787779994.669545:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc200/0xc8fc0a51799609cd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779994.669551:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc200/0xc8fc0a51799609cd lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779994.669560:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c0443d81900) 00010000:00010000:2.0:1787779994.669562:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787779994.669565:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc200/0xc8fc0a51799609cd lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779994.669570:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc200/0xc8fc0a51799609cd lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779994.669588:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71a00/0xc8fc0a5179960a0c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779994.669593:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71a00/0xc8fc0a5179960a0c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779994.669598:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71a00/0xc8fc0a5179960a0c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779994.669602:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0477a71a00 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:2.0:1787779994.669605:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71a00/0xc8fc0a5179960a0c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779994.669624:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71a00/0xc8fc0a5179960a0c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779994.669633:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9c04621c0d00) 00010000:00010000:2.0:1787779994.669635:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787779994.669638:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71a00/0xc8fc0a5179960a0c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779994.669645:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71a00/0xc8fc0a5179960a0c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779994.669662:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71800/0xc8fc0a5179960b16 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779994.669668:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71800/0xc8fc0a5179960b16 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779994.669673:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71800/0xc8fc0a5179960b16 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779994.669678:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0477a71800 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:2.0:1787779994.669681:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71800/0xc8fc0a5179960b16 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779994.669688:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71800/0xc8fc0a5179960b16 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779994.669695:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c04621c0900) 00010000:00010000:2.0:1787779994.669698:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787779994.669700:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71800/0xc8fc0a5179960b16 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779994.669715:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71800/0xc8fc0a5179960b16 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779994.669727:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd400/0xc8fc0a5179960b39 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779994.669741:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd400/0xc8fc0a5179960b39 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779994.669747:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd400/0xc8fc0a5179960b39 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779994.669752:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c04766dd400 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:2.0:1787779994.669754:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd400/0xc8fc0a5179960b39 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779994.669760:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd400/0xc8fc0a5179960b39 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779994.669768:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c04621c0900) 00010000:00010000:2.0:1787779994.669770:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787779994.669773:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd400/0xc8fc0a5179960b39 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779994.669778:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd400/0xc8fc0a5179960b39 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779994.669788:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6a00/0xc8fc0a5179960b7f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779994.669793:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6a00/0xc8fc0a5179960b7f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779994.669805:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6a00/0xc8fc0a5179960b7f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779994.669809:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0346dd6a00 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:2.0:1787779994.669811:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6a00/0xc8fc0a5179960b7f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779994.669817:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6a00/0xc8fc0a5179960b7f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779994.669825:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c04621c0900) 00010000:00010000:2.0:1787779994.669827:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787779994.669829:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6a00/0xc8fc0a5179960b7f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779994.669835:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6a00/0xc8fc0a5179960b7f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779994.669896:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787779994.669919:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346da4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881607296:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787779994.670038:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779994.675311:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881607296 00000100:00100000:1.0:1787779994.675330:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881607296 00000100:00100000:1.0:1787779994.675413:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787779994.675425:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347e592c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3644:x1874622881607296:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1787779994.675468:0:9899:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2 count 1 00002000:00010000:1.0:1787779994.675508:0:9899:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 13, mtime: 0x6a8f5b99, atime: 0x6a8f5b99, ctime: 0x6a8f5b99, blocks: 0x8 00010000:00010000:1.0:1787779994.675517:0:9899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d70f423b/0xc8fc0a5179960be1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779994.675536:0:9899:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=402s v=(0 0) 00010000:00010000:1.0:1787779994.675559:0:9899:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787779994.675567:0:9899:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d70f423b/0xc8fc0a5179960be1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779994.675589:0:9899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d70f423b/0xc8fc0a5179960be1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779994.675599:0:9899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d70f423b/0xc8fc0a5179960be1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779994.675607:0:9899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d70f423b/0xc8fc0a5179960be1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779994.675628:0:9899:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787779994.677054:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347e592c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3644:x1874622881607296:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1625us (7009us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1787779994.677067:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000020:00080000:2.0:1787779994.677169:0:6544:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:2.0:1787779994.677365:0:6544:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00010000:00010000:2.0:1787779994.677380:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787779994.677390:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d70f423b/0xc8fc0a5179960be1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779994.677401:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0346dd6000 already unused, calling callback (ffffffffc0d97420) 00010000:00010000:2.0:1787779994.677407:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d70f423b/0xc8fc0a5179960be1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779994.677425:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d70f423b/0xc8fc0a5179960be1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779994.677450:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d70f423b/0xc8fc0a5179960be1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779994.677458:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d70f423b/0xc8fc0a5179960be1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779994.677485:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787779994.677487:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787779994.677489:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1787779994.677537:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c0346da4780/2, rc 0, transno 4294967302 00000100:00100000:2.0:1787779994.677546:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346da4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881607296:0@lo:6:osp-syn-0-0.0 00000100:00080000:3.0:1787779994.679701:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787779994.780657:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787779994.921255:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787779994.921573:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863685376 00000100:00100000:0.0:1787779994.921586:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863685376 00000100:00100000:0.0:1787779994.921668:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 74 00000100:00100000:0.0:1787779994.921679:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347e58b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+12:11322:x1874622863685376:12345-192.168.203.31@tcp:101:cat.0 00010000:00010000:0.0:1787779994.921711:0:7821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787779994.921767:0:7821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868a00/0xc8fc0a5179960be8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea1e63 expref: -99 pid: 7821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779994.921982:0:7821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868c00/0xc8fc0a5179960bef lrc: 3/1,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779994.922000:0:7821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868c00/0xc8fc0a5179960bef lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779994.922013:0:7821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868c00/0xc8fc0a5179960bef lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787779994.922201:0:7821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:0.0:1787779994.922523:0:7821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868a00/0xc8fc0a5179960be8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1e63 expref: 15 pid: 7821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779994.922547:0:7821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868c00/0xc8fc0a5179960bef lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1e63 expref: 14 pid: 7821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779994.922558:0:7821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c04621c0900) 00010000:00010000:0.0:1787779994.922561:0:7821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787779994.922565:0:7821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0477868c00, rc 0) 00000100:00100000:0.0:1787779994.922702:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347e58b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+14:11322:x1874622863685376:12345-192.168.203.31@tcp:101:cat.0 Request processed in 1024us (1462us total) trans 4294967351 rc 0/0 00000100:00100000:0.0:1787779994.922712:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 74 00000100:00100000:2.0:1787779994.960146:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787779994.960268:0:12488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863685504 00000100:00100000:0.0:1787779994.960282:0:12488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863685504 00000100:00100000:0.0:1787779994.960358:0:12488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 75 00000100:00100000:0.0:1787779994.960370:0:12488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347e5a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:781d29bb-23d2-48e3-b16d-c29e52cd5375+14:11323:x1874622863685504:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:0.0:1787779994.960423:0:12488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787779994.960451:0:12488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868a00/0xc8fc0a5179960bfd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea1e6a expref: -99 pid: 12488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779994.960541:0:12488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868000/0xc8fc0a5179960c04 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779994.960560:0:12488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868000/0xc8fc0a5179960c04 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779994.960574:0:12488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868000/0xc8fc0a5179960c04 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787779994.960631:0:12488:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1787779994.960636:0:12488:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787779994.960660:0:12488:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868000/0xc8fc0a5179960c04 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779994.960695:0:12488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868a00/0xc8fc0a5179960bfd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1e6a expref: 16 pid: 12488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779994.960718:0:12488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868000/0xc8fc0a5179960c04 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1e6a expref: 15 pid: 12488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779994.960738:0:12488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c0443d81900) 00010000:00010000:0.0:1787779994.960741:0:12488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787779994.960746:0:12488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0477868000, rc 0) 00000100:00100000:0.0:1787779994.960940:0:12488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347e5a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:781d29bb-23d2-48e3-b16d-c29e52cd5375+15:11323:x1874622863685504:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 571us (808us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779994.960949:0:12488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 75 00000100:00100000:1.0:1787779994.974761:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787779994.978127:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863685888 00000100:00100000:3.0:1787779994.978148:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863685888 00000100:00100000:3.0:1787779994.978372:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 18 00000100:00100000:3.0:1787779994.978386:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346da6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+15:11323:x1874622863685888:12345-192.168.203.31@tcp:35:lfs.0 00000100:00100000:3.0:1787779994.980883:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346da6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+16:11323:x1874622863685888:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 2486us (6124us total) trans 4294967352 rc 0/0 00000100:00100000:3.0:1787779994.980900:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 18 00000100:00100000:2.0:1787779994.987782:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787779994.988371:0:7921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863686016 00000100:00100000:3.0:1787779994.988385:0:7921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863686016 00000100:00100000:3.0:1787779994.988583:0:7921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 6 00000100:00100000:3.0:1787779994.988597:0:7921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347e58780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+16:11323:x1874622863686016:12345-192.168.203.31@tcp:103:lfs.0 00010000:00010000:3.0:1787779994.988621:0:7921:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1787779994.988654:0:7921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766ddc00/0xc8fc0a5179960b8d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1e4e expref: 16 pid: 12488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779994.988683:0:7921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868c00/0xc8fc0a5179960bef lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1e63 expref: 15 pid: 7821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779994.988701:0:7921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70600/0xc8fc0a5179960a8a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1e08 expref: 14 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779994.988712:0:7921:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c04621c0900) 00010000:00010000:3.0:1787779994.988718:0:7921:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787779994.988806:0:7921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347e58780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+13:11323:x1874622863686016:12345-192.168.203.31@tcp:103:lfs.0 Request processed in 212us (1039us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779994.988828:0:7921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 6 00000100:00100000:2.0:1787779994.996547:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787779994.996812:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863686144 00000100:00100000:1.0:1787779994.996825:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863686144 00000100:00100000:1.0:1787779994.997490:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 76 00000100:00100000:1.0:1787779994.997503:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347e5a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+13:11323:x1874622863686144:12345-192.168.203.31@tcp:58:lfs.0 00010000:00010000:1.0:1787779994.997658:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6e00/0xc8fc0a5179960c0b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779994.997681:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6e00/0xc8fc0a5179960c0b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779994.999835:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6e00/0xc8fc0a5179960c0b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787779995.003835:0:6512:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787779995.004047:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:1.0:1787779995.004163:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:1.0:1787779995.004309:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347e5a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+13:11323:x1874622863686144:12345-192.168.203.31@tcp:58:lfs.0 Request processed in 6800us (7769us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779995.004323:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 76 00000100:00100000:2.0:1787779995.063653:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787779995.063812:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863686272 00000100:00100000:0.0:1787779995.063825:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863686272 00000100:00100000:0.0:1787779995.063932:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 77 00000100:00100000:0.0:1787779995.063943:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347e5b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+13:11325:x1874622863686272:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:0.0:1787779995.063975:0:7821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787779995.064009:0:7821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868a00/0xc8fc0a5179960c12 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea1e71 expref: -99 pid: 7821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779995.064110:0:7821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868800/0xc8fc0a5179960c19 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779995.064126:0:7821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868800/0xc8fc0a5179960c19 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779995.064140:0:7821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868800/0xc8fc0a5179960c19 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779995.064159:0:7821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869800/0xc8fc0a5179960c20 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779995.064166:0:7821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869800/0xc8fc0a5179960c20 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779995.064173:0:7821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869800/0xc8fc0a5179960c20 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779995.064262:0:7821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869200/0xc8fc0a5179960c27 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779995.064271:0:7821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869200/0xc8fc0a5179960c27 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779995.064299:0:7821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869200/0xc8fc0a5179960c27 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787779995.064355:0:7821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:0.0:1787779995.064360:0:7821:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787779995.064382:0:7821:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869200/0xc8fc0a5179960c27 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779995.064397:0:7821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869200/0xc8fc0a5179960c27 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779995.064406:0:7821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868800/0xc8fc0a5179960c19 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779995.064413:0:7821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868800/0xc8fc0a5179960c19 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779995.064419:0:7821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868800/0xc8fc0a5179960c19 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779995.064426:0:7821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0477868800 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:0.0:1787779995.064431:0:7821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868800/0xc8fc0a5179960c19 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779995.064440:0:7821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868800/0xc8fc0a5179960c19 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779995.064452:0:7821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c0443d81900) 00010000:00010000:0.0:1787779995.064455:0:7821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787779995.064461:0:7821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868800/0xc8fc0a5179960c19 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779995.064479:0:7821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868800/0xc8fc0a5179960c19 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779995.064497:0:7821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869800/0xc8fc0a5179960c20 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779995.064504:0:7821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869800/0xc8fc0a5179960c20 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779995.064510:0:7821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869800/0xc8fc0a5179960c20 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779995.064697:0:7821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0477869800 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:0.0:1787779995.064701:0:7821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869800/0xc8fc0a5179960c20 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779995.064708:0:7821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869800/0xc8fc0a5179960c20 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779995.064716:0:7821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9c0347bec800) 00010000:00010000:0.0:1787779995.064719:0:7821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787779995.064722:0:7821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869800/0xc8fc0a5179960c20 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779995.064737:0:7821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869800/0xc8fc0a5179960c20 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779995.064775:0:7821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868a00/0xc8fc0a5179960c12 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1e71 expref: 15 pid: 7821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779995.064788:0:7821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869200/0xc8fc0a5179960c27 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1e71 expref: 14 pid: 7821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779995.064802:0:7821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c04621c0900) 00010000:00010000:0.0:1787779995.064805:0:7821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787779995.064808:0:7821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0477869200, rc 0) 00000100:00100000:0.0:1787779995.064928:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347e5b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+14:11325:x1874622863686272:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 986us (1288us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779995.064941:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 77 00000040:00080000:1.0:1787779995.805060:0:13794:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787779995.805072:0:13794:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787779995.805118:0:13794:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1787779995.805128:0:13794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787779995.805331:0:13794:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347c37c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13794:1874622881607424:192.168.203.31@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787779995.805460:0:13794:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0347ec69c0 going to sleep for 11 seconds 00010000:00010000:3.0:1787779995.806056:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787779995.812421:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787779995.812475:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863686400 00000100:00100000:2.0:1787779995.812486:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863686400 00000100:00100000:1.0:1787779995.812797:0:13794:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347c37c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13794:1874622881607424:192.168.203.31@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787779995.813660:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 78 00000100:00100000:2.0:1787779995.813677:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347e58f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+14:11336:x1874622863686400:12345-192.168.203.31@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787779995.813731:0:6513:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787779995.813912:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347e58f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+14:11336:x1874622863686400:12345-192.168.203.31@tcp:53:lhsmtool_posix.0 Request processed in 240us (1507us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779995.813921:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 78 00000100:00100000:2.0:1787779995.826916:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787779995.827054:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863686528 00000100:00100000:3.0:1787779995.827067:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863686528 00000100:00100000:3.0:1787779995.827147:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 79 00000100:00100000:3.0:1787779995.827159:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347e59680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+14:11336:x1874622863686528:12345-192.168.203.31@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787779995.827258:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766ddc00/0xc8fc0a5179960c2e lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779995.827281:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766ddc00/0xc8fc0a5179960c2e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779995.827295:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766ddc00/0xc8fc0a5179960c2e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779995.836143:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19200/0xc8fc0a5179960c35 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779995.836174:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19200/0xc8fc0a5179960c35 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779995.836191:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19200/0xc8fc0a5179960c35 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779995.836244:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18800/0xc8fc0a5179960c3c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779995.836254:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18800/0xc8fc0a5179960c3c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779995.836261:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18800/0xc8fc0a5179960c3c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787779995.836328:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1787779995.836333:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787779995.836351:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18800/0xc8fc0a5179960c3c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779995.836366:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766ddc00/0xc8fc0a5179960c2e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779995.836372:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766ddc00/0xc8fc0a5179960c2e lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779995.836402:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766ddc00/0xc8fc0a5179960c2e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779995.836409:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c04766ddc00 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:2.0:1787779995.836414:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766ddc00/0xc8fc0a5179960c2e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779995.836423:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766ddc00/0xc8fc0a5179960c2e lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779995.836441:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c0347a50800) 00010000:00010000:2.0:1787779995.836445:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787779995.836450:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766ddc00/0xc8fc0a5179960c2e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779995.836456:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766ddc00/0xc8fc0a5179960c2e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779995.836471:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19200/0xc8fc0a5179960c35 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779995.836477:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19200/0xc8fc0a5179960c35 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779995.836482:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19200/0xc8fc0a5179960c35 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779995.836487:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0444c19200 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:2.0:1787779995.836489:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19200/0xc8fc0a5179960c35 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779995.836505:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19200/0xc8fc0a5179960c35 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779995.836513:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x840cc931 (ffff9c04621c0400) 00010000:00010000:2.0:1787779995.836516:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787779995.836519:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19200/0xc8fc0a5179960c35 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779995.836525:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19200/0xc8fc0a5179960c35 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779995.836552:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18800/0xc8fc0a5179960c3c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779995.836558:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18800/0xc8fc0a5179960c3c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779995.836564:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18800/0xc8fc0a5179960c3c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779995.836569:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0444c18800 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:2.0:1787779995.836572:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18800/0xc8fc0a5179960c3c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779995.836578:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18800/0xc8fc0a5179960c3c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779995.836584:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c04621c0900) 00010000:00010000:2.0:1787779995.836586:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787779995.836589:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18800/0xc8fc0a5179960c3c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779995.836610:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18800/0xc8fc0a5179960c3c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779995.836748:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347e59680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+14:11336:x1874622863686528:12345-192.168.203.31@tcp:34:lhsmtool_posix.0 Request processed in 9581us (9837us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779995.836758:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 79 00000100:00100000:1.0:1787779995.841090:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787779995.841381:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863686784 00000100:00100000:3.0:1787779995.841395:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863686784 00000100:00100000:3.0:1787779995.841475:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 80 00000100:00100000:3.0:1787779995.841486:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347c37c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+14:11336:x1874622863686784:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787779995.841516:0:7821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787779995.841545:0:7821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dca00/0xc8fc0a5179960c43 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea1e78 expref: -99 pid: 7821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779995.841706:0:7821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc600/0xc8fc0a5179960c4a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779995.841733:0:7821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc600/0xc8fc0a5179960c4a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779995.841768:0:7821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc600/0xc8fc0a5179960c4a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787779995.841782:0:7821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:3.0:1787779995.842042:0:7821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc600/0xc8fc0a5179960c4a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779995.842052:0:7821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc600/0xc8fc0a5179960c4a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779995.842059:0:7821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc600/0xc8fc0a5179960c4a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779995.842066:0:7821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c04766dc600 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:3.0:1787779995.842070:0:7821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc600/0xc8fc0a5179960c4a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779995.842078:0:7821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc600/0xc8fc0a5179960c4a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779995.842093:0:7821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c04621c0900) 00010000:00010000:3.0:1787779995.842096:0:7821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787779995.842101:0:7821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc600/0xc8fc0a5179960c4a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779995.842108:0:7821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc600/0xc8fc0a5179960c4a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779995.842164:0:7821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dca00/0xc8fc0a5179960c43 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1e78 expref: 16 pid: 7821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779995.842189:0:7821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c0347a50800) 00010000:00010000:3.0:1787779995.842191:0:7821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787779995.842196:0:7821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dca00/0xc8fc0a5179960c43 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1e78 expref: 16 pid: 7821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779995.842207:0:7821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c04766dca00, rc 0) 00000100:00100000:3.0:1787779995.843096:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347c37c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+15:11336:x1874622863686784:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 1603us (2009us total) trans 4294967353 rc 301/301 00000100:00100000:3.0:1787779995.843108:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 80 00000100:00100000:2.0:1787779995.865151:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787779995.865258:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863686912 00000100:00100000:3.0:1787779995.865272:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863686912 00000100:00100000:3.0:1787779995.865342:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 81 00000100:00100000:3.0:1787779995.865352:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347e5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+15:11336:x1874622863686912:12345-192.168.203.31@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787779995.865385:0:6514:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787779995.865510:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347e5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+15:11336:x1874622863686912:12345-192.168.203.31@tcp:53:lhsmtool_posix.0 Request processed in 158us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779995.865517:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 81 00000100:00100000:3.0:1787779995.872437:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787779995.877245:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863687168 00000100:00100000:1.0:1787779995.877259:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863687168 00000100:00100000:1.0:1787779995.877356:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 82 00000100:00100000:1.0:1787779995.877369:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347dac780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+15:11336:x1874622863687168:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787779995.877391:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787779995.877395:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787779995.877420:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868000/0xc8fc0a5179960c04 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1e6a expref: 15 pid: 12488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779995.877453:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c0443d81900) 00010000:00010000:1.0:1787779995.877458:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787779995.877473:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd7c00/0xc8fc0a5179960c58 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea1e7f expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787779995.878397:0:6512:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x3:0x0], index 1: 0 00010000:00010000:1.0:1787779995.878545:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6600/0xc8fc0a5179960c5f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779995.878558:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6600/0xc8fc0a5179960c5f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779995.878569:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6600/0xc8fc0a5179960c5f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779995.878624:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd7c00/0xc8fc0a5179960c58 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1e7f expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779995.878641:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6600/0xc8fc0a5179960c5f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1e7f expref: 16 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779995.878648:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9c0341cd1b00) 00010000:00010000:1.0:1787779995.878651:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787779995.878654:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0346dd6600, rc 0) 00000100:00100000:1.0:1787779995.878931:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347dac780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+16:11336:x1874622863687168:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 1564us (6502us total) trans 4294967354 rc 0/0 00000100:00100000:1.0:1787779995.878941:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 82 00000100:00100000:3.0:1787779995.884720:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787779995.884938:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863687424 00000100:00100000:0.0:1787779995.884956:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863687424 00000100:00100000:0.0:1787779995.885030:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 83 00000100:00100000:0.0:1787779995.885041:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347daf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+16:11336:x1874622863687424:12345-192.168.203.31@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787779995.885118:0:7821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787779995.885153:0:7821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6600/0xc8fc0a5179960c5f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1e7f expref: 16 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779995.885195:0:7821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9c0341cd1b00) 00010000:00010000:0.0:1787779995.885209:0:7821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787779995.885372:0:7821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04427dbc00/0xc8fc0a5179960c6d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779995.885391:0:7821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c04427dbc00/0xc8fc0a5179960c6d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779995.885402:0:7821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c04427dbc00/0xc8fc0a5179960c6d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779995.885497:0:7821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a200/0xc8fc0a5179960c74 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x6eb2e712 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779995.885505:0:7821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a200/0xc8fc0a5179960c74 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x6eb2e712 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779995.885512:0:7821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a200/0xc8fc0a5179960c74 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x6eb2e712 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779995.885563:0:7821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04427dbc00/0xc8fc0a5179960c6d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779995.885570:0:7821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c04427dbc00/0xc8fc0a5179960c6d lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779995.885577:0:7821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c04427dbc00/0xc8fc0a5179960c6d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779995.885582:0:7821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c04427dbc00 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:1.0:1787779995.885585:0:7821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c04427dbc00/0xc8fc0a5179960c6d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779995.885593:0:7821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c04427dbc00/0xc8fc0a5179960c6d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779995.885614:0:7821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c0443d81900) 00010000:00010000:1.0:1787779995.885617:0:7821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787779995.885622:0:7821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c04427dbc00/0xc8fc0a5179960c6d lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779995.885628:0:7821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04427dbc00/0xc8fc0a5179960c6d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779995.885642:0:7821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a200/0xc8fc0a5179960c74 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x6eb2e712 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779995.885648:0:7821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a200/0xc8fc0a5179960c74 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x6eb2e712 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779995.885655:0:7821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a200/0xc8fc0a5179960c74 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x6eb2e712 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779995.885660:0:7821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0347e4a200 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:1.0:1787779995.885662:0:7821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a200/0xc8fc0a5179960c74 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x6eb2e712 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779995.885667:0:7821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a200/0xc8fc0a5179960c74 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x6eb2e712 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779995.885673:0:7821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x6eb2e712 (ffff9c0341cd1000) 00010000:00010000:1.0:1787779995.885675:0:7821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787779995.885677:0:7821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a200/0xc8fc0a5179960c74 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x6eb2e712 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779995.885683:0:7821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a200/0xc8fc0a5179960c74 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x6eb2e712 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779995.885915:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347daf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+15:11336:x1874622863687424:12345-192.168.203.31@tcp:36:lhsmtool_posix.0 Request processed in 872us (1211us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787779995.885924:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 83 00000100:00100000:3.0:1787779995.888456:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787779995.888538:0:12488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863687552 00000100:00100000:0.0:1787779995.888556:0:12488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863687552 00000100:00100000:0.0:1787779995.888666:0:12488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 84 00000100:00100000:0.0:1787779995.888685:0:12488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347bcc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:781d29bb-23d2-48e3-b16d-c29e52cd5375+15:11336:x1874622863687552:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787779995.888712:0:12488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787779995.888756:0:12488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869800/0xc8fc0a5179960c7b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea1e86 expref: -99 pid: 12488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779995.889018:0:12488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868800/0xc8fc0a5179960c82 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779995.889050:0:12488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868800/0xc8fc0a5179960c82 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779995.889065:0:12488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868800/0xc8fc0a5179960c82 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779995.889196:0:12488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869800/0xc8fc0a5179960c7b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1e86 expref: 17 pid: 12488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779995.889216:0:12488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868800/0xc8fc0a5179960c82 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1e86 expref: 16 pid: 12488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779995.889225:0:12488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9c0347bec800) 00010000:00010000:0.0:1787779995.889229:0:12488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787779995.889232:0:12488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0477868800, rc 0) 00000100:00100000:0.0:1787779995.889316:0:12488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347bcc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:781d29bb-23d2-48e3-b16d-c29e52cd5375+16:11336:x1874622863687552:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 639us (866us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779995.889324:0:12488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 84 00000100:00100000:3.0:1787779995.891736:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787779995.892417:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863687808 00000100:00100000:0.0:1787779995.892426:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863687808 00000100:00100000:0.0:1787779995.892478:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 85 00000100:00100000:0.0:1787779995.892492:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347a87c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+16:11336:x1874622863687808:12345-192.168.203.31@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787779995.892573:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868e00/0xc8fc0a5179960c89 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779995.892588:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868e00/0xc8fc0a5179960c89 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779995.892618:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868e00/0xc8fc0a5179960c89 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787779995.892992:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:1.0:1787779995.893003:0:6512:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 403897163735ns, next at 404897161466ns, rc = 0 00000004:00010000:1.0:1787779995.893254:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000621b21f7 reply state 00000000b5616c6e transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868e00/0xc8fc0a5179960c89 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779995.893266:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868e00/0xc8fc0a5179960c89 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779995.893336:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9c0347bec800) 00010000:00010000:1.0:1787779995.893339:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1787779995.893342:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787779995.893426:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347a87c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+18:11336:x1874622863687808:12345-192.168.203.31@tcp:36:lhsmtool_posix.0 Request processed in 936us (1706us total) trans 4294967355 rc 0/0 00000100:00100000:1.0:1787779995.893434:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 85 00000100:00100000:2.0:1787779995.895571:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787779995.896937:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863687936 00000100:00100000:1.0:1787779995.896956:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863687936 00000100:00100000:1.0:1787779995.897053:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 86 00000100:00100000:1.0:1787779995.897064:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347fa9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+18:11336:x1874622863687936:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787779995.897095:0:7821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787779995.897113:0:7821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a200/0xc8fc0a5179960c90 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea1e8d expref: -99 pid: 7821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779995.897167:0:7821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a200/0xc8fc0a5179960c90 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1e8d expref: 19 pid: 7821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779995.897201:0:7821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a200/0xc8fc0a5179960c90 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1e8d expref: 19 pid: 7821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779995.897219:0:7821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9c0347bec800) 00010000:00010000:1.0:1787779995.897222:0:7821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787779995.897226:0:7821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0347e4a200, rc 0) 00000100:00100000:1.0:1787779995.897287:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347fa9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+19:11336:x1874622863687936:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 225us (1722us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779995.897294:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 86 00000100:00100000:3.0:1787779995.900693:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787779995.900775:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863688064 00000100:00100000:2.0:1787779995.900792:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863688064 00000100:00100000:2.0:1787779995.900856:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 33 00000100:00100000:2.0:1787779995.900864:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347ebf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2407:x1874622863688064:12345-192.168.203.31@tcp:8:lhsmtool_posix.0 00010000:00080000:2.0:1787779995.900896:0:8430:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 781d29bb-23d2-48e3-b16d-c29e52cd5375@192.168.203.31@tcp t0 exp 0000000000000000 cur 403 last 0 00000020:00000080:2.0:1787779995.900924:0:8430:0:(genops.c:1385:class_connect()) connect: client 781d29bb-23d2-48e3-b16d-c29e52cd5375, cookie 0xc8fc0a5179960c97 00002000:00100000:2.0:1787779995.900935:0:8430:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 781d29bb-23d2-48e3-b16d-c29e52cd5375/ffff9c0347e3c000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113939 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787779995.900961:0:8430:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787779995.901039:0:8430:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787779995.901067:0:8430:0:(import.c:65:import_set_state_nolock()) ffff9c0347e39000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787779995.901143:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347ebf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+6:2407:x1874622863688064:12345-192.168.203.31@tcp:8:lhsmtool_posix.0 Request processed in 278us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779995.901151:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 33 00000100:00100000:2.0:1787779995.905034:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787779995.905105:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863688192 00000100:00100000:1.0:1787779995.905114:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863688192 00000100:00100000:1.0:1787779995.905174:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 34 00000100:00100000:1.0:1787779995.905184:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347fab0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+6:0:x1874622863688192:12345-192.168.203.31@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1787779995.905425:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:0.0:1787779995.907307:0:9508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00100000:0.0:1787779995.907320:0:9508:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 781d29bb-23d2-48e3-b16d-c29e52cd5375 00000100:00100000:1.0:1787779995.907561:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347fab0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:0:x1874622863688192:12345-192.168.203.31@tcp:2:lhsmtool_posix.0 Request processed in 2374us (2531us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1787779995.907571:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 34 00000100:00100000:2.0:1787779995.913152:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787779995.913315:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863688448 00000100:00100000:0.0:1787779995.913324:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863688448 00000100:00100000:0.0:1787779995.913389:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 19 00000100:00100000:0.0:1787779995.913400:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347fa9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+19:11336:x1874622863688448:12345-192.168.203.31@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787779995.913673:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347fa9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+20:11336:x1874622863688448:12345-192.168.203.31@tcp:35:lhsmtool_posix.0 Request processed in 274us (529us total) trans 4294967356 rc 0/0 00000100:00100000:0.0:1787779995.913682:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 19 00000100:00100000:3.0:1787779995.919789:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787779995.919920:0:12488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863688704 00000100:00100000:0.0:1787779995.919928:0:12488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863688704 00000100:00100000:0.0:1787779995.919987:0:12488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 87 00000100:00100000:0.0:1787779995.919996:0:12488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347e54f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:781d29bb-23d2-48e3-b16d-c29e52cd5375+20:11336:x1874622863688704:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787779995.920112:0:12488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347e54f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:781d29bb-23d2-48e3-b16d-c29e52cd5375+20:11336:x1874622863688704:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 Request processed in 117us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779995.920120:0:12488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 87 00000100:00100000:2.0:1787779995.928453:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787779995.929495:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863688832 00000100:00100000:1.0:1787779995.929506:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863688832 00000100:00100000:1.0:1787779995.929561:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 88 00000100:00100000:1.0:1787779995.929577:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347fa9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+20:11336:x1874622863688832:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787779995.929597:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787779995.929619:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4ba00/0xc8fc0a5179960c9e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea1e94 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779995.929686:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4be00/0xc8fc0a5179960ca5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779995.929708:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4be00/0xc8fc0a5179960ca5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779995.929731:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4be00/0xc8fc0a5179960ca5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787779995.929771:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787779995.929786:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4be00/0xc8fc0a5179960ca5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779995.929813:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4ba00/0xc8fc0a5179960c9e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1e94 expref: 22 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779995.929831:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4be00/0xc8fc0a5179960ca5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1e94 expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779995.929863:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9c0347bec800) 00010000:00010000:1.0:1787779995.929866:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787779995.929870:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0347e4be00, rc 0) 00000100:00100000:1.0:1787779995.929952:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347fa9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+21:11336:x1874622863688832:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 368us (1494us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779995.929960:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 88 00000100:00100000:2.0:1787779995.931977:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347fab840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881607552:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787779995.932045:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779995.932122:0:8529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881607552 00000100:00100000:2.0:1787779995.932129:0:8529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881607552 00000100:00100000:2.0:1787779995.932193:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1787779995.932202:0:8529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347fa92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881607552:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787779995.932223:0:8529:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787779995.932284:0:8529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347fa92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881607552:12345-0@lo:13:osp-pre-1-1.0 Request processed in 83us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779995.932292:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1787779995.932324:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347fab840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881607552:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787779995.932355:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787779995.932365:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477aecf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881607936:0@lo:400:kworker.0 00000100:00100000:2.0:1787779995.932368:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787779995.932379:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477aefc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874622881608064:0@lo:400:kworker.0 00000100:00100000:3.0:1787779995.932411:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779995.932417:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779995.932448:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348802940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881608576:0@lo:400:kworker.0 00000100:00100000:1.0:1787779995.932455:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881608064 00000100:00100000:2.0:1787779995.932457:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348803c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1874622881608448:0@lo:400:kworker.0 00000100:00100000:1.0:1787779995.932462:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881608064 00000100:00100000:3.0:1787779995.932495:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779995.932495:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787779995.932502:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:1.0:1787779995.932512:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347faa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1874622881608064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779995.932513:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c046215fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1874622881608960:0@lo:400:kworker.0 00000100:00100000:3.0:1787779995.932525:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c046215de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881609088:0@lo:400:kworker.0 00000100:00100000:2.0:1787779995.932536:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779995.932567:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779995.932575:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477aefc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874622881608064:0@lo:400:kworker.0 00000100:00100000:1.0:1787779995.932576:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347faa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1874622881608064:12345-0@lo:400:kworker.0 Request processed in 64us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779995.932597:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:2.0:1787779995.932599:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881608448 00000100:00100000:2.0:1787779995.932603:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881608448 00000100:00100000:3.0:1787779995.932613:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881607936 00000100:00100000:1.0:1787779995.932615:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881608960 00000100:00100000:3.0:1787779995.932619:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881607936 00000100:00100000:1.0:1787779995.932621:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881608960 00000100:00100000:2.0:1787779995.932635:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:2.0:1787779995.932643:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347faa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1874622881608448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787779995.932655:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:3.0:1787779995.932663:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1787779995.932667:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347fa83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1874622881608960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779995.932675:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347faa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1874622881608448:12345-0@lo:400:kworker.0 Request processed in 33us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779995.932677:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347e55680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881607936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779995.932684:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00010000:00080000:2.0:1787779995.932707:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0348803c00 x1874622881608448/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787780011 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787779995.932717:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347fa83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1874622881608960:12345-0@lo:400:kworker.0 Request processed in 55us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779995.932745:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:2.0:1787779995.932749:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348803c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1874622881608448:0@lo:400:kworker.0 00000100:00100000:3.0:1787779995.932754:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347e55680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881607936:12345-0@lo:400:kworker.0 Request processed in 80us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779995.932764:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00010000:00080000:2.0:1787779995.932776:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c046215fc00 x1874622881608960/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787780011 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787779995.932786:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c046215fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1874622881608960:0@lo:400:kworker.0 00000100:00100000:3.0:1787779995.932791:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881608576 00000100:00100000:3.0:1787779995.932796:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881608576 00000100:00100000:2.0:1787779995.932826:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881609088 00000100:00100000:3.0:1787779995.932831:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1787779995.932832:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881609088 00000100:00100000:0.0:1787779995.932834:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347c34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1f575176-36bc-4786-83ee-2fea064a12a9:3641:1874622881607680:0@lo:400:kworker.0 00000100:00100000:2.0:1787779995.932885:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1787779995.932890:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779995.932891:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347e57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881609088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787779995.932912:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477aec780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881608192:0@lo:400:kworker.0 00000100:00100000:2.0:1787779995.932919:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347e57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881609088:12345-0@lo:400:kworker.0 Request processed in 29us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779995.932925:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1787779995.932932:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779995.932945:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881607680 00000100:00100000:2.0:1787779995.932948:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881607680 00000100:00100000:0.0:1787779995.932948:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348803480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881608704:0@lo:400:kworker.0 00000100:00100000:2.0:1787779995.932972:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00000100:00100000:2.0:1787779995.932978:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0442d59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+24:3641:x1874622881607680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787779995.932979:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779995.932996:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1787779995.933003:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347c361c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874622881607808:0@lo:400:kworker.0 00000100:00100000:2.0:1787779995.933004:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0442d59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+24:3641:x1874622881607680:12345-0@lo:400:kworker.0 Request processed in 28us (114us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779995.933010:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00000100:00100000:0.0:1787779995.933023:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779995.933038:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881608704 00000100:00100000:0.0:1787779995.933038:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477aee1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1874622881608320:0@lo:400:kworker.0 00000100:00100000:2.0:1787779995.933041:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881608704 00000100:00100000:2.0:1787779995.933061:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1787779995.933062:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779995.933067:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477ae83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3641:x1874622881608704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787779995.933077:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c046215e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1874622881608832:0@lo:400:kworker.0 00000100:00100000:2.0:1787779995.933095:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477ae83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3641:x1874622881608704:12345-0@lo:400:kworker.0 Request processed in 28us (115us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779995.933095:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779995.933111:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1787779995.933113:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347c34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1f575176-36bc-4786-83ee-2fea064a12a9:3641:1874622881607680:0@lo:400:kworker.0 00000100:00100000:0.0:1787779995.933123:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348803480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881608704:0@lo:400:kworker.0 00000100:00100000:2.0:1787779995.933127:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881607808 00000100:00100000:2.0:1787779995.933130:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881607808 00000100:00100000:2.0:1787779995.933142:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881608320 00000100:00100000:2.0:1787779995.933145:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881608320 00000100:00100000:0.0:1787779995.933148:0:12488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881608832 00000100:00100000:0.0:1787779995.933150:0:12488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881608832 00000100:00100000:2.0:1787779995.933159:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:2.0:1787779995.933164:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477ae8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874622881607808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787779995.933169:0:12488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:0.0:1787779995.933174:0:12488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04779421c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874622881608320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779995.933197:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477ae8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874622881607808:12345-0@lo:400:kworker.0 Request processed in 33us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779995.933198:0:12488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04779421c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874622881608320:12345-0@lo:400:kworker.0 Request processed in 25us (137us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779995.933203:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:0.0:1787779995.933216:0:12488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:2.0:1787779995.933219:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:2.0:1787779995.933225:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477943480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1874622881608832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787779995.933253:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477943480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1874622881608832:12345-0@lo:400:kworker.0 Request processed in 28us (156us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779995.933259:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:2.0:1787779995.933286:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347c361c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874622881607808:0@lo:400:kworker.0 00000100:00080000:0.0:1787779995.933290:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787779995.933295:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477aee1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1874622881608320:0@lo:400:kworker.0 00000100:00080000:0.0:1787779995.933295:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787779995.933297:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787779995.933300:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787779995.933304:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c046215e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1874622881608832:0@lo:400:kworker.0 00000100:00100000:0.0:1787779995.933308:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881608192 00000100:00100000:0.0:1787779995.933311:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881608192 00000100:00100000:0.0:1787779995.933329:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1787779995.933335:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0476441a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874622881608192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787779995.933374:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0476441a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874622881608192:12345-0@lo:400:kworker.0 Request processed in 40us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779995.933388:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1787779995.933483:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477aec780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881608192:0@lo:400:kworker.0 00000100:00100000:3.0:1787779995.937609:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347e55e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881608576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787779995.937698:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347e55e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881608576:12345-0@lo:400:kworker.0 Request processed in 103us (5208us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779995.937706:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1787779995.937783:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348802940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881608576:0@lo:400:kworker.0 00000100:00100000:3.0:1787779995.937799:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c046215de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881609088:0@lo:400:kworker.0 00000100:00100000:3.0:1787779995.937811:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477aecf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881607936:0@lo:400:kworker.0 00000100:00100000:2.0:1787779995.942528:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787779995.942742:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863688960 00000100:00100000:3.0:1787779995.942758:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863688960 00000100:00100000:3.0:1787779995.942816:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 35 00000100:00100000:3.0:1787779995.942827:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347fabc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:2411:x1874622863688960:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787779995.942879:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787779995.942902:0:8427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000054d1404c/0xc8fc0a5179960cac lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea1e9b expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787779995.942926:0:8427:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8f5b9c, blocks: 0x0 00010000:00010000:3.0:1787779995.942944:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=403s v=(0 0) 00010000:00010000:3.0:1787779995.942948:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787779995.942957:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000054d1404c/0xc8fc0a5179960cac lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1e9b expref: 6 pid: 8427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779995.942989:0:8427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000054d1404c/0xc8fc0a5179960cac lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1e9b expref: 6 pid: 8427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779995.943002:0:8427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c04766dca00, rc 0) 00000100:00100000:3.0:1787779995.943080:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347fabc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+6:2411:x1874622863688960:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 247us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779995.943088:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 35 00000100:00100000:0.0:1787779995.954576:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787779995.954631:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863689216 00000100:00100000:3.0:1787779995.954641:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863689216 00000100:00100000:3.0:1787779995.954754:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 89 00000100:00100000:3.0:1787779995.954766:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347c361c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+21:11336:x1874622863689216:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787779995.954903:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347c361c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+21:11336:x1874622863689216:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 Request processed in 140us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779995.954921:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 89 00000100:00100000:1.0:1787779995.964552:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787779995.964871:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863689344 00000100:00100000:2.0:1787779995.964880:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863689344 00000100:00100000:2.0:1787779995.964938:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 36 00000100:00100000:2.0:1787779995.964953:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046215de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+6:11336:x1874622863689344:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787779995.964981:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787779995.964999:0:8430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000698a48c3/0xc8fc0a5179960cb3 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea1ea2 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779995.965028:0:8430:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000054d1404c/0xc8fc0a5179960cac lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1e9b expref: 7 pid: 8427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779995.965038:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787779995.965042:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787779995.965048:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000698a48c3/0xc8fc0a5179960cb3 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1ea2 expref: 7 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779995.965081:0:8430:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000054d1404c/0xc8fc0a5179960cac lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1e9b expref: 7 pid: 8427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779995.965095:0:8430:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000054d1404c/0xc8fc0a5179960cac lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1e9b expref: 7 pid: 8427 timeout: 503 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779995.965108:0:8430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347fa8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8430:1874622881609216:192.168.203.31@tcp:104: 00000100:00100000:2.0:1787779995.965189:0:8430:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c045ab72b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787779995.967801:0:8430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347fa8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8430:1874622881609216:192.168.203.31@tcp:104: 00010000:00010000:3.0:1787779995.967871:0:8430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000698a48c3/0xc8fc0a5179960cb3 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1ea2 expref: 7 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779995.967892:0:8430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0444c18a00, rc 0) 00000100:00100000:1.0:1787779995.967965:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046215de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+7:11336:x1874622863689344:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 3010us (3417us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779995.967976:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 36 00000100:00100000:0.0:1787779995.971557:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787779995.971751:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863689472 00000100:00100000:1.0:1787779995.971760:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863689472 00010000:00010000:1.0:1787779995.971803:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000054d1404c/0xc8fc0a5179960cac lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1e9b expref: 7 pid: 8427 timeout: 503 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779995.971886:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 59 00000100:00100000:1.0:1787779995.971898:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347c34000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+7:2410:x1874622863689472:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787779995.971912:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787779995.971932:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000054d1404c/0xc8fc0a5179960cac lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1e9b expref: 7 pid: 8427 timeout: 503 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779995.971947:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000054d1404c/0xc8fc0a5179960cac lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1e9b expref: 7 pid: 8427 timeout: 503 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779995.971991:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000054d1404c/0xc8fc0a5179960cac lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1e9b expref: 7 pid: 8427 timeout: 503 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779995.972004:0:6499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787779995.972009:0:6499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787779995.972024:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000698a48c3/0xc8fc0a5179960cb3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1ea2 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779995.972036:0:6499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000698a48c3/0xc8fc0a5179960cb3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1ea2 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779995.972083:0:6499:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000698a48c3/0xc8fc0a5179960cb3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1ea2 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779995.972098:0:6499:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c046215e940 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6499:1874622881609344:192.168.203.31@tcp:105: 00000100:00100000:1.0:1787779995.972172:0:6499:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0444f62840 going to sleep for 11 seconds 00000100:00100000:0.0:1787779995.982024:0:6499:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c046215e940 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6499:1874622881609344:192.168.203.31@tcp:105: 00010000:00010000:0.0:1787779995.982056:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787779995.982127:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347c34000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+6:2410:x1874622863689472:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 10232us (10577us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779995.982140:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 59 00000100:00100000:1.0:1787779995.992518:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787779995.992667:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863689600 00000100:00100000:3.0:1787779995.992677:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863689600 00002000:00100000:3.0:1787779995.992736:0:8435:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff9c046215fc00 x1874622863689600/t0(0) o4->781d29bb-23d2-48e3-b16d-c29e52cd5375@192.168.203.31@tcp:406/0 lens 504/0 e 0 to 0 dl 1787780006 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787779995.992748:0:8435:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c046215fc00 with x1874622863689600 ext(0->8) 00002000:00010000:3.0:1787779995.992754:0:8435:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c046215fc00 00000100:00100000:3.0:1787779995.992791:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 0 00000100:00100000:3.0:1787779995.992803:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046215fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+6:2410:x1874622863689600:12345-192.168.203.31@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1787779995.994060:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046215fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+8:2410:x1874622863689600:12345-192.168.203.31@tcp:4:lhsmtool_posix.0 Request processed in 1255us (1546us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1787779995.994072:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 0 00002000:00100000:3.0:1787779995.994082:0:8435:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff9c046215fc00 x1874622863689600/t4294967303(0) o4->781d29bb-23d2-48e3-b16d-c29e52cd5375@192.168.203.31@tcp:406/0 lens 504/448 e 0 to 0 dl 1787780006 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787779995.994093:0:8435:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c046215fc00 with x1874622863689600 ext(0->8) 00002000:00010000:3.0:1787779995.994097:0:8435:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c046215fc00 00000100:00100000:0.0:1787779996.004870:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787779996.007830:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863689728 00000100:00100000:2.0:1787779996.007876:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863689728 00000100:00100000:2.0:1787779996.007943:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 90 00000100:00100000:2.0:1787779996.007953:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046efcd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+21:11336:x1874622863689728:12345-192.168.203.31@tcp:44:lhsmtool_posix.0 00000100:00080000:1.0:1787779996.009879:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:0.0:1787779996.014745:0:6491:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967356 is committed 00000004:00080000:0.0:1787779996.014762:0:6491:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:0.0:1787779996.014787:0:6491:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00010000:00010000:3.0:1787779996.014886:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868e00/0xc8fc0a5179960c89 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779996.014903:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:3.0:1787779996.014914:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868e00/0xc8fc0a5179960c89 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779996.014921:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868e00/0xc8fc0a5179960c89 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779996.014925:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04764970c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881609472:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1787779996.014930:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0477868e00 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:3.0:1787779996.014936:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868e00/0xc8fc0a5179960c89 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779996.014945:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868e00/0xc8fc0a5179960c89 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779996.014973:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9c0347bec800) 00010000:00010000:3.0:1787779996.014977:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787779996.014981:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868e00/0xc8fc0a5179960c89 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779996.014986:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868e00/0xc8fc0a5179960c89 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779996.014994:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779996.015019:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881609472 00000100:00100000:3.0:1787779996.015026:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881609472 00000100:00100000:3.0:1787779996.015077:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787779996.015086:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046f1b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1874622881609472:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1787779996.015191:0:8427:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1787779996.015194:0:8427:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1787779996 00002000:00010000:3.0:1787779996.015196:0:8427:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1787779996.015199:0:8427:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1787779996 -> 1787779996 00002000:00010000:3.0:1787779996.015206:0:8427:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:3.0:1787779996.015252:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046f1b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3642:x1874622881609472:12345-0@lo:2:osp-syn-1-0.0 Request processed in 167us (260us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1787779996.015259:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000004:00080000:0.0:1787779996.015330:0:3642:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c04764970c0/2, rc 0, transno 4294967304 00000100:00100000:0.0:1787779996.015337:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04764970c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881609472:0@lo:2:osp-syn-1-0.0 00000020:00080000:2.0:1787779996.015509:0:6544:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:2.0:1787779996.015524:0:6544:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:2.0:1787779996.016071:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046efcd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+14:11336:x1874622863689728:12345-192.168.203.31@tcp:44:lhsmtool_posix.0 Request processed in 8115us (11228us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779996.016082:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 90 00000100:00100000:1.0:1787779996.018497:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787779996.018587:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863689856 00000100:00100000:3.0:1787779996.018596:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863689856 00000100:00100000:3.0:1787779996.018743:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 38 00000100:00100000:3.0:1787779996.018754:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046215de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+8:2411:x1874622863689856:12345-192.168.203.31@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1787779996.021932:0:9508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:2.0:1787779996.021946:0:9508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000100:00100000:1.0:1787779996.022143:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046215de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+6:2411:x1874622863689856:12345-192.168.203.31@tcp:16:lhsmtool_posix.0 Request processed in 3385us (3648us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779996.022154:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 38 00000100:00100000:2.0:1787779996.026825:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787779996.027312:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863690112 00000100:00100000:3.0:1787779996.027322:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863690112 00000100:00100000:3.0:1787779996.027384:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 91 00000100:00100000:3.0:1787779996.027394:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347faa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+14:11336:x1874622863690112:12345-192.168.203.31@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787779996.027444:0:7821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787779996.027470:0:7821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4be00/0xc8fc0a5179960ca5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1e94 expref: 14 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779996.027486:0:7821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9c0347bec800) 00010000:00010000:3.0:1787779996.027491:0:7821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787779996.027519:0:7821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc600/0xc8fc0a5179960cba lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779996.027534:0:7821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc600/0xc8fc0a5179960cba lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779996.027544:0:7821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc600/0xc8fc0a5179960cba lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787779996.027659:0:7821:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000404fc767 reply state 000000000d06ede1 transno 4294967357 ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc600/0xc8fc0a5179960cba lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779996.027684:0:7821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc600/0xc8fc0a5179960cba lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779996.027691:0:7821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9c0347bec800) 00010000:00010000:3.0:1787779996.027693:0:7821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787779996.027696:0:7821:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787779996.027809:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347faa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+15:11336:x1874622863690112:12345-192.168.203.31@tcp:36:lhsmtool_posix.0 Request processed in 415us (990us total) trans 4294967357 rc 0/0 00000100:00100000:3.0:1787779996.027816:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 91 00000100:00100000:2.0:1787779996.031569:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787779996.031644:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863690240 00000100:00100000:0.0:1787779996.031653:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863690240 00000100:00100000:0.0:1787779996.031709:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 39 00000100:00100000:0.0:1787779996.031730:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347faad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+6:2410:x1874622863690240:12345-192.168.203.31@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1787779996.032044:0:9899:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1787779996.032048:0:9899:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 1787779996 -> 1787779995 00002000:00010000:0.0:1787779996.032051:0:9899:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 1787779993 00002000:00010000:0.0:1787779996.032053:0:9899:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1787779996 -> 1787779995 00002000:00010000:0.0:1787779996.032056:0:9899:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1787779996.032146:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347faad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+7:2410:x1874622863690240:12345-192.168.203.31@tcp:2:lhsmtool_posix.0 Request processed in 428us (585us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1787779996.032155:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 39 00000100:00100000:3.0:1787779996.034004:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787779996.034975:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863690496 00000100:00100000:2.0:1787779996.034986:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863690496 00000100:00100000:2.0:1787779996.035046:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 92 00000100:00100000:2.0:1787779996.035055:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347e57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+15:11336:x1874622863690496:12345-192.168.203.31@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1787779996.035115:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19600/0xc8fc0a5179960cc1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779996.035132:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868800/0xc8fc0a5179960c82 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1e86 expref: 15 pid: 12488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779996.035142:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19600/0xc8fc0a5179960cc1 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779996.035173:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868800/0xc8fc0a5179960c82 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1e86 expref: 15 pid: 12488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779996.035187:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868800/0xc8fc0a5179960c82 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1e86 expref: 15 pid: 12488 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779996.035200:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347fa8780 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1874622881609600:192.168.203.31@tcp:104: 00000100:00100000:2.0:1787779996.035298:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c045ab72b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787779996.046569:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787779996.046626:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347fa8780 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1874622881609600:192.168.203.31@tcp:104: 00000100:00100000:1.0:1787779996.046648:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863690624 00000100:00100000:1.0:1787779996.046656:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863690624 00010000:00010000:2.0:1787779996.046659:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19600/0xc8fc0a5179960cc1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779996.046690:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868800/0xc8fc0a5179960c82 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1e86 expref: 16 pid: 12488 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779996.046746:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 60 00000100:00100000:1.0:1787779996.046756:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347fab0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+16:2410:x1874622863690624:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787779996.046770:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787779996.046778:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868800/0xc8fc0a5179960c82 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1e86 expref: 16 pid: 12488 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779996.046903:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868800/0xc8fc0a5179960c82 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1e86 expref: 16 pid: 12488 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779996.046926:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868800/0xc8fc0a5179960c82 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1e86 expref: 16 pid: 12488 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779996.046940:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9c0347bec800) 00010000:00010000:1.0:1787779996.046945:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19600/0xc8fc0a5179960cc1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779996.046953:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19600/0xc8fc0a5179960cc1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779996.046960:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19600/0xc8fc0a5179960cc1 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779996.046982:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787779996.047026:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347fab0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+15:2410:x1874622863690624:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 272us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779996.047034:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 60 00010000:00010000:1.0:1787779996.047111:0:6513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19600/0xc8fc0a5179960cc1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779996.047124:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19600/0xc8fc0a5179960cc1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779996.047160:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19600/0xc8fc0a5179960cc1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779996.047168:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19600/0xc8fc0a5179960cc1 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779996.047174:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19600/0xc8fc0a5179960cc1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779996.047180:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0444c19600 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:1.0:1787779996.047185:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19600/0xc8fc0a5179960cc1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779996.047192:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19600/0xc8fc0a5179960cc1 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779996.047201:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9c0347bec800) 00010000:00010000:1.0:1787779996.047204:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1787779996.047208:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19600/0xc8fc0a5179960cc1 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779996.047214:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19600/0xc8fc0a5179960cc1 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779996.047256:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347e57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+14:11336:x1874622863690496:12345-192.168.203.31@tcp:55:lhsmtool_posix.0 Request processed in 12202us (13258us total) trans 0 rc -22/-22 00000100:00100000:1.0:1787779996.047263:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 92 00000040:00080000:3.0:1787779996.052282:0:14204:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787779996.052291:0:14204:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787779996.052314:0:14204:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1787779996.052319:0:14204:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787779996.055486:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787779996.055574:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863690752 00000100:00100000:0.0:1787779996.055583:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863690752 00000100:00100000:0.0:1787779996.055642:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 40 00000100:00100000:0.0:1787779996.055652:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347fa8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+7:2408:x1874622863690752:12345-192.168.203.31@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787779996.055793:0:8430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000064595807/0xc8fc0a5179960cc8 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779996.055815:0:8430:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000698a48c3/0xc8fc0a5179960cb3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1ea2 expref: 7 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779996.055824:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1787779996.055828:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787779996.055833:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000064595807/0xc8fc0a5179960cc8 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779996.055956:0:8430:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000698a48c3/0xc8fc0a5179960cb3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1ea2 expref: 7 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779996.055970:0:8430:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000698a48c3/0xc8fc0a5179960cb3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1ea2 expref: 7 pid: 8430 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779996.055985:0:8430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0476497840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8430:1874622881609728:192.168.203.31@tcp:104: 00000100:00100000:0.0:1787779996.056094:0:8430:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0347d45600 going to sleep for 11 seconds 00000100:00100000:0.0:1787779996.064884:0:8430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0476497840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8430:1874622881609728:192.168.203.31@tcp:104: 00010000:00010000:0.0:1787779996.064918:0:8430:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000064595807/0xc8fc0a5179960cc8 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779996.066350:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787779996.066420:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863690880 00000100:00100000:0.0:1787779996.066428:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863690880 00010000:00010000:0.0:1787779996.066464:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000698a48c3/0xc8fc0a5179960cb3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1ea2 expref: 8 pid: 8430 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779996.066511:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 61 00000100:00100000:0.0:1787779996.066523:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347fabc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+8:2410:x1874622863690880:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787779996.066538:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787779996.066561:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000698a48c3/0xc8fc0a5179960cb3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1ea2 expref: 8 pid: 8430 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779996.066583:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000698a48c3/0xc8fc0a5179960cb3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1ea2 expref: 8 pid: 8430 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779996.066616:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000698a48c3/0xc8fc0a5179960cb3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1ea2 expref: 8 pid: 8430 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779996.066640:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787779996.066645:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787779996.066651:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000064595807/0xc8fc0a5179960cc8 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779996.066677:0:6497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000064595807/0xc8fc0a5179960cc8 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779996.066701:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787779996.066717:0:8430:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000064595807/0xc8fc0a5179960cc8 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779996.066738:0:8430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000064595807/0xc8fc0a5179960cc8 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779996.066757:0:8430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000064595807/0xc8fc0a5179960cc8 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779996.066759:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347fabc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+7:2410:x1874622863690880:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 238us (414us total) trans 0 rc 0/0 00010000:00010000:1.0:1787779996.066766:0:8430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000064595807/0xc8fc0a5179960cc8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779996.066766:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 61 00010000:00010000:1.0:1787779996.066773:0:8430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000064595807/0xc8fc0a5179960cc8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779996.066780:0:8430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0477868400 already unused, calling callback (ffffffffc0d97420) 00010000:00010000:1.0:1787779996.066784:0:8430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000064595807/0xc8fc0a5179960cc8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779996.066804:0:8430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000064595807/0xc8fc0a5179960cc8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779996.066816:0:8430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000064595807/0xc8fc0a5179960cc8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779996.066824:0:8430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000064595807/0xc8fc0a5179960cc8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779996.066906:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347fa8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+6:2408:x1874622863690752:12345-192.168.203.31@tcp:1:lhsmtool_posix.0 Request processed in 11255us (11427us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779996.066915:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 40 00000100:00100000:1.0:1787779996.088563:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787779996.088612:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863691136 00000100:00100000:2.0:1787779996.088620:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863691136 00000100:00100000:2.0:1787779996.088669:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 93 00000100:00100000:2.0:1787779996.088688:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046215e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+14:11336:x1874622863691136:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787779996.088775:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19e00/0xc8fc0a5179960ccf lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779996.088788:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a5179960b0f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1e2b expref: 14 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779996.088795:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19e00/0xc8fc0a5179960ccf lrc: 4/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779996.088822:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a5179960b0f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1e2b expref: 14 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779996.088832:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a5179960b0f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1e2b expref: 14 pid: 6514 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779996.089960:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347fa8000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1874622881609856:192.168.203.31@tcp:104: 00000100:00100000:2.0:1787779996.090993:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c045ab72b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787779996.099188:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787779996.099221:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863691264 00000100:00100000:1.0:1787779996.099229:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863691264 00010000:00010000:1.0:1787779996.099280:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a5179960b0f lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1e2b expref: 15 pid: 6514 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779996.099317:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 62 00000100:00100000:1.0:1787779996.099327:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046099ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+15:2409:x1874622863691264:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787779996.099340:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787779996.099347:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a5179960b0f lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1e2b expref: 15 pid: 6514 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779996.099359:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a5179960b0f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1e2b expref: 15 pid: 6514 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779996.099379:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c04621c0900) 00010000:00010000:1.0:1787779996.099385:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19e00/0xc8fc0a5179960ccf lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779996.099394:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19e00/0xc8fc0a5179960ccf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779996.099413:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19e00/0xc8fc0a5179960ccf lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779996.099432:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787779996.099480:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046099ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+15:2409:x1874622863691264:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 154us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779996.099488:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 62 00010000:00010000:3.0:1787779996.100340:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a5179960b0f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1e2b expref: 14 pid: 6514 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779996.100358:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347fa8000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1874622881609856:192.168.203.31@tcp:104: 00010000:00010000:3.0:1787779996.100383:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19e00/0xc8fc0a5179960ccf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779996.100391:0:6514:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19e00/0xc8fc0a5179960ccf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779996.100397:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19e00/0xc8fc0a5179960ccf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779996.100550:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc000/0xc8fc0a5179960cd6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779996.100570:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a200/0xc8fc0a5179960c90 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1e8d expref: 14 pid: 7821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779996.100578:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc000/0xc8fc0a5179960cd6 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779996.100610:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a200/0xc8fc0a5179960c90 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1e8d expref: 14 pid: 7821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779996.100624:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a200/0xc8fc0a5179960c90 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1e8d expref: 14 pid: 7821 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779996.100637:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347e55e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1874622881609984:192.168.203.31@tcp:104: 00000100:00100000:3.0:1787779996.100702:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0346d5b600 going to sleep for 11 seconds 00000100:00100000:3.0:1787779996.104556:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347e55e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1874622881609984:192.168.203.31@tcp:104: 00010000:00010000:3.0:1787779996.104584:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc000/0xc8fc0a5179960cd6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779996.111329:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787779996.112243:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863691392 00000100:00100000:3.0:1787779996.112254:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863691392 00010000:00010000:3.0:1787779996.112302:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a200/0xc8fc0a5179960c90 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1e8d expref: 15 pid: 7821 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779996.112344:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 63 00000100:00100000:3.0:1787779996.112352:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347fab840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+15:2410:x1874622863691392:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787779996.112366:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787779996.112384:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a200/0xc8fc0a5179960c90 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1e8d expref: 15 pid: 7821 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779996.112396:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a200/0xc8fc0a5179960c90 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1e8d expref: 15 pid: 7821 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779996.112417:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a200/0xc8fc0a5179960c90 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1e8d expref: 15 pid: 7821 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779996.112433:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9c0347bec800) 00010000:00010000:3.0:1787779996.112438:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc000/0xc8fc0a5179960cd6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779996.112448:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc000/0xc8fc0a5179960cd6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779996.112455:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc000/0xc8fc0a5179960cd6 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779996.112477:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787779996.112524:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347fab840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+14:2410:x1874622863691392:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 172us (1203us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779996.112532:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 63 00010000:00010000:3.0:1787779996.112559:0:6514:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc000/0xc8fc0a5179960cd6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779996.112566:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc000/0xc8fc0a5179960cd6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787779996.112658:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000001:00080000:3.0:1787779996.112762:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000001:00080000:3.0:1787779996.112798:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967360 00000100:00100000:3.0:1787779996.112877:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347e55e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6514:1874622881610112:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1787779996.112921:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779996.112954:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0347ec6c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787779996.113287:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881610112 00000100:00100000:0.0:1787779996.113292:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881610112 00000100:00100000:0.0:1787779996.113329:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1787779996.113337:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347e57c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6514:x1874622881610112:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787779996.113408:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347e57c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6514:x1874622881610112:12345-0@lo:1000:mdt00_002.0 Request processed in 72us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779996.113415:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1787779996.114924:0:6514:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:2.0:1787779996.114943:0:6514:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c04764970c0, transno 4294967304 00000100:00100000:2.0:1787779996.114964:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347e55e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6514:1874622881610112:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1787779996.115343:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00000100:00100000:2.0:1787779996.115400:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347fa8000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6514:1874622881610240:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787779996.115444:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787779996.115475:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c04537e0000 going to sleep for 11 seconds 00000100:00100000:3.0:1787779996.115646:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881610240 00000100:00100000:3.0:1787779996.115651:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881610240 00000100:00100000:3.0:1787779996.115691:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1787779996.115699:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347fab0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6514:x1874622881610240:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1787779996.115817:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347fab0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6514:x1874622881610240:12345-0@lo:1000:mdt00_002.0 Request processed in 118us (372us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1787779996.115825:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1787779996.116197:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347fa8000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6514:1874622881610240:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1787779996.116235:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc000/0xc8fc0a5179960cd6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779996.116244:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc000/0xc8fc0a5179960cd6 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779996.116253:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc000/0xc8fc0a5179960cd6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779996.116259:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c04766dc000 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:2.0:1787779996.116767:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc000/0xc8fc0a5179960cd6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779996.116778:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc000/0xc8fc0a5179960cd6 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779996.116793:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9c0347bec800) 00010000:00010000:2.0:1787779996.116796:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787779996.116800:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc000/0xc8fc0a5179960cd6 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779996.116812:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc000/0xc8fc0a5179960cd6 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779996.116859:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6e00/0xc8fc0a5179960c0b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779996.116865:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6e00/0xc8fc0a5179960c0b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779996.116871:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6e00/0xc8fc0a5179960c0b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779996.116877:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0346dd6e00 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:2.0:1787779996.116880:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6e00/0xc8fc0a5179960c0b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779996.116886:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6e00/0xc8fc0a5179960c0b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779996.116894:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c04621c0900) 00010000:00010000:2.0:1787779996.116896:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787779996.116899:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6e00/0xc8fc0a5179960c0b lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779996.116905:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd6e00/0xc8fc0a5179960c0b lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779996.116926:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19a00/0xc8fc0a5179960cdd lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779996.116950:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869200/0xc8fc0a5179960c27 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1e71 expref: 17 pid: 7821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779996.116974:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19a00/0xc8fc0a5179960cdd lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779996.118819:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869200/0xc8fc0a5179960c27 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1e71 expref: 17 pid: 7821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779996.118859:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869200/0xc8fc0a5179960c27 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1e71 expref: 17 pid: 7821 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779996.118876:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347fabc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1874622881610368:192.168.203.31@tcp:104: 00000100:00100000:2.0:1787779996.119045:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c04537e0000 going to sleep for 11 seconds 00000100:00100000:3.0:1787779996.122445:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347fabc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1874622881610368:192.168.203.31@tcp:104: 00010000:00010000:3.0:1787779996.122476:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19a00/0xc8fc0a5179960cdd lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779996.122595:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787779996.122677:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863691520 00000100:00100000:2.0:1787779996.122685:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863691520 00010000:00010000:2.0:1787779996.122727:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869200/0xc8fc0a5179960c27 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1e71 expref: 18 pid: 7821 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779996.122766:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 64 00000100:00100000:2.0:1787779996.122775:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477af3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+18:2410:x1874622863691520:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787779996.122789:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787779996.122796:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869200/0xc8fc0a5179960c27 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1e71 expref: 18 pid: 7821 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779996.122810:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869200/0xc8fc0a5179960c27 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1e71 expref: 18 pid: 7821 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779996.122833:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869200/0xc8fc0a5179960c27 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1e71 expref: 18 pid: 7821 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779996.122880:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c04621c0900) 00010000:00010000:2.0:1787779996.122886:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19a00/0xc8fc0a5179960cdd lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779996.122895:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19a00/0xc8fc0a5179960cdd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779996.122911:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19a00/0xc8fc0a5179960cdd lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779996.122943:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787779996.122989:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477af3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+17:2410:x1874622863691520:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 214us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779996.122997:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 64 00010000:00010000:3.0:1787779996.124121:0:6514:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19a00/0xc8fc0a5179960cdd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779996.124132:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19a00/0xc8fc0a5179960cdd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779996.124144:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19a00/0xc8fc0a5179960cdd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779996.124151:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19a00/0xc8fc0a5179960cdd lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779996.124158:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19a00/0xc8fc0a5179960cdd lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779996.124175:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0444c19a00 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:3.0:1787779996.124179:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19a00/0xc8fc0a5179960cdd lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779996.124186:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19a00/0xc8fc0a5179960cdd lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779996.124198:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c04621c0900) 00010000:00010000:3.0:1787779996.124201:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787779996.124205:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19a00/0xc8fc0a5179960cdd lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779996.124211:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19a00/0xc8fc0a5179960cdd lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779996.124223:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19e00/0xc8fc0a5179960ccf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779996.124229:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19e00/0xc8fc0a5179960ccf lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779996.124235:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19e00/0xc8fc0a5179960ccf lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779996.124240:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0444c19e00 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:3.0:1787779996.124243:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19e00/0xc8fc0a5179960ccf lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779996.124249:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19e00/0xc8fc0a5179960ccf lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779996.124360:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c04621c0900) 00010000:00010000:3.0:1787779996.124364:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787779996.124367:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19e00/0xc8fc0a5179960ccf lrc: 2/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779996.124373:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19e00/0xc8fc0a5179960ccf lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779996.124520:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046215e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+16:11336:x1874622863691136:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 Request processed in 35840us (35960us total) trans 4294967362 rc 0/0 00000100:00100000:3.0:1787779996.124529:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 93 00000020:00080000:3.0:1787779996.124534:0:6514:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1787779996.124831:0:13794:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787779996.124877:0:13794:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787779996.124896:0:13794:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1787779996.125509:0:13794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787779996.127407:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787779996.127503:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863691776 00000100:00100000:3.0:1787779996.127510:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863691776 00000100:00100000:3.0:1787779996.127565:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 20 00000100:00100000:3.0:1787779996.127576:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477af2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+16:11336:x1874622863691776:12345-192.168.203.31@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1787779996.129829:0:6516:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1787779996.129896:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967363 00010000:00010000:3.0:1787779996.131113:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a5179960ce4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779996.131133:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a5179960ce4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779996.131145:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a5179960ce4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779996.131154:0:6516:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a5179960ce4 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779996.131172:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a5179960ce4 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779996.131178:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a5179960ce4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779996.131200:0:6516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787779996.131487:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477af2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+18:11336:x1874622863691776:12345-192.168.203.31@tcp:35:lhsmtool_posix.0 Request processed in 3909us (4085us total) trans 4294967364 rc 0/0 00000100:00100000:3.0:1787779996.131497:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 20 00000020:00080000:3.0:1787779996.131503:0:6516:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787779996.131807:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787779996.131815:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a5179960ce4 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779996.131822:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c04766dc400 already unused, calling callback (ffffffffc0d97420) 00010000:00010000:0.0:1787779996.131825:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a5179960ce4 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779996.131834:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a5179960ce4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779996.132000:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9c0347bec800) 00010000:00010000:0.0:1787779996.132003:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787779996.132021:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a5179960ce4 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779996.132028:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a5179960ce4 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779996.132039:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787779996.132041:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787779996.132042:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787779996.444463:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0476497840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881610496:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787779996.444534:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779996.444826:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881610496 00000100:00100000:0.0:1787779996.444834:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881610496 00000100:00100000:0.0:1787779996.444901:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1787779996.444910:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347fabc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3642:x1874622881610496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787779996.444932:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923529728 avail 3691978752 00000100:00100000:0.0:1787779996.444983:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347fabc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3642:x1874622881610496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779996.444990:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1787779996.445045:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0476497840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881610496:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787779996.445714:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787779996.445737:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347e55e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881610624:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787779996.445781:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779996.445809:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881610624 00000100:00100000:3.0:1787779996.445816:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881610624 00000100:00100000:3.0:1787779996.445877:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1787779996.445885:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477989e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881610624:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787779996.445905:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787779996.445942:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477989e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881610624:12345-0@lo:13:osp-pre-0-1.0 Request processed in 57us (161us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779996.445949:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1787779996.446033:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347e55e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881610624:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1787779996.828156:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787779996.956156:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047798b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881610752:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787779996.956224:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779996.956493:0:8529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881610752 00000100:00100000:3.0:1787779996.956502:0:8529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881610752 00000100:00100000:3.0:1787779996.956572:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1787779996.956586:0:8529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0348802580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3644:x1874622881610752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787779996.956606:0:8529:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787779996.956649:0:8529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0348802580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3644:x1874622881610752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779996.956656:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00080000:1.0:1787779996.956737:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787779996.957689:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047798b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881610752:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787779997.589445:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787779997.589493:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787779997.589582:0:12488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863692160 00000100:00100000:0.0:1787779997.589592:0:12488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863692160 00000100:00100000:0.0:1787779997.589666:0:12488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 330 00000100:00100000:0.0:1787779997.589677:0:12488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c047798b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:2409:x1874622863692160:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1787779997.589759:0:12488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c047798b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:2409:x1874622863692160:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 84us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779997.589779:0:12488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 330 00000100:00080000:1.0:1787779997.589960:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787779997.590076:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863691904 00000100:00100000:2.0:1787779997.590081:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863691904 00000100:00100000:2.0:1787779997.590123:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 389 00000100:00100000:2.0:1787779997.590131:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471775850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+13:2409:x1874622863691904:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1787779997.590172:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471775850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+13:2409:x1874622863691904:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 42us (736us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779997.590192:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 389 00000100:00100000:1.0:1787779997.598148:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787779997.598188:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787779997.598302:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863692288 00000100:00100000:0.0:1787779997.598312:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863692288 00000100:00100000:0.0:1787779997.598371:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 138 00000100:00100000:0.0:1787779997.598380:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477842d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+7:2408:x1874622863692288:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1787779997.598455:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477842d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+7:2408:x1874622863692288:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 76us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779997.598462:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 138 00000100:00080000:0.0:1787779997.598483:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787779997.598745:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787779997.598769:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787779997.598791:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787779997.598811:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863692416 00000100:00100000:1.0:1787779997.598815:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863692416 00000100:00100000:1.0:1787779997.598873:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 139 00000100:00100000:1.0:1787779997.598880:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477843c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+6:2409:x1874622863692416:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1787779997.598921:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477843c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+6:2409:x1874622863692416:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 41us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779997.598928:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 139 00000100:00100000:1.0:1787779997.598947:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863692032 00000100:00100000:1.0:1787779997.598950:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863692032 00000100:00100000:1.0:1787779997.598972:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 331 00000100:00100000:1.0:1787779997.598977:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04778421c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+18:2408:x1874622863692032:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1787779997.599006:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04778421c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+18:2408:x1874622863692032:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 29us (868us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779997.599013:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 331 00000100:00100000:1.0:1787779997.599023:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863692544 00000100:00100000:1.0:1787779997.599026:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863692544 00000100:00080000:0.0:1787779997.599114:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787779997.599228:0:12488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863692672 00000100:00100000:0.0:1787779997.599232:0:12488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863692672 00000100:00080000:3.0:1787779997.599266:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787779997.599267:0:12488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 332 00000100:00100000:0.0:1787779997.599273:0:12488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0461957480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+5:2409:x1874622863692672:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1787779997.599316:0:12488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0461957480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+5:2409:x1874622863692672:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 43us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779997.599323:0:12488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 332 00000100:00100000:1.0:1787779997.601464:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 333 00000100:00100000:1.0:1787779997.601480:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04619561c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+5:2408:x1874622863692544:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1787779997.601613:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04619561c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+5:2408:x1874622863692544:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 137us (2841us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779997.601621:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 333 00000100:00080000:1.0:1787779997.601656:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787779997.851922:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787779997.856906:0:14256:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787779997.856917:0:14256:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787779997.856942:0:14256:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1787779997.856952:0:14256:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787779998.002801:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787779998.002852:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863692928 00000100:00100000:1.0:1787779998.002861:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863692928 00000100:00100000:1.0:1787779998.002914:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 94 00000100:00100000:1.0:1787779998.002925:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0461955e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+18:11353:x1874622863692928:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:1.0:1787779998.002946:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787779998.002965:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4b200/0xc8fc0a5179960ceb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea1ea9 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779998.003078:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a800/0xc8fc0a5179960cf2 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779998.003092:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a800/0xc8fc0a5179960cf2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779998.003105:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a800/0xc8fc0a5179960cf2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787779998.003115:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1787779998.003211:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4b200/0xc8fc0a5179960ceb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1ea9 expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779998.003227:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a800/0xc8fc0a5179960cf2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1ea9 expref: 20 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779998.003235:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c0443d81900) 00010000:00010000:1.0:1787779998.003238:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787779998.003242:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0347e4a800, rc 0) 00000100:00100000:1.0:1787779998.003307:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0461955e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+20:11353:x1874622863692928:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 383us (515us total) trans 4294967365 rc 0/0 00000100:00100000:1.0:1787779998.003314:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 94 00000100:00100000:1.0:1787779998.011293:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787779998.011726:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863693056 00000100:00100000:3.0:1787779998.011737:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863693056 00000100:00100000:3.0:1787779998.011807:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 95 00000100:00100000:3.0:1787779998.011817:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0461954f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+20:11353:x1874622863693056:12345-192.168.203.31@tcp:34:lfs.0 00010000:00010000:3.0:1787779998.011970:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a5179960d00 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779998.011987:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a5179960d00 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779998.011999:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a5179960d00 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779998.012014:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc000/0xc8fc0a5179960d07 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779998.012020:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc000/0xc8fc0a5179960d07 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779998.012026:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc000/0xc8fc0a5179960d07 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779998.012100:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dca00/0xc8fc0a5179960d0e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779998.012109:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dca00/0xc8fc0a5179960d0e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779998.012130:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dca00/0xc8fc0a5179960d0e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787779998.012176:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dca00/0xc8fc0a5179960d0e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779998.012188:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a5179960d00 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779998.012195:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a5179960d00 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779998.012202:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a5179960d00 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779998.012208:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c04766dc400 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:3.0:1787779998.012213:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a5179960d00 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779998.012220:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a5179960d00 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779998.012233:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c0443d81900) 00010000:00010000:3.0:1787779998.012236:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787779998.012239:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a5179960d00 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779998.012245:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a5179960d00 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779998.012255:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc000/0xc8fc0a5179960d07 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779998.012267:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc000/0xc8fc0a5179960d07 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779998.012273:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc000/0xc8fc0a5179960d07 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779998.012277:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c04766dc000 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:3.0:1787779998.012280:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc000/0xc8fc0a5179960d07 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779998.012286:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc000/0xc8fc0a5179960d07 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779998.012294:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9c0443d81800) 00010000:00010000:3.0:1787779998.012296:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787779998.012299:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc000/0xc8fc0a5179960d07 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779998.012305:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc000/0xc8fc0a5179960d07 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779998.012319:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dca00/0xc8fc0a5179960d0e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779998.012325:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dca00/0xc8fc0a5179960d0e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779998.012331:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dca00/0xc8fc0a5179960d0e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779998.012336:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c04766dca00 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:3.0:1787779998.012347:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dca00/0xc8fc0a5179960d0e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779998.012353:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dca00/0xc8fc0a5179960d0e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779998.012361:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c0443d81500) 00010000:00010000:3.0:1787779998.012363:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787779998.012366:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dca00/0xc8fc0a5179960d0e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779998.012372:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dca00/0xc8fc0a5179960d0e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779998.012441:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0461954f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+20:11353:x1874622863693056:12345-192.168.203.31@tcp:34:lfs.0 Request processed in 624us (1156us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779998.012449:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 95 00000100:00080000:1.0:1787779998.012540:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787779998.043214:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787779998.045301:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863693312 00000100:00100000:2.0:1787779998.045315:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863693312 00000100:00100000:2.0:1787779998.045414:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 96 00000100:00100000:2.0:1787779998.045425:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0461beed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+20:11357:x1874622863693312:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:2.0:1787779998.045445:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787779998.045465:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18e00/0xc8fc0a5179960d15 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea1eb0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779998.045531:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19000/0xc8fc0a5179960d1c lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779998.045545:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19000/0xc8fc0a5179960d1c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779998.045555:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19000/0xc8fc0a5179960d1c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779998.045568:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18200/0xc8fc0a5179960d23 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779998.045574:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18200/0xc8fc0a5179960d23 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779998.045580:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18200/0xc8fc0a5179960d23 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779998.045686:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19e00/0xc8fc0a5179960d2a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779998.045718:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19e00/0xc8fc0a5179960d2a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779998.045726:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19e00/0xc8fc0a5179960d2a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787779998.045738:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:2.0:1787779998.045814:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19000/0xc8fc0a5179960d1c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779998.045821:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19000/0xc8fc0a5179960d1c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779998.045827:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19000/0xc8fc0a5179960d1c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779998.045832:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0444c19000 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:2.0:1787779998.045916:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19000/0xc8fc0a5179960d1c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779998.045926:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19000/0xc8fc0a5179960d1c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779998.045937:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c0443d81900) 00010000:00010000:2.0:1787779998.045941:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787779998.046014:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19000/0xc8fc0a5179960d1c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779998.046023:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19000/0xc8fc0a5179960d1c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779998.046036:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18200/0xc8fc0a5179960d23 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779998.046049:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18200/0xc8fc0a5179960d23 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779998.046055:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18200/0xc8fc0a5179960d23 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779998.046060:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0444c18200 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:2.0:1787779998.046063:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18200/0xc8fc0a5179960d23 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779998.046070:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18200/0xc8fc0a5179960d23 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779998.046090:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9c0347a4ef00) 00010000:00010000:2.0:1787779998.046093:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787779998.046097:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18200/0xc8fc0a5179960d23 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779998.046103:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18200/0xc8fc0a5179960d23 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779998.046143:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18e00/0xc8fc0a5179960d15 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1eb0 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779998.046157:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19e00/0xc8fc0a5179960d2a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1eb0 expref: 22 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779998.046163:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c0347a4ea00) 00010000:00010000:2.0:1787779998.046166:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787779998.046175:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0444c19e00, rc 0) 00000100:00100000:2.0:1787779998.046242:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0461beed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+22:11357:x1874622863693312:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 818us (3038us total) trans 4294967366 rc 0/0 00000100:00100000:2.0:1787779998.046249:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 96 00000100:00100000:1.0:1787779998.049261:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787779998.049346:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863693440 00000100:00100000:2.0:1787779998.049356:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863693440 00000100:00100000:2.0:1787779998.049421:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 97 00000100:00100000:2.0:1787779998.049431:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347c34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+22:11357:x1874622863693440:12345-192.168.203.31@tcp:54:lfs.0 00010000:00010000:2.0:1787779998.049493:0:7821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19a00/0xc8fc0a5179960d38 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779998.049508:0:7821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19a00/0xc8fc0a5179960d38 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779998.049518:0:7821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19a00/0xc8fc0a5179960d38 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779998.049549:0:7821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19a00/0xc8fc0a5179960d38 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779998.049556:0:7821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19a00/0xc8fc0a5179960d38 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779998.049562:0:7821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19a00/0xc8fc0a5179960d38 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779998.049568:0:7821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0444c19a00 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:2.0:1787779998.049571:0:7821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19a00/0xc8fc0a5179960d38 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779998.049578:0:7821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19a00/0xc8fc0a5179960d38 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779998.049616:0:7821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c0347a4ea00) 00010000:00010000:2.0:1787779998.049619:0:7821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787779998.049623:0:7821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19a00/0xc8fc0a5179960d38 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779998.049628:0:7821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19a00/0xc8fc0a5179960d38 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779998.050489:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347c34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+22:11357:x1874622863693440:12345-192.168.203.31@tcp:54:lfs.0 Request processed in 1055us (1232us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779998.050499:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 97 00000100:00100000:3.0:1787779998.052169:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787779998.052327:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863693696 00000100:00100000:0.0:1787779998.052337:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863693696 00000100:00100000:0.0:1787779998.052471:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 21 00000100:00100000:0.0:1787779998.052481:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c044361b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+22:11357:x1874622863693696:12345-192.168.203.31@tcp:35:lfs.0 00000100:00100000:0.0:1787779998.052750:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c044361b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+23:11357:x1874622863693696:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 270us (587us total) trans 4294967367 rc 0/0 00000100:00100000:0.0:1787779998.052757:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 21 00000100:00100000:1.0:1787779998.094518:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787779998.094623:0:12488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863693952 00000100:00100000:2.0:1787779998.094632:0:12488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863693952 00000100:00100000:2.0:1787779998.094688:0:12488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 98 00000100:00100000:2.0:1787779998.094697:0:12488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347c34780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:781d29bb-23d2-48e3-b16d-c29e52cd5375+23:10874:x1874622863693952:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:2.0:1787779998.094732:0:12488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787779998.094753:0:12488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19a00/0xc8fc0a5179960d3f lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea1eb7 expref: -99 pid: 12488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779998.094898:0:12488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18e00/0xc8fc0a5179960d46 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779998.094913:0:12488:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19e00/0xc8fc0a5179960d2a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1eb0 expref: 24 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779998.094921:0:12488:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18e00/0xc8fc0a5179960d46 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779998.095016:0:12488:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19e00/0xc8fc0a5179960d2a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1eb0 expref: 24 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779998.095043:0:12488:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19e00/0xc8fc0a5179960d2a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1eb0 expref: 24 pid: 6513 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779998.095271:0:12488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348801a40 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12488:1874622881610880:192.168.203.31@tcp:104: 00000100:00100000:0.0:1787779998.095446:0:12488:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c04537e06c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787779998.099937:0:12488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348801a40 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12488:1874622881610880:192.168.203.31@tcp:104: 00010000:00010000:0.0:1787779998.099968:0:12488:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18e00/0xc8fc0a5179960d46 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779998.100420:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787779998.100511:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863694080 00000100:00100000:3.0:1787779998.100517:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863694080 00010000:00010000:3.0:1787779998.100554:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19e00/0xc8fc0a5179960d2a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1eb0 expref: 25 pid: 6513 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779998.100593:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 65 00000100:00100000:3.0:1787779998.100603:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04812aad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+25:2410:x1874622863694080:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787779998.100618:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787779998.100625:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19e00/0xc8fc0a5179960d2a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1eb0 expref: 25 pid: 6513 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779998.100638:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19e00/0xc8fc0a5179960d2a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1eb0 expref: 25 pid: 6513 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779998.100672:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19e00/0xc8fc0a5179960d2a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1eb0 expref: 25 pid: 6513 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779998.100688:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c0347a4ea00) 00010000:00010000:3.0:1787779998.100693:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18e00/0xc8fc0a5179960d46 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779998.100702:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18e00/0xc8fc0a5179960d46 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779998.100719:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18e00/0xc8fc0a5179960d46 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779998.100747:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787779998.100803:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04812aad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+24:2410:x1874622863694080:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 201us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779998.100811:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 65 00010000:00010000:0.0:1787779998.101073:0:12488:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18e00/0xc8fc0a5179960d46 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779998.101083:0:12488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18e00/0xc8fc0a5179960d46 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787779998.101102:0:12488:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:0.0:1787779998.101241:0:12488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19a00/0xc8fc0a5179960d3f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1eb7 expref: 25 pid: 12488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779998.101258:0:12488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18e00/0xc8fc0a5179960d46 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1eb7 expref: 24 pid: 12488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779998.101265:0:12488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c0347a4ea00) 00010000:00010000:0.0:1787779998.101268:0:12488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787779998.101271:0:12488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0444c18e00, rc 0) 00000100:00100000:0.0:1787779998.101311:0:12488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347c34780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:781d29bb-23d2-48e3-b16d-c29e52cd5375+24:10874:x1874622863693952:12345-192.168.203.31@tcp:101:bash.0 Request processed in 6615us (6802us total) trans 4294967368 rc 0/0 00000100:00100000:0.0:1787779998.101318:0:12488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 98 00000100:00100000:1.0:1787779998.108213:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787779998.108720:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863694208 00000100:00100000:2.0:1787779998.108731:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863694208 00000100:00100000:2.0:1787779998.108797:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 99 00000100:00100000:2.0:1787779998.108808:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04812a8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+24:10874:x1874622863694208:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:2.0:1787779998.108836:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787779998.108894:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18200/0xc8fc0a5179960d54 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea1ebe expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779998.108927:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19000/0xc8fc0a5179960d5b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779998.108941:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19000/0xc8fc0a5179960d5b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779998.108953:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19000/0xc8fc0a5179960d5b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779998.109069:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18200/0xc8fc0a5179960d54 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1ebe expref: 26 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779998.109088:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19000/0xc8fc0a5179960d5b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1ebe expref: 25 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779998.109108:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c0347a4ea00) 00010000:00010000:2.0:1787779998.109111:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787779998.109114:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0444c19000, rc 0) 00000100:00100000:2.0:1787779998.109179:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04812a8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+25:10874:x1874622863694208:12345-192.168.203.31@tcp:101:bash.0 Request processed in 373us (975us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779998.109187:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 99 00000100:00100000:1.0:1787779998.118603:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787779998.118968:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863694464 00000100:00100000:2.0:1787779998.118977:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863694464 00000100:00100000:2.0:1787779998.119034:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 100 00000100:00100000:2.0:1787779998.119044:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04812ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+25:10874:x1874622863694464:12345-192.168.203.31@tcp:36:bash.0 00010000:00010000:2.0:1787779998.119256:0:7821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18200/0xc8fc0a5179960d62 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779998.119273:0:7821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18200/0xc8fc0a5179960d62 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779998.119285:0:7821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18200/0xc8fc0a5179960d62 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787779998.119327:0:7821:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967369 00000004:00010000:2.0:1787779998.119348:0:7821:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002eeab59c reply state 00000000e4442229 transno 4294967370 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18200/0xc8fc0a5179960d62 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779998.119474:0:7821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18200/0xc8fc0a5179960d62 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779998.119483:0:7821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c0347a4ea00) 00010000:00010000:2.0:1787779998.119486:0:7821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787779998.119503:0:7821:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1787779998.119544:0:7821:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967370 00000100:00100000:2.0:1787779998.119649:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04812ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+29:10874:x1874622863694464:12345-192.168.203.31@tcp:36:bash.0 Request processed in 605us (1053us total) trans 4294967371 rc 0/0 00000100:00100000:2.0:1787779998.119657:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 100 00000020:00080000:2.0:1787779998.119662:0:7821:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1787779998.122893:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787779998.122986:0:12488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863694592 00000100:00100000:0.0:1787779998.122995:0:12488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863694592 00000100:00100000:0.0:1787779998.123054:0:12488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 101 00000100:00100000:0.0:1787779998.123064:0:12488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04812a8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:781d29bb-23d2-48e3-b16d-c29e52cd5375+29:10874:x1874622863694592:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:0.0:1787779998.123086:0:12488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787779998.123117:0:12488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869c00/0xc8fc0a5179960d69 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea1ec5 expref: -99 pid: 12488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779998.123171:0:12488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869c00/0xc8fc0a5179960d69 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1ec5 expref: 30 pid: 12488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779998.123184:0:12488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869c00/0xc8fc0a5179960d69 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1ec5 expref: 30 pid: 12488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779998.123201:0:12488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c0347a4ea00) 00010000:00010000:0.0:1787779998.123204:0:12488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787779998.123207:0:12488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0477869c00, rc 0) 00000100:00100000:0.0:1787779998.123266:0:12488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04812a8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:781d29bb-23d2-48e3-b16d-c29e52cd5375+30:10874:x1874622863694592:12345-192.168.203.31@tcp:101:bash.0 Request processed in 204us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779998.123280:0:12488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 101 00000100:00100000:3.0:1787779998.126030:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787779998.126204:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863694720 00000100:00100000:0.0:1787779998.126216:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863694720 00000100:00100000:0.0:1787779998.126290:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 41 00000100:00100000:0.0:1787779998.126301:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347e55e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+6:10874:x1874622863694720:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:0.0:1787779998.126316:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787779998.126337:0:8427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000091228ed4/0xc8fc0a5179960d70 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea1ecc expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787779998.126486:0:8427:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a8f5b9b, atime: 0x6a8f5b99, ctime: 0x6a8f5b9b, blocks: 0x8 00010000:00010000:0.0:1787779998.126509:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=406s v=(0 0) 00010000:00010000:0.0:1787779998.126514:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787779998.126522:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000091228ed4/0xc8fc0a5179960d70 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1ecc expref: 7 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779998.126553:0:8427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000091228ed4/0xc8fc0a5179960d70 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1ecc expref: 7 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779998.126566:0:8427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0477869600, rc 0) 00000100:00100000:0.0:1787779998.127374:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347e55e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+7:10874:x1874622863694720:12345-192.168.203.31@tcp:101:bash.0 Request processed in 1071us (1347us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779998.127383:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 41 00000100:00100000:2.0:1787779998.143930:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787779998.147933:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863694848 00000100:00100000:3.0:1787779998.148019:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863694848 00002000:00010000:2.0:1787779998.148239:0:8433:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/3 (0->18446744073709551615) 00002000:00100000:2.0:1787779998.148245:0:8433:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c03488021c0 with x1874622863694848 ext(0->18446744073709551615) 00002000:00010000:2.0:1787779998.148258:0:8433:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c03488021c0. 00000100:00100000:2.0:1787779998.148458:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 1 00000100:00100000:2.0:1787779998.148469:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03488021c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+7:2411:x1874622863694848:12345-192.168.203.31@tcp:10:bash.0 00002000:00010000:2.0:1787779998.148927:0:8433:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1787779998.148932:0:8433:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 1787779995 -> 1787779998 00002000:00010000:2.0:1787779998.148934:0:8433:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 1787779993 -> 1787779993 00002000:00010000:2.0:1787779998.148936:0:8433:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1787779995 -> 1787779998 00002000:00010000:2.0:1787779998.148938:0:8433:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:2.0:1787779998.150233:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03488021c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+8:2411:x1874622863694848:12345-192.168.203.31@tcp:10:bash.0 Request processed in 1759us (6305us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1787779998.150245:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 1 00002000:00010000:2.0:1787779998.150250:0:8433:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/3 (0->18446744073709551615) 00002000:00100000:2.0:1787779998.150253:0:8433:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c03488021c0 with x1874622863694848 ext(0->18446744073709551615) 00002000:00010000:2.0:1787779998.150261:0:8433:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c03488021c0. 00000100:00100000:1.0:1787779998.264620:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787779998.266033:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863694976 00000100:00100000:2.0:1787779998.266047:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863694976 00000100:00100000:2.0:1787779998.266119:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 102 00000100:00100000:2.0:1787779998.266129:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347dacf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+30:11371:x1874622863694976:12345-192.168.203.31@tcp:34:lfs.0 00010000:00010000:2.0:1787779998.266234:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18400/0xc8fc0a5179960d77 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779998.266262:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18400/0xc8fc0a5179960d77 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779998.266274:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18400/0xc8fc0a5179960d77 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779998.266291:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18a00/0xc8fc0a5179960d7e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779998.266298:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18a00/0xc8fc0a5179960d7e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779998.266304:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18a00/0xc8fc0a5179960d7e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779998.266370:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19600/0xc8fc0a5179960d85 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779998.266378:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19600/0xc8fc0a5179960d85 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779998.266384:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19600/0xc8fc0a5179960d85 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787779998.266583:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19600/0xc8fc0a5179960d85 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779998.266597:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18400/0xc8fc0a5179960d77 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779998.266616:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18400/0xc8fc0a5179960d77 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779998.266622:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18400/0xc8fc0a5179960d77 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779998.266628:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0444c18400 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:2.0:1787779998.266632:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18400/0xc8fc0a5179960d77 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779998.266640:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18400/0xc8fc0a5179960d77 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779998.266653:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c0443d81900) 00010000:00010000:2.0:1787779998.266656:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787779998.266660:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18400/0xc8fc0a5179960d77 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779998.266665:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18400/0xc8fc0a5179960d77 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779998.266678:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18a00/0xc8fc0a5179960d7e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779998.266682:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18a00/0xc8fc0a5179960d7e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779998.266687:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18a00/0xc8fc0a5179960d7e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779998.266691:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0444c18a00 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:2.0:1787779998.266702:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18a00/0xc8fc0a5179960d7e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779998.266719:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18a00/0xc8fc0a5179960d7e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779998.266727:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9c0347a4ef00) 00010000:00010000:2.0:1787779998.266729:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787779998.266732:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18a00/0xc8fc0a5179960d7e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779998.266737:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18a00/0xc8fc0a5179960d7e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779998.266749:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19600/0xc8fc0a5179960d85 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779998.266755:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19600/0xc8fc0a5179960d85 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779998.266761:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19600/0xc8fc0a5179960d85 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779998.266765:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0444c19600 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:2.0:1787779998.266767:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19600/0xc8fc0a5179960d85 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779998.266773:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19600/0xc8fc0a5179960d85 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779998.266780:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c0347a4ea00) 00010000:00010000:2.0:1787779998.266782:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787779998.266792:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19600/0xc8fc0a5179960d85 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779998.266798:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19600/0xc8fc0a5179960d85 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779998.266924:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347dacf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+30:11371:x1874622863694976:12345-192.168.203.31@tcp:34:lfs.0 Request processed in 795us (2312us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779998.266934:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 102 00000100:00100000:2.0:1787779998.314774:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787779998.314923:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863695232 00000100:00100000:1.0:1787779998.314932:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863695232 00000100:00100000:1.0:1787779998.315013:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 103 00000100:00100000:1.0:1787779998.315024:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03488012c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+30:11374:x1874622863695232:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:1.0:1787779998.315045:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787779998.315098:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4b600/0xc8fc0a5179960d8c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea1ed3 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779998.315170:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4ba00/0xc8fc0a5179960d93 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779998.315185:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4ba00/0xc8fc0a5179960d93 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779998.315196:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4ba00/0xc8fc0a5179960d93 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779998.315210:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a400/0xc8fc0a5179960d9a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779998.315229:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a400/0xc8fc0a5179960d9a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779998.315235:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a400/0xc8fc0a5179960d9a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779998.315360:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a000/0xc8fc0a5179960da1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779998.315383:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a000/0xc8fc0a5179960da1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779998.315390:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a000/0xc8fc0a5179960da1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787779998.315400:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:1.0:1787779998.315476:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4ba00/0xc8fc0a5179960d93 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779998.315483:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4ba00/0xc8fc0a5179960d93 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779998.315490:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4ba00/0xc8fc0a5179960d93 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779998.315496:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0347e4ba00 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:1.0:1787779998.315501:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4ba00/0xc8fc0a5179960d93 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779998.315508:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4ba00/0xc8fc0a5179960d93 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779998.315520:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c0443d81900) 00010000:00010000:1.0:1787779998.315524:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787779998.315528:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4ba00/0xc8fc0a5179960d93 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779998.315535:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4ba00/0xc8fc0a5179960d93 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779998.315549:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a400/0xc8fc0a5179960d9a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779998.315562:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a400/0xc8fc0a5179960d9a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779998.315567:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a400/0xc8fc0a5179960d9a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779998.315573:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0347e4a400 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:1.0:1787779998.315576:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a400/0xc8fc0a5179960d9a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779998.315581:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a400/0xc8fc0a5179960d9a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779998.315590:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9c0341cd1000) 00010000:00010000:1.0:1787779998.315592:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787779998.315595:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a400/0xc8fc0a5179960d9a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779998.315600:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a400/0xc8fc0a5179960d9a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779998.315641:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4b600/0xc8fc0a5179960d8c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1ed3 expref: 33 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779998.315655:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a000/0xc8fc0a5179960da1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1ed3 expref: 32 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779998.315663:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c0347a4ea00) 00010000:00010000:1.0:1787779998.315665:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787779998.315676:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0347e4a000, rc 0) 00000100:00100000:1.0:1787779998.315774:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03488012c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+32:11374:x1874622863695232:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 751us (1008us total) trans 4294967372 rc 0/0 00000100:00100000:1.0:1787779998.315783:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 103 00000100:00100000:1.0:1787779998.323009:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787779998.323112:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863695360 00000100:00100000:3.0:1787779998.323121:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863695360 00000100:00100000:3.0:1787779998.323177:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 104 00000100:00100000:3.0:1787779998.323188:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347daf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+32:11374:x1874622863695360:12345-192.168.203.31@tcp:54:lfs.0 00010000:00010000:3.0:1787779998.323251:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dca00/0xc8fc0a5179960daf lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779998.323269:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18e00/0xc8fc0a5179960d46 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1eb7 expref: 32 pid: 12488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779998.323389:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dca00/0xc8fc0a5179960daf lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779998.323425:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18e00/0xc8fc0a5179960d46 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1eb7 expref: 32 pid: 12488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779998.323439:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18e00/0xc8fc0a5179960d46 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1eb7 expref: 32 pid: 12488 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779998.323454:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0476441e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1874622881611008:192.168.203.31@tcp:104: 00000100:00100000:3.0:1787779998.323555:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0347ec6c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787779998.332415:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787779998.333054:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863695616 00000100:00100000:0.0:1787779998.333074:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863695616 00000100:00100000:0.0:1787779998.333134:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 22 00000100:00100000:0.0:1787779998.333144:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04764403c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+33:6177:x1874622863695616:12345-192.168.203.31@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1787779998.333425:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04764403c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+34:6177:x1874622863695616:12345-192.168.203.31@tcp:35:ldlm_bl.0 Request processed in 281us (1019us total) trans 4294967373 rc 0/0 00000100:00100000:0.0:1787779998.333433:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 22 00000100:00100000:1.0:1787779998.333477:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0476441e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1874622881611008:192.168.203.31@tcp:104: 00010000:00010000:1.0:1787779998.333504:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dca00/0xc8fc0a5179960daf lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779998.335902:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787779998.336059:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863695744 00000100:00100000:2.0:1787779998.336067:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863695744 00010000:00010000:2.0:1787779998.336102:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18e00/0xc8fc0a5179960d46 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1eb7 expref: 34 pid: 12488 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779998.336144:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 66 00000100:00100000:2.0:1787779998.336154:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0476441e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+34:2410:x1874622863695744:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787779998.336168:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787779998.336174:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18e00/0xc8fc0a5179960d46 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1eb7 expref: 34 pid: 12488 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779998.336186:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18e00/0xc8fc0a5179960d46 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1eb7 expref: 34 pid: 12488 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779998.336205:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18e00/0xc8fc0a5179960d46 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1eb7 expref: 34 pid: 12488 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779998.336221:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c0347a4ea00) 00010000:00010000:2.0:1787779998.336227:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dca00/0xc8fc0a5179960daf lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779998.336250:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dca00/0xc8fc0a5179960daf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779998.336257:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dca00/0xc8fc0a5179960daf lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779998.336289:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787779998.336335:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0476441e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+33:2410:x1874622863695744:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 182us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779998.336343:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 66 00010000:00010000:3.0:1787779998.336449:0:6514:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dca00/0xc8fc0a5179960daf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779998.336457:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dca00/0xc8fc0a5179960daf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779998.336495:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dca00/0xc8fc0a5179960daf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779998.336503:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dca00/0xc8fc0a5179960daf lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779998.336509:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dca00/0xc8fc0a5179960daf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779998.336515:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c04766dca00 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:3.0:1787779998.336526:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dca00/0xc8fc0a5179960daf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779998.336534:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dca00/0xc8fc0a5179960daf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779998.336544:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c0347a4ea00) 00010000:00010000:3.0:1787779998.336547:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787779998.336551:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dca00/0xc8fc0a5179960daf lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779998.336558:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dca00/0xc8fc0a5179960daf lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779998.336602:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347daf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+32:11374:x1874622863695360:12345-192.168.203.31@tcp:54:lfs.0 Request processed in 13416us (13603us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779998.336610:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 104 00000100:00100000:3.0:1787779998.340410:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787779998.340576:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863696000 00000100:00100000:0.0:1787779998.340585:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863696000 00000100:00100000:0.0:1787779998.340641:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 23 00000100:00100000:0.0:1787779998.340651:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04618e83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+32:11374:x1874622863696000:12345-192.168.203.31@tcp:35:lfs.0 00000100:00100000:0.0:1787779998.341144:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04618e83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+33:11374:x1874622863696000:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 493us (742us total) trans 4294967374 rc 0/0 00000100:00100000:0.0:1787779998.341152:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 23 00000100:00100000:0.0:1787779998.428451:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787779998.428546:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863696256 00000100:00100000:2.0:1787779998.428555:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863696256 00000100:00100000:2.0:1787779998.428611:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 105 00000100:00100000:2.0:1787779998.428621:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0476497840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+33:11385:x1874622863696256:12345-192.168.203.31@tcp:101:cat.0 00010000:00010000:2.0:1787779998.428644:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787779998.428665:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18e00/0xc8fc0a5179960db6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea1eda expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779998.428747:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18a00/0xc8fc0a5179960dbd lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779998.428763:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18a00/0xc8fc0a5179960dbd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779998.428774:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18a00/0xc8fc0a5179960dbd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779998.428790:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18400/0xc8fc0a5179960dc4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779998.428815:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18400/0xc8fc0a5179960dc4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779998.428823:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18400/0xc8fc0a5179960dc4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779998.428986:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18000/0xc8fc0a5179960dcb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779998.428996:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18000/0xc8fc0a5179960dcb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779998.429003:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18000/0xc8fc0a5179960dcb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787779998.429013:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 8 00010000:00010000:2.0:1787779998.429098:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18a00/0xc8fc0a5179960dbd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779998.429106:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18a00/0xc8fc0a5179960dbd lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779998.429113:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18a00/0xc8fc0a5179960dbd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779998.429119:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0444c18a00 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:2.0:1787779998.429124:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18a00/0xc8fc0a5179960dbd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779998.429132:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18a00/0xc8fc0a5179960dbd lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779998.429155:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c0443d81900) 00010000:00010000:2.0:1787779998.429158:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787779998.429163:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18a00/0xc8fc0a5179960dbd lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779998.429169:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18a00/0xc8fc0a5179960dbd lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779998.429185:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18400/0xc8fc0a5179960dc4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779998.429191:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18400/0xc8fc0a5179960dc4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779998.429196:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18400/0xc8fc0a5179960dc4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779998.429202:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0444c18400 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:2.0:1787779998.429204:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18400/0xc8fc0a5179960dc4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779998.429211:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18400/0xc8fc0a5179960dc4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779998.429217:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9c0347a4ef00) 00010000:00010000:2.0:1787779998.429220:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787779998.429222:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18400/0xc8fc0a5179960dc4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779998.429228:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18400/0xc8fc0a5179960dc4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779998.429276:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18e00/0xc8fc0a5179960db6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1eda expref: 36 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779998.429289:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18000/0xc8fc0a5179960dcb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1eda expref: 35 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779998.429297:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c0347a4ea00) 00010000:00010000:2.0:1787779998.429299:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787779998.429301:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0444c18000, rc 0) 00000100:00100000:2.0:1787779998.429360:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0476497840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+35:11385:x1874622863696256:12345-192.168.203.31@tcp:101:cat.0 Request processed in 741us (920us total) trans 4294967375 rc 0/0 00000100:00100000:2.0:1787779998.429369:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 105 00000100:00100000:3.0:1787779998.434899:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787779998.435258:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863696512 00000100:00100000:2.0:1787779998.435268:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863696512 00000100:00100000:2.0:1787779998.435326:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 24 00000100:00100000:2.0:1787779998.435336:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04618ebc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+35:11385:x1874622863696512:12345-192.168.203.31@tcp:35:cat.0 00000100:00100000:2.0:1787779998.435608:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04618ebc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+36:11385:x1874622863696512:12345-192.168.203.31@tcp:35:cat.0 Request processed in 273us (773us total) trans 4294967376 rc 0/0 00000100:00100000:2.0:1787779998.435616:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 24 00000100:00100000:3.0:1787779998.455517:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787779998.455626:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863696768 00000100:00100000:1.0:1787779998.455636:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863696768 00000100:00100000:1.0:1787779998.455700:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 106 00000100:00100000:1.0:1787779998.455720:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0345e770c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+36:11386:x1874622863696768:12345-192.168.203.31@tcp:36:rm.0 00010000:00010000:1.0:1787779998.455777:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:1.0:1787779998.455803:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869c00/0xc8fc0a5179960d69 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1ec5 expref: 36 pid: 12488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779998.455825:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18000/0xc8fc0a5179960dcb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1eda expref: 35 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779998.455903:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a000/0xc8fc0a5179960da1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1ed3 expref: 34 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779998.455919:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19000/0xc8fc0a5179960d5b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1ebe expref: 33 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779998.455929:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c0347a4ea00) 00010000:00010000:1.0:1787779998.455946:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787779998.455980:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4b600/0xc8fc0a5179960dd9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779998.455994:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4b600/0xc8fc0a5179960dd9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779998.456004:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4b600/0xc8fc0a5179960dd9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779998.456018:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a400/0xc8fc0a5179960de0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779998.456026:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a400/0xc8fc0a5179960de0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779998.456031:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a400/0xc8fc0a5179960de0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779998.456115:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4ba00/0xc8fc0a5179960de7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779998.456125:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4ba00/0xc8fc0a5179960de7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779998.456132:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4ba00/0xc8fc0a5179960de7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787779998.456338:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:1.0:1787779998.456348:0:6512:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 406460509291ns, next at 407460506663ns, rc = 0 00010000:00010000:1.0:1787779998.456393:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4be00/0xc8fc0a5179960dee lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779998.456415:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4be00/0xc8fc0a5179960dee lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779998.456424:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4be00/0xc8fc0a5179960dee lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779998.456431:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4be00/0xc8fc0a5179960dee lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779998.456438:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4be00/0xc8fc0a5179960dee lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779998.456444:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4be00/0xc8fc0a5179960dee lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779998.456469:0:6512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787779998.456486:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4ba00/0xc8fc0a5179960de7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779998.456492:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4ba00/0xc8fc0a5179960de7 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779998.456498:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4ba00/0xc8fc0a5179960de7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779998.456503:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0347e4ba00 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:1.0:1787779998.456508:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4ba00/0xc8fc0a5179960de7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779998.456515:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4ba00/0xc8fc0a5179960de7 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779998.456532:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c0347a4ea00) 00010000:00010000:1.0:1787779998.456535:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787779998.456539:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4ba00/0xc8fc0a5179960de7 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779998.456545:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4ba00/0xc8fc0a5179960de7 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779998.456561:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4b600/0xc8fc0a5179960dd9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779998.456567:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4b600/0xc8fc0a5179960dd9 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779998.456573:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4b600/0xc8fc0a5179960dd9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779998.456578:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0347e4b600 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:1.0:1787779998.456580:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4b600/0xc8fc0a5179960dd9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779998.456586:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4b600/0xc8fc0a5179960dd9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779998.456593:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c0443d81900) 00010000:00010000:1.0:1787779998.456596:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787779998.456599:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4b600/0xc8fc0a5179960dd9 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779998.456604:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4b600/0xc8fc0a5179960dd9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787779998.456624:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000b6b039f reply state 000000002958c51f transno 4294967377 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a400/0xc8fc0a5179960de0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779998.456636:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a400/0xc8fc0a5179960de0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779998.456643:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9c0341cd1000) 00010000:00010000:1.0:1787779998.456645:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787779998.456648:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787779998.456741:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0345e770c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+34:11386:x1874622863696768:12345-192.168.203.31@tcp:36:rm.0 Request processed in 1022us (1232us total) trans 4294967377 rc 0/0 00000100:00100000:1.0:1787779998.456749:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 106 00010000:00010000:0.0:1787779998.457096:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787779998.457110:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4be00/0xc8fc0a5179960dee lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779998.457117:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0347e4be00 already unused, calling callback (ffffffffc0d97420) 00010000:00010000:0.0:1787779998.457121:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4be00/0xc8fc0a5179960dee lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779998.457127:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4be00/0xc8fc0a5179960dee lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779998.457137:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c0347a4ea00) 00010000:00010000:0.0:1787779998.457140:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787779998.457143:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4be00/0xc8fc0a5179960dee lrc: 1/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779998.457148:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4be00/0xc8fc0a5179960dee lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779998.457160:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787779998.457162:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787779998.457164:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787779998.494053:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787779998.494087:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348834780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874622881611136:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787779998.494166:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779998.494449:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881611136 00000100:00100000:3.0:1787779998.494457:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881611136 00000100:00100000:3.0:1787779998.494510:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1787779998.494519:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04764970c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1874622881611136:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787779998.494552:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:3.0:1787779998.494607:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04764970c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1874622881611136:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779998.494614:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1787779998.494790:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348834780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874622881611136:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787779998.509663:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787779998.509787:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863697024 00000100:00100000:1.0:1787779998.509797:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863697024 00000100:00100000:1.0:1787779998.509903:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 107 00000100:00100000:1.0:1787779998.509913:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0345e76d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+34:11392:x1874622863697024:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:1.0:1787779998.509940:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787779998.509973:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4b600/0xc8fc0a5179960df5 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea1ee1 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779998.510078:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4ba00/0xc8fc0a5179960dfc lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779998.510093:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4ba00/0xc8fc0a5179960dfc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779998.510104:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4ba00/0xc8fc0a5179960dfc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779998.510132:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a000/0xc8fc0a5179960e03 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779998.510141:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a000/0xc8fc0a5179960e03 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779998.510147:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a000/0xc8fc0a5179960e03 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787779998.510450:0:6514:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x3:0x0], index 0: 0 00010000:00010000:1.0:1787779998.510581:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a600/0xc8fc0a5179960e0a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779998.510590:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a600/0xc8fc0a5179960e0a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779998.510597:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a600/0xc8fc0a5179960e0a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779998.510627:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4ba00/0xc8fc0a5179960dfc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779998.510634:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4ba00/0xc8fc0a5179960dfc lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779998.510639:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4ba00/0xc8fc0a5179960dfc lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779998.510645:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0347e4ba00 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:1.0:1787779998.510649:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4ba00/0xc8fc0a5179960dfc lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779998.510667:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4ba00/0xc8fc0a5179960dfc lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779998.510679:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c0443d81900) 00010000:00010000:1.0:1787779998.510681:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787779998.510685:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4ba00/0xc8fc0a5179960dfc lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779998.510691:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4ba00/0xc8fc0a5179960dfc lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787779998.510716:0:6514:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000272ee666 reply state 000000001a73d5bb transno 4294967378 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a000/0xc8fc0a5179960e03 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779998.510727:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a000/0xc8fc0a5179960e03 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779998.510733:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9c0341cd1000) 00010000:00010000:1.0:1787779998.510735:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787779998.510738:0:6514:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787779998.510764:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4b600/0xc8fc0a5179960df5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1ee1 expref: 37 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779998.510779:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a600/0xc8fc0a5179960e0a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1ee1 expref: 36 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779998.510786:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c0341cd1500) 00010000:00010000:1.0:1787779998.510788:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787779998.510790:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0347e4a600, rc 0) 00000100:00100000:1.0:1787779998.510907:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0345e76d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+37:11392:x1874622863697024:12345-192.168.203.31@tcp:101:bash.0 Request processed in 995us (1254us total) trans 4294967378 rc 0/0 00000100:00100000:1.0:1787779998.510924:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 107 00000100:00100000:1.0:1787779998.515917:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787779998.516048:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863697152 00000100:00100000:3.0:1787779998.516077:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863697152 00000100:00100000:3.0:1787779998.516131:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 42 00000100:00100000:3.0:1787779998.516141:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0348837840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+7:2410:x1874622863697152:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:3.0:1787779998.516159:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787779998.516180:0:8428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000caa8902b/0xc8fc0a5179960e18 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea1ee8 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787779998.516205:0:8428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787779998.516224:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=406s v=(0 0) 00010000:00010000:3.0:1787779998.516229:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787779998.516239:0:8428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000caa8902b/0xc8fc0a5179960e18 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1ee8 expref: 8 pid: 8428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779998.516257:0:8428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000caa8902b/0xc8fc0a5179960e18 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1ee8 expref: 8 pid: 8428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779998.516269:0:8428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c04766dc000, rc 0) 00000100:00100000:3.0:1787779998.516328:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0348837840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+8:2410:x1874622863697152:12345-192.168.203.31@tcp:101:bash.0 Request processed in 189us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779998.516334:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 42 00000100:00100000:0.0:1787779998.528924:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787779998.530074:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863697280 00000100:00100000:2.0:1787779998.530085:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863697280 00000100:00100000:2.0:1787779998.530144:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 43 00000100:00100000:2.0:1787779998.530155:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04764961c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+8:11392:x1874622863697280:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:2.0:1787779998.530173:0:9899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787779998.530191:0:9899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f4c09eaf/0xc8fc0a5179960e1f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea1eef expref: -99 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779998.530236:0:9899:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000caa8902b/0xc8fc0a5179960e18 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1ee8 expref: 9 pid: 8428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779998.530245:0:9899:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787779998.530249:0:9899:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787779998.530254:0:9899:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4c09eaf/0xc8fc0a5179960e1f lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1eef expref: 9 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779998.530287:0:9899:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000caa8902b/0xc8fc0a5179960e18 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1ee8 expref: 9 pid: 8428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779998.530301:0:9899:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000caa8902b/0xc8fc0a5179960e18 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1ee8 expref: 9 pid: 8428 timeout: 506 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779998.530314:0:9899:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348800b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9899:1874622881611264:192.168.203.31@tcp:104: 00000100:00100000:2.0:1787779998.531201:0:9899:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c04537e0600 going to sleep for 11 seconds 00000100:00100000:2.0:1787779998.538001:0:9899:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348800b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9899:1874622881611264:192.168.203.31@tcp:104: 00010000:00010000:2.0:1787779998.538038:0:9899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f4c09eaf/0xc8fc0a5179960e1f lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1eef expref: 9 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779998.538072:0:9899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0444c18e00, rc 0) 00000100:00100000:2.0:1787779998.538132:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04764961c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+9:11392:x1874622863697280:12345-192.168.203.31@tcp:101:bash.0 Request processed in 7978us (9215us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779998.538141:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 43 00000100:00100000:1.0:1787779998.541236:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787779998.541328:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863697408 00000100:00100000:3.0:1787779998.541338:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863697408 00010000:00010000:3.0:1787779998.541376:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000caa8902b/0xc8fc0a5179960e18 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1ee8 expref: 9 pid: 8428 timeout: 506 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779998.541423:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 67 00000100:00100000:3.0:1787779998.541433:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0348835680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+9:2410:x1874622863697408:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787779998.541463:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787779998.541485:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000caa8902b/0xc8fc0a5179960e18 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1ee8 expref: 9 pid: 8428 timeout: 506 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779998.541498:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000caa8902b/0xc8fc0a5179960e18 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1ee8 expref: 9 pid: 8428 timeout: 506 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779998.541522:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000caa8902b/0xc8fc0a5179960e18 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1ee8 expref: 9 pid: 8428 timeout: 506 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779998.541539:0:6499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787779998.541543:0:6499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787779998.541551:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f4c09eaf/0xc8fc0a5179960e1f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1eef expref: 8 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779998.541561:0:6499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4c09eaf/0xc8fc0a5179960e1f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1eef expref: 8 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779998.541596:0:6499:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000f4c09eaf/0xc8fc0a5179960e1f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1eef expref: 8 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779998.541611:0:6499:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0345e75e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6499:1874622881611392:192.168.203.31@tcp:105: 00000100:00100000:3.0:1787779998.541689:0:6499:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0347ec6c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787779998.555099:0:6499:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0345e75e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6499:1874622881611392:192.168.203.31@tcp:105: 00010000:00010000:3.0:1787779998.555125:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787779998.555196:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0348835680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+8:2410:x1874622863697408:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 13763us (13968us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779998.555208:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 67 00000100:00100000:0.0:1787779998.556440:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787779998.556526:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863697664 00000100:00100000:2.0:1787779998.556534:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863697664 00000100:00100000:2.0:1787779998.556590:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 25 00000100:00100000:2.0:1787779998.556600:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346da6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+37:11392:x1874622863697664:12345-192.168.203.31@tcp:35:bash.0 00000100:00100000:2.0:1787779998.556916:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346da6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+38:11392:x1874622863697664:12345-192.168.203.31@tcp:35:bash.0 Request processed in 316us (481us total) trans 4294967379 rc 0/0 00000100:00100000:2.0:1787779998.556924:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 25 00000100:00100000:1.0:1787779998.725559:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787779998.725665:0:12488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863697792 00000100:00100000:0.0:1787779998.725673:0:12488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863697792 00000100:00100000:0.0:1787779998.725747:0:12488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 108 00000100:00100000:0.0:1787779998.725757:0:12488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03488370c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:781d29bb-23d2-48e3-b16d-c29e52cd5375+38:11409:x1874622863697792:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:0.0:1787779998.725792:0:12488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787779998.725813:0:12488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869800/0xc8fc0a5179960e26 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea1ef6 expref: -99 pid: 12488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779998.725912:0:12488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869000/0xc8fc0a5179960e2d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779998.725926:0:12488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869000/0xc8fc0a5179960e2d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779998.725948:0:12488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869000/0xc8fc0a5179960e2d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787779998.725988:0:12488:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1787779998.725991:0:12488:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787779998.726007:0:12488:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869000/0xc8fc0a5179960e2d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779998.726031:0:12488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869800/0xc8fc0a5179960e26 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1ef6 expref: 40 pid: 12488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779998.726050:0:12488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869000/0xc8fc0a5179960e2d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1ef6 expref: 39 pid: 12488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779998.726058:0:12488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c0443d81900) 00010000:00010000:0.0:1787779998.726061:0:12488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787779998.726064:0:12488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0477869000, rc 0) 00000100:00100000:0.0:1787779998.726246:0:12488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03488370c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:781d29bb-23d2-48e3-b16d-c29e52cd5375+39:11409:x1874622863697792:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 490us (694us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779998.726255:0:12488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 108 00000100:00100000:3.0:1787779998.731367:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787779998.743823:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863698048 00000100:00100000:2.0:1787779998.743852:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863698048 00000100:00100000:2.0:1787779998.744023:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 109 00000100:00100000:2.0:1787779998.744034:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0345e75e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+39:11409:x1874622863698048:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:2.0:1787779998.745544:0:7821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787779998.745573:0:7821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18400/0xc8fc0a5179960e34 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea1efd expref: -99 pid: 7821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779998.745686:0:7821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18a00/0xc8fc0a5179960e3b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779998.745699:0:7821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18a00/0xc8fc0a5179960e3b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779998.745728:0:7821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18a00/0xc8fc0a5179960e3b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787779998.745739:0:7821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1787779998.745854:0:7821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18400/0xc8fc0a5179960e34 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1efd expref: 42 pid: 7821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779998.745873:0:7821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18a00/0xc8fc0a5179960e3b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1efd expref: 41 pid: 7821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779998.745896:0:7821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c0341cd1500) 00010000:00010000:2.0:1787779998.745899:0:7821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787779998.745902:0:7821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0444c18a00, rc 0) 00000100:00100000:2.0:1787779998.745989:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0345e75e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+41:11409:x1874622863698048:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 1956us (14636us total) trans 4294967380 rc 0/0 00000100:00100000:2.0:1787779998.746194:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 109 00000100:00100000:3.0:1787779998.752827:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787779998.757023:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787779998.757399:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863698432 00000100:00100000:3.0:1787779998.757408:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863698432 00000100:00100000:3.0:1787779998.757475:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 7 00000100:00100000:3.0:1787779998.757486:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347e583c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+41:2411:x1874622863698432:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787779998.757502:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787779998.757526:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18a00/0xc8fc0a5179960e3b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1efd expref: 41 pid: 7821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779998.757547:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c0341cd1500) 00010000:00010000:3.0:1787779998.757553:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787779998.757601:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347e583c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+40:2411:x1874622863698432:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 118us (589us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779998.757609:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 7 00000100:00100000:1.0:1787779998.758473:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863698304 00000100:00100000:1.0:1787779998.758481:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863698304 00000100:00100000:1.0:1787779998.758555:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 110 00000100:00100000:1.0:1787779998.758564:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c048131c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+40:11409:x1874622863698304:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:1.0:1787779998.758587:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787779998.758605:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4b400/0xc8fc0a5179960e49 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea1f04 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779998.760230:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4aa00/0xc8fc0a5179960e50 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779998.760553:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4aa00/0xc8fc0a5179960e50 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779998.760568:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4aa00/0xc8fc0a5179960e50 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787779998.760585:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:1.0:1787779998.760721:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4b400/0xc8fc0a5179960e49 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1f04 expref: 43 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779998.760742:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4aa00/0xc8fc0a5179960e50 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1f04 expref: 42 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779998.760767:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c0341cd1500) 00010000:00010000:1.0:1787779998.760771:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787779998.760774:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0347e4aa00, rc 0) 00000100:00100000:1.0:1787779998.760860:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c048131c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+42:11409:x1874622863698304:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 2296us (8041us total) trans 4294967381 rc 0/0 00000100:00100000:1.0:1787779998.760869:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 110 00000100:00100000:3.0:1787779998.766727:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787779998.766810:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863698560 00000100:00100000:1.0:1787779998.766825:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863698560 00000100:00100000:1.0:1787779998.766935:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 44 00000100:00100000:1.0:1787779998.766946:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347e58780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+8:2410:x1874622863698560:12345-192.168.203.31@tcp:1:lfs.0 00010000:00010000:1.0:1787779998.766990:0:8428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000049fbcdd9/0xc8fc0a5179960e5e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779998.767027:0:8428:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f4c09eaf/0xc8fc0a5179960e1f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1eef expref: 8 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779998.767037:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787779998.767041:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787779998.767046:0:8428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000049fbcdd9/0xc8fc0a5179960e5e lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779998.767083:0:8428:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f4c09eaf/0xc8fc0a5179960e1f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1eef expref: 8 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779998.767097:0:8428:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f4c09eaf/0xc8fc0a5179960e1f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1eef expref: 8 pid: 9899 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779998.767127:0:8428:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348834780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1874622881611520:192.168.203.31@tcp:104: 00000100:00100000:1.0:1787779998.767225:0:8428:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c04717aef00 going to sleep for 11 seconds 00000100:00100000:1.0:1787779998.777601:0:8428:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348834780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1874622881611520:192.168.203.31@tcp:104: 00010000:00010000:1.0:1787779998.777633:0:8428:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000049fbcdd9/0xc8fc0a5179960e5e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779998.779384:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787779998.779544:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863698688 00000100:00100000:1.0:1787779998.779558:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863698688 00002000:00100000:1.0:1787779998.779609:0:8435:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff9c0347e59a40 x1874622863698688/t0(0) o4->781d29bb-23d2-48e3-b16d-c29e52cd5375@192.168.203.31@tcp:409/0 lens 504/0 e 0 to 0 dl 1787780009 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787779998.779620:0:8435:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c0347e59a40 with x1874622863698688 ext(0->8) 00010000:00010000:1.0:1787779998.779629:0:8435:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000f4c09eaf/0xc8fc0a5179960e1f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1eef expref: 9 pid: 9899 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779998.779646:0:8435:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000f4c09eaf/0xc8fc0a5179960e1f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1eef expref: 9 pid: 9899 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787779998.779654:0:8435:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9c0347e59a40 00000100:00100000:1.0:1787779998.779712:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 1 00000100:00100000:1.0:1787779998.779723:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347e59a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+9:2410:x1874622863698688:12345-192.168.203.31@tcp:4:lfs.0 00000100:00100000:0.0:1787779998.789169:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347e59a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+11:2410:x1874622863698688:12345-192.168.203.31@tcp:4:lfs.0 Request processed in 9430us (9780us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1787779998.789193:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 1 00002000:00100000:0.0:1787779998.789212:0:8435:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff9c0347e59a40 x1874622863698688/t4294967303(0) o4->781d29bb-23d2-48e3-b16d-c29e52cd5375@192.168.203.31@tcp:409/0 lens 504/448 e 0 to 0 dl 1787780009 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787779998.789224:0:8435:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c0347e59a40 with x1874622863698688 ext(0->8) 00010000:00010000:0.0:1787779998.789236:0:8435:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000f4c09eaf/0xc8fc0a5179960e1f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1eef expref: 11 pid: 9899 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779998.789258:0:8435:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000f4c09eaf/0xc8fc0a5179960e1f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1eef expref: 11 pid: 9899 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787779998.789267:0:8435:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9c0347e59a40 00000001:00080000:3.0:1787779998.791418:0:8423:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:3.0:1787779998.791437:0:8423:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000100:00100000:3.0:1787779998.800465:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787779998.805076:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863698816 00000100:00100000:2.0:1787779998.805090:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863698816 00010000:00010000:2.0:1787779998.805137:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f4c09eaf/0xc8fc0a5179960e1f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1eef expref: 7 pid: 9899 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779998.805245:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 68 00000100:00100000:2.0:1787779998.805263:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046099f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+7:2411:x1874622863698816:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787779998.805278:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1787779998.805296:0:6497:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1787779998.805299:0:6497:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1787779999 00002000:00010000:2.0:1787779998.805301:0:6497:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 1787779999 00002000:00010000:2.0:1787779998.805303:0:6497:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 0 -> 1787779999 00002000:00010000:2.0:1787779998.805305:0:6497:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1787779998.805311:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f4c09eaf/0xc8fc0a5179960e1f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1eef expref: 7 pid: 9899 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779998.805326:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f4c09eaf/0xc8fc0a5179960e1f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1eef expref: 7 pid: 9899 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779998.805373:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f4c09eaf/0xc8fc0a5179960e1f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1eef expref: 7 pid: 9899 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779998.805391:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787779998.805395:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787779998.805400:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000049fbcdd9/0xc8fc0a5179960e5e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779998.805410:0:6497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000049fbcdd9/0xc8fc0a5179960e5e lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779998.805446:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787779998.805512:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046099f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+6:2411:x1874622863698816:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 250us (5057us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779998.805519:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 68 00010000:00010000:1.0:1787779998.806863:0:8428:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000049fbcdd9/0xc8fc0a5179960e5e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779998.806896:0:8428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000049fbcdd9/0xc8fc0a5179960e5e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779998.806923:0:8428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000049fbcdd9/0xc8fc0a5179960e5e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779998.806932:0:8428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000049fbcdd9/0xc8fc0a5179960e5e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779998.806953:0:8428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000049fbcdd9/0xc8fc0a5179960e5e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779998.806961:0:8428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0347e4b800 already unused, calling callback (ffffffffc0d97420) 00010000:00010000:1.0:1787779998.806966:0:8428:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000049fbcdd9/0xc8fc0a5179960e5e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779998.806974:0:8428:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000049fbcdd9/0xc8fc0a5179960e5e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779998.806990:0:8428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000049fbcdd9/0xc8fc0a5179960e5e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779998.807006:0:8428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000049fbcdd9/0xc8fc0a5179960e5e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787779998.807098:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347e58780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:2410:x1874622863698560:12345-192.168.203.31@tcp:1:lfs.0 Request processed in 40152us (40396us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779998.807108:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 44 00000100:00100000:3.0:1787779998.812075:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787779998.812224:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863699072 00000100:00100000:2.0:1787779998.812232:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863699072 00000100:00100000:2.0:1787779998.812288:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 26 00000100:00100000:2.0:1787779998.812297:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c044361a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+42:11409:x1874622863699072:12345-192.168.203.31@tcp:35:lfs.0 00000004:00010000:2.0:1787779998.812353:0:6515:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4aa00/0xc8fc0a5179960e50 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1f04 expref: 42 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787779998.812518:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00000001:00080000:2.0:1787779998.812550:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:2.0:1787779998.812879:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00010000:00010000:2.0:1787779998.812912:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18400/0xc8fc0a5179960e65 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779998.812931:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a600/0xc8fc0a5179960e0a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1ee1 expref: 46 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779998.812940:0:6515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18400/0xc8fc0a5179960e65 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779998.812972:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a600/0xc8fc0a5179960e0a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1ee1 expref: 46 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779998.812985:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a600/0xc8fc0a5179960e0a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1ee1 expref: 46 pid: 6514 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779998.813994:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348800b40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6515:1874622881611648:192.168.203.31@tcp:104: 00000100:00100000:2.0:1787779998.814111:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c04537e0180 going to sleep for 11 seconds 00000100:00100000:2.0:1787779998.817373:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348800b40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6515:1874622881611648:192.168.203.31@tcp:104: 00010000:00010000:2.0:1787779998.817402:0:6515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18400/0xc8fc0a5179960e65 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779998.818420:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787779998.818498:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863699200 00000100:00100000:2.0:1787779998.818507:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863699200 00010000:00010000:2.0:1787779998.818544:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a600/0xc8fc0a5179960e0a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1ee1 expref: 47 pid: 6514 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779998.818583:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 69 00000100:00100000:2.0:1787779998.818593:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347e5bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+47:2410:x1874622863699200:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787779998.818607:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787779998.818628:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a600/0xc8fc0a5179960e0a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1ee1 expref: 47 pid: 6514 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779998.818641:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a600/0xc8fc0a5179960e0a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1ee1 expref: 47 pid: 6514 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779998.818665:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a600/0xc8fc0a5179960e0a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1ee1 expref: 47 pid: 6514 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779998.818682:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c0341cd1500) 00010000:00010000:2.0:1787779998.818687:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18400/0xc8fc0a5179960e65 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779998.818696:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18400/0xc8fc0a5179960e65 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779998.818721:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18400/0xc8fc0a5179960e65 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779998.818754:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787779998.819029:0:6515:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18400/0xc8fc0a5179960e65 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779998.819038:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18400/0xc8fc0a5179960e65 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787779998.819146:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000001:00080000:0.0:1787779998.819266:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000100:00100000:0.0:1787779998.819355:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347fab840 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6515:1874622881611776:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787779998.819403:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787779998.819435:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0347d45d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787779998.819569:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347e5bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+48:2410:x1874622863699200:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 976us (1153us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779998.819579:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 69 00000100:00100000:3.0:1787779998.819670:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881611776 00000100:00100000:3.0:1787779998.819687:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881611776 00000100:00100000:3.0:1787779998.819768:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1787779998.819776:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347fa9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6515:x1874622881611776:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787779998.819883:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347fa9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6515:x1874622881611776:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 108us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779998.819890:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1787779998.819919:0:6515:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967302 gen 2 00000004:00080000:3.0:1787779998.819924:0:6515:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967301 committed transno 4294967302 00000004:00080000:3.0:1787779998.819950:0:6515:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c0346da4780, transno 4294967302 00000100:00100000:3.0:1787779998.819964:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347fab840 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6515:1874622881611776:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1787779998.820066:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00000100:00100000:3.0:1787779998.820110:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347e58000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6515:1874622881611904:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787779998.820139:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779998.820154:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0347ec69c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787779998.820224:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881611904 00000100:00100000:3.0:1787779998.820228:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881611904 00000100:00100000:3.0:1787779998.820245:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00080000:0.0:1787779998.820411:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787779998.820500:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347e59e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6515:x1874622881611904:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787779998.820607:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347e59e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6515:x1874622881611904:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 110us (467us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1787779998.820654:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347e58000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6515:1874622881611904:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1787779998.820689:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00010000:00010000:0.0:1787779998.820746:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18400/0xc8fc0a5179960e65 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779998.820756:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18400/0xc8fc0a5179960e65 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779998.820762:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18400/0xc8fc0a5179960e65 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779998.820769:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0444c18400 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:0.0:1787779998.820773:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18400/0xc8fc0a5179960e65 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779998.820781:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18400/0xc8fc0a5179960e65 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779998.820795:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c0341cd1500) 00010000:00010000:0.0:1787779998.820798:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1787779998.820802:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18400/0xc8fc0a5179960e65 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779998.820808:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18400/0xc8fc0a5179960e65 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787779998.820904:0:6515:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1787779998.820951:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:0.0:1787779998.820961:0:6515:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 406825121779ns, next at 407825119825ns, rc = 0 00000001:00080000:0.0:1787779998.820967:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967389 00010000:00010000:0.0:1787779998.820987:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c0341cd1500) 00010000:00010000:0.0:1787779998.820990:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787779998.820996:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4aa00/0xc8fc0a5179960e50 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1f04 expref: 50 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787779998.821086:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c044361a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+49:11409:x1874622863699072:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 8790us (9020us total) trans 4294967390 rc 0/0 00000100:00100000:0.0:1787779998.821094:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 26 00000020:00080000:0.0:1787779998.821098:0:6515:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1787779998.826576:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1787779998.828623:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787779998.828716:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863699328 00000100:00100000:0.0:1787779998.828730:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863699328 00000100:00100000:0.0:1787779998.828813:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 111 00000100:00100000:0.0:1787779998.828824:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0348834780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+49:11409:x1874622863699328:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:0.0:1787779998.828884:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787779998.828908:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868800/0xc8fc0a5179960e6c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea1f0b expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779998.828979:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868800/0xc8fc0a5179960e6c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1f0b expref: 50 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779998.828993:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868800/0xc8fc0a5179960e6c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1f0b expref: 50 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779998.829013:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c04533a3600) 00010000:00010000:0.0:1787779998.829016:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787779998.829020:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0477868800, rc 0) 00000100:00100000:0.0:1787779998.829084:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0348834780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+50:11409:x1874622863699328:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 261us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779998.829092:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 111 00000100:00100000:1.0:1787779998.834779:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787779998.837384:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863699584 00000100:00100000:0.0:1787779998.837407:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863699584 00000100:00100000:0.0:1787779998.837525:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 27 00000100:00100000:0.0:1787779998.837615:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0348835680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+50:11409:x1874622863699584:12345-192.168.203.31@tcp:35:lfs.0 00000100:00100000:0.0:1787779998.838272:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0348835680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+51:11409:x1874622863699584:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 659us (3585us total) trans 4294967391 rc 0/0 00000100:00100000:0.0:1787779998.838282:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 27 00010000:00010000:0.0:1787779998.876183:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787779998.929782:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787779998.930017:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863699712 00000100:00100000:3.0:1787779998.930031:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863699712 00000100:00100000:3.0:1787779998.930130:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 112 00000100:00100000:3.0:1787779998.930142:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03488be940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+51:11419:x1874622863699712:12345-192.168.203.31@tcp:34:lfs.0 00010000:00010000:3.0:1787779998.930247:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dca00/0xc8fc0a5179960e73 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779998.930287:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dca00/0xc8fc0a5179960e73 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779998.930303:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dca00/0xc8fc0a5179960e73 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779998.930319:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc000/0xc8fc0a5179960e7a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779998.930326:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc000/0xc8fc0a5179960e7a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779998.930332:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc000/0xc8fc0a5179960e7a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779998.930424:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a5179960e81 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779998.930433:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a5179960e81 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779998.930441:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a5179960e81 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787779998.930509:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a5179960e81 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779998.930523:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dca00/0xc8fc0a5179960e73 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779998.930531:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dca00/0xc8fc0a5179960e73 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779998.930549:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dca00/0xc8fc0a5179960e73 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779998.930555:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c04766dca00 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:3.0:1787779998.930559:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dca00/0xc8fc0a5179960e73 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779998.930568:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dca00/0xc8fc0a5179960e73 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779998.930583:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c0443d81900) 00010000:00010000:3.0:1787779998.930587:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787779998.930592:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dca00/0xc8fc0a5179960e73 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779998.930599:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dca00/0xc8fc0a5179960e73 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779998.930615:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc000/0xc8fc0a5179960e7a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779998.930621:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc000/0xc8fc0a5179960e7a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779998.930627:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc000/0xc8fc0a5179960e7a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779998.930632:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c04766dc000 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:3.0:1787779998.930635:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc000/0xc8fc0a5179960e7a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779998.930651:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc000/0xc8fc0a5179960e7a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779998.930660:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9c0341cd1000) 00010000:00010000:3.0:1787779998.930663:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787779998.930666:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc000/0xc8fc0a5179960e7a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779998.930672:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc000/0xc8fc0a5179960e7a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779998.930683:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a5179960e81 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779998.930712:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a5179960e81 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779998.930718:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a5179960e81 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779998.930724:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c04766dc400 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:3.0:1787779998.930726:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a5179960e81 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779998.930732:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a5179960e81 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779998.930740:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c04533a3600) 00010000:00010000:3.0:1787779998.930742:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787779998.930746:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a5179960e81 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779998.930762:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a5179960e81 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779998.930926:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03488be940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+51:11419:x1874622863699712:12345-192.168.203.31@tcp:34:lfs.0 Request processed in 786us (1158us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779998.930936:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 112 00000100:00100000:1.0:1787779998.963681:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787779998.963808:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863699968 00000100:00100000:0.0:1787779998.963822:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863699968 00000100:00100000:0.0:1787779998.964277:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 113 00000100:00100000:0.0:1787779998.964290:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03488bf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+51:11422:x1874622863699968:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:0.0:1787779998.964317:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787779998.964347:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868400/0xc8fc0a5179960e88 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea1f12 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779998.964447:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869200/0xc8fc0a5179960e8f lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779998.964467:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869200/0xc8fc0a5179960e8f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779998.964481:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869200/0xc8fc0a5179960e8f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779998.964494:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868e00/0xc8fc0a5179960e96 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779998.964500:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868e00/0xc8fc0a5179960e96 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779998.964649:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868e00/0xc8fc0a5179960e96 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779998.965190:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869800/0xc8fc0a5179960e9d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779998.965207:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869800/0xc8fc0a5179960e9d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779998.965216:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869800/0xc8fc0a5179960e9d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787779998.965227:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:0.0:1787779998.965331:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869200/0xc8fc0a5179960e8f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779998.965339:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869200/0xc8fc0a5179960e8f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779998.965347:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869200/0xc8fc0a5179960e8f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779998.965353:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0477869200 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:0.0:1787779998.965359:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869200/0xc8fc0a5179960e8f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779998.965367:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869200/0xc8fc0a5179960e8f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779998.965382:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c0443d81900) 00010000:00010000:0.0:1787779998.965385:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787779998.965391:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869200/0xc8fc0a5179960e8f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779998.965410:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869200/0xc8fc0a5179960e8f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779998.965428:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868e00/0xc8fc0a5179960e96 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779998.965434:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868e00/0xc8fc0a5179960e96 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779998.965440:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868e00/0xc8fc0a5179960e96 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779998.965445:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0477868e00 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:0.0:1787779998.965449:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868e00/0xc8fc0a5179960e96 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779998.965455:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868e00/0xc8fc0a5179960e96 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779998.965463:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9c0341cd1000) 00010000:00010000:0.0:1787779998.965466:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787779998.965469:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868e00/0xc8fc0a5179960e96 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779998.965475:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868e00/0xc8fc0a5179960e96 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779998.965609:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868400/0xc8fc0a5179960e88 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1f12 expref: 54 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779998.965627:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869800/0xc8fc0a5179960e9d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1f12 expref: 53 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779998.965643:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c04533a3600) 00010000:00010000:0.0:1787779998.965646:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787779998.965649:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0477869800, rc 0) 00000100:00100000:0.0:1787779998.965815:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03488bf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+53:11422:x1874622863699968:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 1527us (2150us total) trans 4294967392 rc 0/0 00000100:00100000:0.0:1787779998.965833:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 113 00000100:00100000:1.0:1787779998.971464:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787779998.972096:0:12488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863700096 00000100:00100000:3.0:1787779998.972110:0:12488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863700096 00000100:00100000:3.0:1787779998.972192:0:12488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 114 00000100:00100000:3.0:1787779998.972204:0:12488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03488bd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:781d29bb-23d2-48e3-b16d-c29e52cd5375+53:11422:x1874622863700096:12345-192.168.203.31@tcp:54:lfs.0 00010000:00010000:3.0:1787779998.972296:0:12488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a5179960eab lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779998.972317:0:12488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a5179960eab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779998.972330:0:12488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a5179960eab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779998.972379:0:12488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a5179960eab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779998.972385:0:12488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a5179960eab lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779998.972392:0:12488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a5179960eab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779998.972398:0:12488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c04766dc400 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:3.0:1787779998.972403:0:12488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a5179960eab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779998.972429:0:12488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a5179960eab lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779998.972443:0:12488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c04533a3600) 00010000:00010000:3.0:1787779998.972447:0:12488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787779998.972453:0:12488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a5179960eab lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779998.972459:0:12488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a5179960eab lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779998.972644:0:12488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03488bd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:781d29bb-23d2-48e3-b16d-c29e52cd5375+53:11422:x1874622863700096:12345-192.168.203.31@tcp:54:lfs.0 Request processed in 441us (1196us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779998.972654:0:12488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 114 00000100:00100000:1.0:1787779998.976335:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787779998.976434:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863700352 00000100:00100000:3.0:1787779998.976447:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863700352 00000100:00100000:3.0:1787779998.976525:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 28 00000100:00100000:3.0:1787779998.976537:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03488be580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+53:11422:x1874622863700352:12345-192.168.203.31@tcp:35:lfs.0 00000100:00100000:3.0:1787779998.976903:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03488be580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+54:11422:x1874622863700352:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 367us (582us total) trans 4294967393 rc 0/0 00000100:00100000:3.0:1787779998.976913:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 28 00000100:00100000:1.0:1787779999.004508:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787779999.004538:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347e592c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881612032:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787779999.004632:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787779999.004916:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881612032 00000100:00100000:3.0:1787779999.004927:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881612032 00000100:00100000:3.0:1787779999.004998:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1787779999.005009:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347ebc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874622881612032:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787779999.005234:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787779999.005311:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347ebc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874622881612032:12345-0@lo:41:osp-pre-1-0.0 Request processed in 304us (678us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779999.005337:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1787779999.005908:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347e592c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881612032:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787779999.078715:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787779999.078878:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863700608 00000100:00100000:2.0:1787779999.078891:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863700608 00000100:00100000:2.0:1787779999.079023:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 115 00000100:00100000:2.0:1787779999.079035:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347fab840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+54:11432:x1874622863700608:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:2.0:1787779999.079078:0:7821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787779999.079083:0:7821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787779999.079140:0:7821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869000/0xc8fc0a5179960e2d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1ef6 expref: 54 pid: 12488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779999.079164:0:7821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c0443d81900) 00010000:00010000:2.0:1787779999.079171:0:7821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787779999.079190:0:7821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18e00/0xc8fc0a5179960eb2 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea1f19 expref: -99 pid: 7821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779999.079329:0:7821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19c00/0xc8fc0a5179960eb9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779999.079346:0:7821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19c00/0xc8fc0a5179960eb9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779999.079358:0:7821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19c00/0xc8fc0a5179960eb9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787779999.079370:0:7821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1787779999.079504:0:7821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18e00/0xc8fc0a5179960eb2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1f19 expref: 56 pid: 7821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779999.079539:0:7821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19c00/0xc8fc0a5179960eb9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1f19 expref: 55 pid: 7821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779999.079547:0:7821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c04533a3600) 00010000:00010000:2.0:1787779999.079550:0:7821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787779999.079553:0:7821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0444c19c00, rc 0) 00000100:00100000:2.0:1787779999.079642:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347fab840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+55:11432:x1874622863700608:12345-192.168.203.31@tcp:101:bash.0 Request processed in 609us (951us total) trans 4294967394 rc 0/0 00000100:00100000:2.0:1787779999.079651:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 115 00000100:00100000:1.0:1787779999.091306:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787779999.091360:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787779999.091449:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863700864 00000100:00100000:3.0:1787779999.091462:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863700864 00000100:00100000:3.0:1787779999.091553:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 8 00000100:00100000:3.0:1787779999.091564:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347ebd680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+55:2411:x1874622863700864:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787779999.091583:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787779999.091615:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19c00/0xc8fc0a5179960eb9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1f19 expref: 55 pid: 7821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779999.091638:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c04533a3600) 00010000:00010000:3.0:1787779999.091644:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787779999.091724:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347ebd680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+54:2411:x1874622863700864:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 161us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779999.091732:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 8 00000100:00100000:0.0:1787779999.091835:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863700736 00000100:00100000:0.0:1787779999.091877:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863700736 00000100:00100000:0.0:1787779999.091910:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 116 00000100:00100000:0.0:1787779999.091918:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347ebcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+54:11432:x1874622863700736:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:0.0:1787779999.091944:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787779999.091963:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868400/0xc8fc0a5179960ec7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea1f20 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779999.092001:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868e00/0xc8fc0a5179960ece lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779999.092016:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868e00/0xc8fc0a5179960ece lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779999.092028:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868e00/0xc8fc0a5179960ece lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779999.092177:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868400/0xc8fc0a5179960ec7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1f20 expref: 56 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779999.092207:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868e00/0xc8fc0a5179960ece lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1f20 expref: 55 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779999.092216:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c04533a3600) 00010000:00010000:0.0:1787779999.092220:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787779999.092223:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0477868e00, rc 0) 00000100:00100000:0.0:1787779999.092264:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347ebcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+55:11432:x1874622863700736:12345-192.168.203.31@tcp:101:bash.0 Request processed in 347us (974us total) trans 0 rc 0/0 00000100:00100000:0.0:1787779999.092272:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 116 00000100:00100000:1.0:1787779999.105731:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787779999.105929:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863701120 00000100:00100000:3.0:1787779999.105956:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863701120 00000100:00100000:3.0:1787779999.106033:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 117 00000100:00100000:3.0:1787779999.106045:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347ebf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+55:11432:x1874622863701120:12345-192.168.203.31@tcp:36:bash.0 00010000:00010000:3.0:1787779999.106124:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787779999.106165:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869800/0xc8fc0a5179960e9d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1f12 expref: 55 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779999.106191:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c04533a3600) 00010000:00010000:3.0:1787779999.106197:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787779999.106425:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a5179960ed5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779999.106470:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a5179960ed5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779999.106482:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a5179960ed5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787779999.106535:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967395 00000004:00010000:3.0:1787779999.106565:0:6514:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006b3aa092 reply state 000000008f372d09 transno 4294967396 ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a5179960ed5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779999.106579:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a5179960ed5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779999.106586:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c04533a3600) 00010000:00010000:3.0:1787779999.106589:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787779999.106591:0:6514:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787779999.106727:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347ebf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+57:11432:x1874622863701120:12345-192.168.203.31@tcp:36:bash.0 Request processed in 683us (1011us total) trans 4294967396 rc 0/0 00000100:00100000:3.0:1787779999.106736:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 117 00000020:00080000:3.0:1787779999.106743:0:6514:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787779999.120488:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787779999.120625:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863701248 00000100:00100000:2.0:1787779999.120639:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863701248 00000100:00100000:2.0:1787779999.120726:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 118 00000100:00100000:2.0:1787779999.120739:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347ebf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+57:11432:x1874622863701248:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:2.0:1787779999.120770:0:7821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787779999.120799:0:7821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18e00/0xc8fc0a5179960edc lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea1f27 expref: -99 pid: 7821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779999.121005:0:7821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18600/0xc8fc0a5179960ee3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779999.121025:0:7821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18600/0xc8fc0a5179960ee3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779999.121039:0:7821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18600/0xc8fc0a5179960ee3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787779999.121077:0:7821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1787779999.121082:0:7821:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787779999.121107:0:7821:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18600/0xc8fc0a5179960ee3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779999.121138:0:7821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18e00/0xc8fc0a5179960edc lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1f27 expref: 59 pid: 7821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779999.121160:0:7821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18600/0xc8fc0a5179960ee3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1f27 expref: 58 pid: 7821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779999.121170:0:7821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c04533a3600) 00010000:00010000:2.0:1787779999.121173:0:7821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787779999.121186:0:7821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0444c18600, rc 0) 00000100:00100000:2.0:1787779999.121258:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347ebf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+58:11432:x1874622863701248:12345-192.168.203.31@tcp:101:bash.0 Request processed in 522us (785us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779999.121267:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 118 00000100:00100000:0.0:1787779999.127404:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787779999.127496:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863701504 00000100:00100000:3.0:1787779999.127509:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863701504 00000100:00100000:3.0:1787779999.127695:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 29 00000100:00100000:3.0:1787779999.127718:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04618e83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+58:11432:x1874622863701504:12345-192.168.203.31@tcp:35:bash.0 00000100:00100000:3.0:1787779999.128088:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04618e83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+59:11432:x1874622863701504:12345-192.168.203.31@tcp:35:bash.0 Request processed in 372us (696us total) trans 4294967397 rc 0/0 00000100:00100000:3.0:1787779999.128099:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 29 00000100:00100000:1.0:1787779999.210830:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787779999.210964:0:12488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863701632 00000100:00100000:3.0:1787779999.210996:0:12488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863701632 00000100:00100000:3.0:1787779999.211071:0:12488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 119 00000100:00100000:3.0:1787779999.211082:0:12488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477aeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:781d29bb-23d2-48e3-b16d-c29e52cd5375+59:11437:x1874622863701632:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:3.0:1787779999.211112:0:12488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787779999.211139:0:12488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc000/0xc8fc0a5179960eea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea1f2e expref: -99 pid: 12488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779999.212391:0:12488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dca00/0xc8fc0a5179960ef1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779999.212413:0:12488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dca00/0xc8fc0a5179960ef1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779999.212427:0:12488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dca00/0xc8fc0a5179960ef1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787779999.212487:0:12488:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1787779999.212491:0:12488:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787779999.212515:0:12488:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dca00/0xc8fc0a5179960ef1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779999.212550:0:12488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc000/0xc8fc0a5179960eea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1f2e expref: 61 pid: 12488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779999.212572:0:12488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dca00/0xc8fc0a5179960ef1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1f2e expref: 60 pid: 12488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779999.212583:0:12488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c0443d81900) 00010000:00010000:3.0:1787779999.212586:0:12488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787779999.212591:0:12488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c04766dca00, rc 0) 00000100:00100000:3.0:1787779999.212685:0:12488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477aeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:781d29bb-23d2-48e3-b16d-c29e52cd5375+60:11437:x1874622863701632:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 1603us (1870us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779999.212695:0:12488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 119 00000100:00100000:1.0:1787779999.218988:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787779999.219083:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863701760 00000100:00100000:3.0:1787779999.219095:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863701760 00000100:00100000:3.0:1787779999.219180:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 120 00000100:00100000:3.0:1787779999.219192:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477ae8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+60:11437:x1874622863701760:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:3.0:1787779999.219219:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787779999.219248:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc000/0xc8fc0a5179960ef8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea1f35 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779999.219330:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766ddc00/0xc8fc0a5179960eff lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779999.219348:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766ddc00/0xc8fc0a5179960eff lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779999.219361:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766ddc00/0xc8fc0a5179960eff lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779999.219374:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd400/0xc8fc0a5179960f06 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779999.219381:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd400/0xc8fc0a5179960f06 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779999.219388:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd400/0xc8fc0a5179960f06 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779999.219472:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc200/0xc8fc0a5179960f0d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779999.219500:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc200/0xc8fc0a5179960f0d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779999.219508:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc200/0xc8fc0a5179960f0d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787779999.219561:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:3.0:1787779999.219565:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787779999.219586:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc200/0xc8fc0a5179960f0d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779999.219601:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc200/0xc8fc0a5179960f0d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779999.219611:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766ddc00/0xc8fc0a5179960eff lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779999.219619:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766ddc00/0xc8fc0a5179960eff lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779999.219626:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766ddc00/0xc8fc0a5179960eff lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779999.219633:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c04766ddc00 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:3.0:1787779999.219638:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766ddc00/0xc8fc0a5179960eff lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779999.219646:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766ddc00/0xc8fc0a5179960eff lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779999.219659:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c0443d81900) 00010000:00010000:3.0:1787779999.219663:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787779999.219676:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766ddc00/0xc8fc0a5179960eff lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779999.219684:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766ddc00/0xc8fc0a5179960eff lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779999.219711:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd400/0xc8fc0a5179960f06 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779999.219718:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd400/0xc8fc0a5179960f06 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779999.219725:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd400/0xc8fc0a5179960f06 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779999.219730:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c04766dd400 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:3.0:1787779999.219733:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd400/0xc8fc0a5179960f06 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779999.219739:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd400/0xc8fc0a5179960f06 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779999.219747:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9c0341cd1000) 00010000:00010000:3.0:1787779999.219750:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787779999.219753:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd400/0xc8fc0a5179960f06 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779999.219759:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd400/0xc8fc0a5179960f06 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779999.219788:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc000/0xc8fc0a5179960ef8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1f35 expref: 62 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779999.219814:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc200/0xc8fc0a5179960f0d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1f35 expref: 61 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779999.219823:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c04533a3600) 00010000:00010000:3.0:1787779999.219826:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787779999.219828:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c04766dc200, rc 0) 00000100:00100000:3.0:1787779999.219962:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477ae8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+61:11437:x1874622863701760:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 772us (988us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779999.219970:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 120 00000100:00100000:0.0:1787779999.226737:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787779999.226887:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863702016 00000100:00100000:2.0:1787779999.226901:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863702016 00000100:00100000:2.0:1787779999.226979:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 121 00000100:00100000:2.0:1787779999.226990:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04618ebc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+61:11437:x1874622863702016:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:2.0:1787779999.227016:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787779999.227043:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18e00/0xc8fc0a5179960f14 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea1f3c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779999.227333:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19400/0xc8fc0a5179960f1b lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779999.227352:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18600/0xc8fc0a5179960ee3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1f27 expref: 62 pid: 7821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779999.227363:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc200/0xc8fc0a5179960f0d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1f35 expref: 62 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779999.227373:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19400/0xc8fc0a5179960f1b lrc: 5/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779999.227415:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc200/0xc8fc0a5179960f0d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1f35 expref: 62 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779999.227431:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc200/0xc8fc0a5179960f0d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1f35 expref: 62 pid: 6514 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779999.227471:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348800b40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1874622881612160:192.168.203.31@tcp:104: 00010000:00010000:2.0:1787779999.227630:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18600/0xc8fc0a5179960ee3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1f27 expref: 62 pid: 7821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779999.227642:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18600/0xc8fc0a5179960ee3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1f27 expref: 62 pid: 7821 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779999.227655:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348802940 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1874622881612288:192.168.203.31@tcp:104: 00000100:00100000:2.0:1787779999.227686:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c04537e0180 going to sleep for 11 seconds 00000100:00100000:0.0:1787779999.236233:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787779999.236494:0:7921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863702144 00000100:00100000:3.0:1787779999.236503:0:7921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863702144 00010000:00010000:3.0:1787779999.236544:0:7921:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc200/0xc8fc0a5179960f0d lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1f35 expref: 63 pid: 6514 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779999.236592:0:7921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 70 00000100:00100000:3.0:1787779999.236601:0:7921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477af3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+63:2411:x1874622863702144:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787779999.236614:0:7921:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787779999.236621:0:7921:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc200/0xc8fc0a5179960f0d lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1f35 expref: 63 pid: 6514 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779999.236634:0:7921:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc200/0xc8fc0a5179960f0d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1f35 expref: 63 pid: 6514 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779999.236658:0:7921:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c04533a3600) 00010000:00010000:3.0:1787779999.236663:0:7921:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19400/0xc8fc0a5179960f1b lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779999.236684:0:7921:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19400/0xc8fc0a5179960f1b lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779999.236692:0:7921:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787779999.236762:0:7921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477af3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+63:2411:x1874622863702144:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 161us (673us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779999.236769:0:7921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 70 00000100:00100000:0.0:1787779999.239131:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787779999.239711:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348802940 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1874622881612288:192.168.203.31@tcp:104: 00010000:00010000:2.0:1787779999.239730:0:6513:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.31@tcp) returned -22 from blocking AST (req@00000000163c034f x1874622881612160) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc200/0xc8fc0a5179960f0d lrc: 1/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1f35 expref: 62 pid: 6514 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779999.239813:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc200/0xc8fc0a5179960f0d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1f35 expref: 62 pid: 6514 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787779999.239833:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348800b40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1874622881612160:192.168.203.31@tcp:104: 00010000:00010000:2.0:1787779999.239955:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c04533a3600) 00010000:00010000:2.0:1787779999.239962:0:6513:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19400/0xc8fc0a5179960f1b lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779999.239975:0:6513:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19400/0xc8fc0a5179960f1b lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779999.240004:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19400/0xc8fc0a5179960f1b lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779999.241267:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863702272 00000100:00100000:3.0:1787779999.241278:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863702272 00010000:00010000:3.0:1787779999.241318:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18600/0xc8fc0a5179960ee3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1f27 expref: 62 pid: 7821 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787779999.241397:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 71 00000100:00100000:3.0:1787779999.241407:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477af2940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+62:2411:x1874622863702272:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787779999.241421:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787779999.241428:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18600/0xc8fc0a5179960ee3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1f27 expref: 62 pid: 7821 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779999.241439:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18600/0xc8fc0a5179960ee3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1f27 expref: 62 pid: 7821 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779999.241461:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18600/0xc8fc0a5179960ee3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1f27 expref: 62 pid: 7821 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779999.241476:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c04533a3600) 00010000:00010000:3.0:1787779999.241480:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19400/0xc8fc0a5179960f1b lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779999.241502:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19400/0xc8fc0a5179960f1b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779999.241511:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19400/0xc8fc0a5179960f1b lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779999.241546:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787779999.241605:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477af2940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+61:2411:x1874622863702272:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 200us (2481us total) trans 0 rc 0/0 00000100:00100000:3.0:1787779999.241612:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 71 00010000:00010000:0.0:1787779999.241671:0:6513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19400/0xc8fc0a5179960f1b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779999.241679:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19400/0xc8fc0a5179960f1b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787779999.241696:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:0.0:1787779999.241870:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18e00/0xc8fc0a5179960f14 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1f3c expref: 62 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779999.241886:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19400/0xc8fc0a5179960f1b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1f3c expref: 61 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787779999.241893:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c04533a3600) 00010000:00010000:0.0:1787779999.241901:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787779999.241904:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0444c19400, rc 0) 00000100:00100000:0.0:1787779999.241943:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04618ebc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+61:11437:x1874622863702016:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 14955us (15224us total) trans 4294967398 rc 0/0 00000100:00100000:0.0:1787779999.241950:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 121 00000100:00100000:3.0:1787779999.247792:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787779999.249257:0:7921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863702528 00000100:00100000:1.0:1787779999.249269:0:7921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863702528 00000100:00100000:1.0:1787779999.249336:0:7921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 9 00000100:00100000:1.0:1787779999.249345:0:7921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347e592c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+61:11437:x1874622863702528:12345-192.168.203.31@tcp:103:lfs.0 00010000:00010000:1.0:1787779999.249363:0:7921:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787779999.249402:0:7921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868800/0xc8fc0a5179960e6c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1f0b expref: 61 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787779999.249427:0:7921:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c04533a3600) 00010000:00010000:1.0:1787779999.249431:0:7921:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787779999.249490:0:7921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347e592c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+60:11437:x1874622863702528:12345-192.168.203.31@tcp:103:lfs.0 Request processed in 146us (1709us total) trans 0 rc 0/0 00000100:00100000:1.0:1787779999.249498:0:7921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 9 00000100:00100000:1.0:1787779999.253428:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787779999.253718:0:12488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863702656 00000100:00100000:3.0:1787779999.253727:0:12488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863702656 00000100:00100000:3.0:1787779999.253788:0:12488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 122 00000100:00100000:3.0:1787779999.253798:0:12488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477ae83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:781d29bb-23d2-48e3-b16d-c29e52cd5375+60:11437:x1874622863702656:12345-192.168.203.31@tcp:58:lfs.0 00010000:00010000:3.0:1787779999.254278:0:12488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc000/0xc8fc0a5179960f29 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779999.254298:0:12488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc000/0xc8fc0a5179960f29 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787779999.254308:0:12488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc000/0xc8fc0a5179960f29 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787779999.254404:0:12488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:2.0:1787779999.257297:0:12488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477ae83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:781d29bb-23d2-48e3-b16d-c29e52cd5375+60:11437:x1874622863702656:12345-192.168.203.31@tcp:58:lfs.0 Request processed in 3490us (3868us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779999.257313:0:12488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 122 00000100:00100000:0.0:1787779999.260130:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787779999.260316:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863702784 00000100:00100000:2.0:1787779999.260326:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863702784 00000100:00100000:2.0:1787779999.260387:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 123 00000100:00100000:2.0:1787779999.260397:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346dade00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+60:11437:x1874622863702784:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:2.0:1787779999.260417:0:7821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787779999.260438:0:7821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19200/0xc8fc0a5179960f30 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea1f43 expref: -99 pid: 7821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779999.260501:0:7821:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc000/0xc8fc0a5179960f29 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779999.260512:0:7821:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19200/0xc8fc0a5179960f30 lrc: 4/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1f43 expref: 61 pid: 7821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779999.260529:0:7821:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc000/0xc8fc0a5179960f29 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779999.260542:0:7821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19200/0xc8fc0a5179960f30 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1f43 expref: 61 pid: 7821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779999.260554:0:7821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c04533a3600) 00010000:00010000:2.0:1787779999.260570:0:7821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787779999.260574:0:7821:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19200/0xc8fc0a5179960f30 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1f43 expref: 61 pid: 7821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787779999.260581:0:7821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0444c19200, rc 0) 00000100:00100000:2.0:1787779999.260643:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346dade00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+61:11437:x1874622863702784:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 248us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1787779999.260651:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 123 00010000:00010000:3.0:1787779999.900030:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787780000.220091:0:13794:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787780000.220100:0:13794:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787780000.220125:0:13794:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:1.0:1787780000.220136:0:13794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787780000.220282:0:13794:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047796c780 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13794:1874622881612416:192.168.203.31@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787780000.220414:0:13794:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c04717ae6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787780000.225622:0:13794:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047796c780 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13794:1874622881612416:192.168.203.31@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787780000.229639:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787780000.229886:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863702912 00000100:00100000:2.0:1787780000.229897:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863702912 00000100:00100000:2.0:1787780000.229980:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 124 00000100:00100000:2.0:1787780000.229990:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c047785e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+61:11439:x1874622863702912:12345-192.168.203.31@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787780000.230017:0:6513:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787780000.230132:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c047785e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+61:11439:x1874622863702912:12345-192.168.203.31@tcp:53:lhsmtool_posix.0 Request processed in 143us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780000.230148:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 124 00000100:00080000:0.0:1787780000.230213:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787780000.237246:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787780000.237452:0:12488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863703040 00000100:00100000:2.0:1787780000.237462:0:12488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863703040 00000100:00100000:2.0:1787780000.237538:0:12488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 125 00000100:00100000:2.0:1787780000.237548:0:12488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c048134a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:781d29bb-23d2-48e3-b16d-c29e52cd5375+61:11439:x1874622863703040:12345-192.168.203.31@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1787780000.237620:0:12488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18c00/0xc8fc0a5179960f37 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.237637:0:12488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18c00/0xc8fc0a5179960f37 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.237650:0:12488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18c00/0xc8fc0a5179960f37 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.237679:0:12488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18800/0xc8fc0a5179960f3e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.237688:0:12488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18800/0xc8fc0a5179960f3e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.237707:0:12488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18800/0xc8fc0a5179960f3e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.237731:0:12488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19800/0xc8fc0a5179960f45 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.237740:0:12488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19800/0xc8fc0a5179960f45 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.237747:0:12488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19800/0xc8fc0a5179960f45 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787780000.237805:0:12488:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1787780000.237810:0:12488:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787780000.237823:0:12488:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19800/0xc8fc0a5179960f45 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.237834:0:12488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18c00/0xc8fc0a5179960f37 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.237874:0:12488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18c00/0xc8fc0a5179960f37 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.237880:0:12488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18c00/0xc8fc0a5179960f37 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.237896:0:12488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0444c18c00 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:2.0:1787780000.237900:0:12488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18c00/0xc8fc0a5179960f37 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.237907:0:12488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18c00/0xc8fc0a5179960f37 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.237918:0:12488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c0347a50800) 00010000:00010000:2.0:1787780000.237921:0:12488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787780000.237926:0:12488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18c00/0xc8fc0a5179960f37 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.237931:0:12488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18c00/0xc8fc0a5179960f37 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.237944:0:12488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18800/0xc8fc0a5179960f3e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.237949:0:12488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18800/0xc8fc0a5179960f3e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.237954:0:12488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18800/0xc8fc0a5179960f3e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.237959:0:12488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0444c18800 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:2.0:1787780000.237961:0:12488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18800/0xc8fc0a5179960f3e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.237966:0:12488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18800/0xc8fc0a5179960f3e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.237983:0:12488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x444bc3cd (ffff9c0347a4e900) 00010000:00010000:2.0:1787780000.237985:0:12488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787780000.237988:0:12488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18800/0xc8fc0a5179960f3e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.237994:0:12488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18800/0xc8fc0a5179960f3e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.238007:0:12488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19800/0xc8fc0a5179960f45 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.238012:0:12488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19800/0xc8fc0a5179960f45 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.238017:0:12488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19800/0xc8fc0a5179960f45 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.238022:0:12488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0444c19800 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:2.0:1787780000.238024:0:12488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19800/0xc8fc0a5179960f45 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.238030:0:12488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19800/0xc8fc0a5179960f45 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.238038:0:12488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c04533a3600) 00010000:00010000:2.0:1787780000.238040:0:12488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787780000.238043:0:12488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19800/0xc8fc0a5179960f45 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.238048:0:12488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19800/0xc8fc0a5179960f45 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787780000.238131:0:12488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c048134a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:781d29bb-23d2-48e3-b16d-c29e52cd5375+61:11439:x1874622863703040:12345-192.168.203.31@tcp:34:lhsmtool_posix.0 Request processed in 584us (894us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780000.238148:0:12488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 125 00000100:00100000:3.0:1787780000.250284:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787780000.250421:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863703296 00000100:00100000:1.0:1787780000.250431:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863703296 00000100:00100000:1.0:1787780000.250494:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 126 00000100:00100000:1.0:1787780000.250505:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347e583c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+61:11439:x1874622863703296:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787780000.250525:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787780000.250544:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4b800/0xc8fc0a5179960f4c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea1f4a expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780000.250661:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a600/0xc8fc0a5179960f53 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780000.250713:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a600/0xc8fc0a5179960f53 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780000.250725:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a600/0xc8fc0a5179960f53 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787780000.250737:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:1.0:1787780000.250817:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a600/0xc8fc0a5179960f53 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780000.250825:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a600/0xc8fc0a5179960f53 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780000.250831:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a600/0xc8fc0a5179960f53 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780000.250865:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0347e4a600 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:1.0:1787780000.250870:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a600/0xc8fc0a5179960f53 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780000.250878:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a600/0xc8fc0a5179960f53 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780000.250890:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c04533a3600) 00010000:00010000:1.0:1787780000.250893:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787780000.250897:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a600/0xc8fc0a5179960f53 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780000.250904:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a600/0xc8fc0a5179960f53 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780000.250945:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4b800/0xc8fc0a5179960f4c lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1f4a expref: 63 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780000.250963:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c0347a50800) 00010000:00010000:1.0:1787780000.250965:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787780000.250970:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4b800/0xc8fc0a5179960f4c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1f4a expref: 63 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780000.250979:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0347e4b800, rc 0) 00000100:00100000:1.0:1787780000.251029:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347e583c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+62:11439:x1874622863703296:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 526us (754us total) trans 4294967399 rc 301/301 00000100:00100000:1.0:1787780000.251036:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 126 00000100:00100000:0.0:1787780000.258957:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787780000.259031:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863703424 00000100:00100000:1.0:1787780000.259040:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863703424 00000100:00100000:1.0:1787780000.259102:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 127 00000100:00100000:1.0:1787780000.259111:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c048134b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+62:11439:x1874622863703424:12345-192.168.203.31@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787780000.259145:0:6514:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787780000.259246:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c048134b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+62:11439:x1874622863703424:12345-192.168.203.31@tcp:53:lhsmtool_posix.0 Request processed in 136us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780000.259253:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 127 00000100:00100000:0.0:1787780000.266543:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787780000.267687:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863703680 00000100:00100000:1.0:1787780000.267707:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863703680 00000100:00100000:1.0:1787780000.268935:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 128 00000100:00100000:1.0:1787780000.268952:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0481349680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+62:11439:x1874622863703680:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787780000.268974:0:7821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787780000.268978:0:7821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787780000.269005:0:7821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dca00/0xc8fc0a5179960ef1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1f2e expref: 62 pid: 12488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780000.269045:0:7821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c0443d81900) 00010000:00010000:1.0:1787780000.269050:0:7821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787780000.269065:0:7821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4b800/0xc8fc0a5179960f61 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea1f51 expref: -99 pid: 7821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787780000.269432:0:7821:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x4:0x0], index 1: 0 00010000:00010000:1.0:1787780000.269563:0:7821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a600/0xc8fc0a5179960f68 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780000.269577:0:7821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a600/0xc8fc0a5179960f68 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780000.269588:0:7821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a600/0xc8fc0a5179960f68 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780000.269637:0:7821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4b800/0xc8fc0a5179960f61 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1f51 expref: 64 pid: 7821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780000.269653:0:7821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a600/0xc8fc0a5179960f68 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1f51 expref: 63 pid: 7821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780000.269660:0:7821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9c0341cd1200) 00010000:00010000:1.0:1787780000.269663:0:7821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787780000.269665:0:7821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0347e4a600, rc 0) 00000100:00100000:1.0:1787780000.269741:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0481349680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+63:11439:x1874622863703680:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 795us (3206us total) trans 4294967400 rc 0/0 00000100:00100000:1.0:1787780000.269749:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 128 00000100:00100000:3.0:1787780000.273724:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787780000.284054:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863703936 00000100:00100000:0.0:1787780000.284070:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863703936 00000100:00100000:2.0:1787780000.284552:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 129 00000100:00100000:2.0:1787780000.284562:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346da6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+63:11439:x1874622863703936:12345-192.168.203.31@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787780000.284615:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787780000.284639:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a600/0xc8fc0a5179960f68 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1f51 expref: 63 pid: 7821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.284659:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9c0341cd1200) 00010000:00010000:2.0:1787780000.284668:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787780000.284688:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18800/0xc8fc0a5179960f76 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.284717:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18800/0xc8fc0a5179960f76 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.284728:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18800/0xc8fc0a5179960f76 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.284744:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18c00/0xc8fc0a5179960f7d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0xcb789e73 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.284751:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18c00/0xc8fc0a5179960f7d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xcb789e73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.284758:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18c00/0xc8fc0a5179960f7d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xcb789e73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.284816:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18800/0xc8fc0a5179960f76 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.284824:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18800/0xc8fc0a5179960f76 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.284831:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18800/0xc8fc0a5179960f76 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.284855:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0444c18800 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:2.0:1787780000.284860:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18800/0xc8fc0a5179960f76 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.284869:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18800/0xc8fc0a5179960f76 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.284878:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c0443d81900) 00010000:00010000:2.0:1787780000.284881:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787780000.284885:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18800/0xc8fc0a5179960f76 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.284892:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18800/0xc8fc0a5179960f76 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.284903:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18c00/0xc8fc0a5179960f7d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xcb789e73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.284909:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18c00/0xc8fc0a5179960f7d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xcb789e73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.284915:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18c00/0xc8fc0a5179960f7d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xcb789e73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.284929:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0444c18c00 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:2.0:1787780000.284932:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18c00/0xc8fc0a5179960f7d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xcb789e73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.284938:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18c00/0xc8fc0a5179960f7d lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xcb789e73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.284946:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0xcb789e73 (ffff9c0347a4e900) 00010000:00010000:2.0:1787780000.284949:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787780000.284952:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18c00/0xc8fc0a5179960f7d lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xcb789e73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.284958:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18c00/0xc8fc0a5179960f7d lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xcb789e73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787780000.285048:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346da6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+62:11439:x1874622863703936:12345-192.168.203.31@tcp:36:lhsmtool_posix.0 Request processed in 488us (11332us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787780000.285056:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 129 00000100:00100000:2.0:1787780000.296167:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787780000.300803:0:12488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863704064 00000100:00100000:3.0:1787780000.300833:0:12488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863704064 00000100:00100000:3.0:1787780000.303997:0:12488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 130 00000100:00100000:3.0:1787780000.304022:0:12488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0348800b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:781d29bb-23d2-48e3-b16d-c29e52cd5375+62:11439:x1874622863704064:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787780000.304046:0:12488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787780000.304073:0:12488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd400/0xc8fc0a5179960f84 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea1f58 expref: -99 pid: 12488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780000.304108:0:12488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766ddc00/0xc8fc0a5179960f8b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780000.304121:0:12488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766ddc00/0xc8fc0a5179960f8b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780000.304131:0:12488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766ddc00/0xc8fc0a5179960f8b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780000.304246:0:12488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd400/0xc8fc0a5179960f84 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1f58 expref: 64 pid: 12488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780000.304263:0:12488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766ddc00/0xc8fc0a5179960f8b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1f58 expref: 63 pid: 12488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780000.304271:0:12488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9c0443d81200) 00010000:00010000:3.0:1787780000.304274:0:12488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787780000.304276:0:12488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c04766ddc00, rc 0) 00000100:00100000:3.0:1787780000.304342:0:12488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0348800b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:781d29bb-23d2-48e3-b16d-c29e52cd5375+63:11439:x1874622863704064:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 333us (8184us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780000.304350:0:12488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 130 00000100:00100000:0.0:1787780000.310164:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787780000.310346:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863704320 00000100:00100000:1.0:1787780000.310356:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863704320 00000100:00100000:1.0:1787780000.310420:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 131 00000100:00100000:1.0:1787780000.310430:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04813483c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+63:11439:x1874622863704320:12345-192.168.203.31@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787780000.310509:0:7821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4b200/0xc8fc0a5179960f92 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780000.310527:0:7821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4b200/0xc8fc0a5179960f92 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780000.310539:0:7821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4b200/0xc8fc0a5179960f92 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787780000.310705:0:7821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00080000:1.0:1787780000.310716:0:7821:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 408314876990ns, next at 409314874432ns, rc = 0 00000004:00010000:1.0:1787780000.310765:0:7821:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002ecfb172 reply state 00000000e2cb5bfc transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4b200/0xc8fc0a5179960f92 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780000.310780:0:7821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4b200/0xc8fc0a5179960f92 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780000.310788:0:7821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9c0443d81200) 00010000:00010000:1.0:1787780000.310791:0:7821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1787780000.310795:0:7821:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787780000.311070:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04813483c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+65:11439:x1874622863704320:12345-192.168.203.31@tcp:36:lhsmtool_posix.0 Request processed in 639us (914us total) trans 4294967401 rc 0/0 00000100:00100000:1.0:1787780000.311077:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 131 00000100:00100000:1.0:1787780000.315432:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787780000.315573:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863704448 00000100:00100000:3.0:1787780000.315605:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863704448 00000100:00100000:3.0:1787780000.315684:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 132 00000100:00100000:3.0:1787780000.315702:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c047796c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+65:11439:x1874622863704448:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787780000.315734:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787780000.315761:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd600/0xc8fc0a5179960f99 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea1f5f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780000.315828:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd600/0xc8fc0a5179960f99 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1f5f expref: 66 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780000.315872:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd600/0xc8fc0a5179960f99 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1f5f expref: 66 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780000.315901:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9c0443d81200) 00010000:00010000:3.0:1787780000.315904:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787780000.315908:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c04766dd600, rc 0) 00000100:00100000:3.0:1787780000.315979:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c047796c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+66:11439:x1874622863704448:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 283us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780000.315991:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 132 00000100:00100000:2.0:1787780000.331973:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787780000.332151:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863704576 00000100:00100000:0.0:1787780000.332161:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863704576 00000100:00100000:0.0:1787780000.332237:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 45 00000100:00100000:0.0:1787780000.332248:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0348802940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+8:2411:x1874622863704576:12345-192.168.203.31@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1787780000.332465:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0348802940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+9:2411:x1874622863704576:12345-192.168.203.31@tcp:2:lhsmtool_posix.0 Request processed in 218us (502us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1787780000.332474:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 45 00000100:00080000:1.0:1787780000.332599:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787780000.336677:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787780000.336772:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863704832 00000100:00100000:3.0:1787780000.336781:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863704832 00000100:00100000:3.0:1787780000.336870:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 30 00000100:00100000:3.0:1787780000.336881:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0481348f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+66:11439:x1874622863704832:12345-192.168.203.31@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787780000.337103:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0481348f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+67:11439:x1874622863704832:12345-192.168.203.31@tcp:35:lhsmtool_posix.0 Request processed in 223us (434us total) trans 4294967402 rc 0/0 00000100:00100000:3.0:1787780000.337112:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 30 00000100:00100000:3.0:1787780000.342151:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787780000.342363:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863705088 00000100:00100000:2.0:1787780000.342372:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863705088 00000100:00100000:2.0:1787780000.342427:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 133 00000100:00100000:2.0:1787780000.342437:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346da4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+67:11439:x1874622863705088:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787780000.342545:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346da4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+67:11439:x1874622863705088:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 Request processed in 109us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780000.342553:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 133 00000100:00100000:2.0:1787780000.352487:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787780000.352612:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863705216 00000100:00100000:1.0:1787780000.352633:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863705216 00000100:00100000:1.0:1787780000.352801:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 134 00000100:00100000:1.0:1787780000.352813:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0348803480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+67:11439:x1874622863705216:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787780000.352833:0:7821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787780000.352902:0:7821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4b400/0xc8fc0a5179960fa0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea1f66 expref: -99 pid: 7821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780000.352970:0:7821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4ba00/0xc8fc0a5179960fa7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780000.352984:0:7821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4ba00/0xc8fc0a5179960fa7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780000.352995:0:7821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4ba00/0xc8fc0a5179960fa7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787780000.353035:0:7821:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787780000.353065:0:7821:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4ba00/0xc8fc0a5179960fa7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780000.353091:0:7821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4b400/0xc8fc0a5179960fa0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1f66 expref: 69 pid: 7821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780000.353110:0:7821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4ba00/0xc8fc0a5179960fa7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1f66 expref: 68 pid: 7821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780000.353119:0:7821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9c0443d81200) 00010000:00010000:1.0:1787780000.353122:0:7821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787780000.353125:0:7821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0347e4ba00, rc 0) 00000100:00100000:1.0:1787780000.353179:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0348803480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+68:11439:x1874622863705216:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 369us (700us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780000.353193:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 134 00000100:00100000:0.0:1787780000.357557:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787780000.357644:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863705344 00000100:00100000:2.0:1787780000.357654:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863705344 00000100:00100000:2.0:1787780000.357717:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 46 00000100:00100000:2.0:1787780000.357727:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0481348780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+9:2410:x1874622863705344:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787780000.357744:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787780000.357764:0:8430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006c7fab01/0xc8fc0a5179960fae lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea1f6d expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787780000.357788:0:8430:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8f5ba1, blocks: 0x0 00010000:00010000:2.0:1787780000.357807:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=408s v=(0 0) 00010000:00010000:2.0:1787780000.357811:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787780000.357820:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006c7fab01/0xc8fc0a5179960fae lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1f6d expref: 10 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.357873:0:8430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006c7fab01/0xc8fc0a5179960fae lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1f6d expref: 10 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.357888:0:8430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0444c18600, rc 0) 00000100:00100000:2.0:1787780000.357948:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0481348780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+10:2410:x1874622863705344:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 222us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780000.357955:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 46 00000100:00100000:0.0:1787780000.360242:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787780000.360321:0:12488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863705600 00000100:00100000:2.0:1787780000.360329:0:12488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863705600 00000100:00100000:2.0:1787780000.360389:0:12488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 135 00000100:00100000:2.0:1787780000.360398:0:12488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c048134a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:781d29bb-23d2-48e3-b16d-c29e52cd5375+68:11439:x1874622863705600:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787780000.360504:0:12488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c048134a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:781d29bb-23d2-48e3-b16d-c29e52cd5375+68:11439:x1874622863705600:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 Request processed in 106us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780000.360512:0:12488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 135 00000100:00100000:0.0:1787780000.365630:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787780000.366271:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863705728 00000100:00100000:1.0:1787780000.366281:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863705728 00000100:00100000:2.0:1787780000.366754:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 47 00000100:00100000:2.0:1787780000.366767:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0481349a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+10:11439:x1874622863705728:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787780000.366785:0:9899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787780000.366803:0:9899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f4c09eaf/0xc8fc0a5179960fb5 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea1f74 expref: -99 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.366852:0:9899:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006c7fab01/0xc8fc0a5179960fae lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1f6d expref: 11 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.366863:0:9899:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787780000.366868:0:9899:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787780000.366874:0:9899:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f4c09eaf/0xc8fc0a5179960fb5 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1f74 expref: 11 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.366910:0:9899:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006c7fab01/0xc8fc0a5179960fae lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1f6d expref: 11 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.366924:0:9899:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006c7fab01/0xc8fc0a5179960fae lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1f6d expref: 11 pid: 8430 timeout: 508 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787780000.366938:0:9899:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348803c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9899:1874622881612544:192.168.203.31@tcp:104: 00000100:00100000:2.0:1787780000.367338:0:9899:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c04537e0f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787780000.369667:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787780000.369762:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863705856 00000100:00100000:0.0:1787780000.369770:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863705856 00010000:00010000:0.0:1787780000.369806:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006c7fab01/0xc8fc0a5179960fae lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1f6d expref: 12 pid: 8430 timeout: 508 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787780000.369889:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 72 00000100:00100000:0.0:1787780000.369898:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0461befc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+12:2411:x1874622863705856:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787780000.369911:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787780000.369930:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006c7fab01/0xc8fc0a5179960fae lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1f6d expref: 12 pid: 8430 timeout: 508 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780000.369953:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006c7fab01/0xc8fc0a5179960fae lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1f6d expref: 12 pid: 8430 timeout: 508 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780000.369976:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787780000.369981:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787780000.369989:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f4c09eaf/0xc8fc0a5179960fb5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1f74 expref: 12 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780000.369998:0:6497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f4c09eaf/0xc8fc0a5179960fb5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1f74 expref: 12 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780000.370030:0:6497:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000f4c09eaf/0xc8fc0a5179960fb5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1f74 expref: 12 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787780000.370051:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c048134b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6497:1874622881612672:192.168.203.31@tcp:105: 00000100:00100000:0.0:1787780000.370113:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0347d45300 going to sleep for 11 seconds 00010000:00010000:2.0:1787780000.370886:0:9899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006c7fab01/0xc8fc0a5179960fae lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1f6d expref: 12 pid: 8430 timeout: 508 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787780000.370904:0:9899:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348803c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9899:1874622881612544:192.168.203.31@tcp:104: 00010000:00010000:2.0:1787780000.370927:0:9899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f4c09eaf/0xc8fc0a5179960fb5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1f74 expref: 11 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.370949:0:9899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0444c18e00, rc 0) 00000100:00100000:2.0:1787780000.370993:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0481349a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+11:11439:x1874622863705728:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 4230us (5371us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780000.371001:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 47 00000100:00100000:0.0:1787780000.373144:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c048134b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6497:1874622881612672:192.168.203.31@tcp:105: 00010000:00010000:0.0:1787780000.373183:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787780000.373230:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0461befc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+10:2411:x1874622863705856:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 3333us (3569us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780000.373240:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 72 00000100:00100000:0.0:1787780000.375878:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787780000.376145:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863705984 00000100:00100000:2.0:1787780000.376154:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863705984 00002000:00100000:2.0:1787780000.376200:0:8433:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff9c048134b480 x1874622863705984/t0(0) o4->781d29bb-23d2-48e3-b16d-c29e52cd5375@192.168.203.31@tcp:411/0 lens 504/0 e 0 to 0 dl 1787780011 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787780000.376211:0:8433:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c048134b480 with x1874622863705984 ext(0->12) 00002000:00010000:2.0:1787780000.376215:0:8433:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c048134b480 00000100:00100000:2.0:1787780000.376246:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 2 00000100:00100000:2.0:1787780000.376255:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c048134b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+10:2411:x1874622863705984:12345-192.168.203.31@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1787780000.377185:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c048134b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+12:2411:x1874622863705984:12345-192.168.203.31@tcp:4:lhsmtool_posix.0 Request processed in 927us (1349us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1787780000.377195:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 2 00002000:00100000:2.0:1787780000.377202:0:8433:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff9c048134b480 x1874622863705984/t4294967309(0) o4->781d29bb-23d2-48e3-b16d-c29e52cd5375@192.168.203.31@tcp:411/0 lens 504/448 e 0 to 0 dl 1787780011 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787780000.377224:0:8433:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c048134b480 with x1874622863705984 ext(0->12) 00002000:00010000:2.0:1787780000.377228:0:8433:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c048134b480 00000100:00100000:1.0:1787780000.379227:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787780000.379306:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863706112 00000100:00100000:2.0:1787780000.379314:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863706112 00000100:00100000:2.0:1787780000.379363:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 136 00000100:00100000:2.0:1787780000.379372:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c047796cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+68:11439:x1874622863706112:12345-192.168.203.31@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1787780000.381436:0:6491:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967402 is committed 00000004:00080000:0.0:1787780000.381450:0:6491:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000004:00080000:0.0:1787780000.381483:0:6491:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:0.0:1787780000.381500:0:6491:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9c0347ec6480 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:0.0:1787780000.381505:0:6491:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c0348806c00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9c0347ec6c00 00000020:00080000:0.0:1787780000.381509:0:6491:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c0348806b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9c0347d6c200 00000004:00080000:0.0:1787780000.381531:0:6491:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:0.0:1787780000.381553:0:6491:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9c0346d5b240 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:0.0:1787780000.381556:0:6491:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c0347bd4a00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9c045ab72b40 00000020:00080000:0.0:1787780000.381559:0:6491:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c0347bd4900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9c046097b000 00000100:00100000:3.0:1787780000.381709:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787780000.381728:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347febc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881612800:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787780000.381788:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780000.381829:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881612800 00000100:00100000:3.0:1787780000.381835:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881612800 00000100:00100000:3.0:1787780000.381899:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787780000.381907:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347fe9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3644:x1874622881612800:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1787780000.381940:0:8430:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3 count 1 00002000:00010000:3.0:1787780000.381970:0:8430:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a8f5b9f, atime: 0x6a8f5b9f, ctime: 0x6a8f5b9f, blocks: 0x8 00010000:00010000:3.0:1787780000.381978:0:8430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc29d83e/0xc8fc0a5179960fbc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780000.381992:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=408s v=(0 0) 00010000:00010000:3.0:1787780000.381997:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787780000.382003:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cc29d83e/0xc8fc0a5179960fbc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780000.382017:0:8430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cc29d83e/0xc8fc0a5179960fbc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780000.382027:0:8430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc29d83e/0xc8fc0a5179960fbc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780000.382034:0:8430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cc29d83e/0xc8fc0a5179960fbc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780000.382074:0:8430:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787780000.382196:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347fe9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3644:x1874622881612800:12345-0@lo:6:osp-syn-0-0.0 Request processed in 289us (407us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1787780000.382203:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:3.0:1787780000.382224:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787780000.382236:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787780000.382241:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cc29d83e/0xc8fc0a5179960fbc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780000.382249:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c04766dd400 already unused, calling callback (ffffffffc0d97420) 00010000:00010000:3.0:1787780000.382253:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc29d83e/0xc8fc0a5179960fbc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780000.382262:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc29d83e/0xc8fc0a5179960fbc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780000.382276:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cc29d83e/0xc8fc0a5179960fbc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780000.382284:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cc29d83e/0xc8fc0a5179960fbc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780000.382300:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787780000.382301:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787780000.382303:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1787780000.382327:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c0347febc00/2, rc 0, transno 4294967305 00000100:00100000:3.0:1787780000.382339:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347febc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881612800:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787780000.382714:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346cfed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881613056:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1787780000.382744:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780000.382776:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881613056 00000100:00100000:1.0:1787780000.382781:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881613056 00000100:00100000:1.0:1787780000.382814:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787780000.382821:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346cfde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3641:x1874622881613056:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1787780000.382924:0:8427:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1787780000.383029:0:8427:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1787780001 00002000:00010000:1.0:1787780000.383032:0:8427:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1787780000.383034:0:8427:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 1787780001 -> 1787780001 00002000:00010000:1.0:1787780000.383036:0:8427:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:1.0:1787780000.383118:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346cfde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3641:x1874622881613056:12345-0@lo:2:osp-syn-1-0.0 Request processed in 297us (373us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1787780000.383125:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:1.0:1787780000.383139:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1787780000.383156:0:3641:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c0346cfed00/2, rc 0, transno 4294967310 00000100:00100000:1.0:1787780000.383161:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346cfed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881613056:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1787780000.383212:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787780000.383221:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346cff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881612928:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1787780000.383249:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787780000.383327:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc600/0xc8fc0a5179960cba lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.383336:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc600/0xc8fc0a5179960cba lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.383342:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc600/0xc8fc0a5179960cba lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.383348:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c04766dc600 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:2.0:1787780000.383353:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc600/0xc8fc0a5179960cba lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.383359:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc600/0xc8fc0a5179960cba lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.383371:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9c0347bec800) 00010000:00010000:2.0:1787780000.383373:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787780000.383377:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc600/0xc8fc0a5179960cba lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.383383:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc600/0xc8fc0a5179960cba lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.383414:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18200/0xc8fc0a5179960d62 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.383420:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18200/0xc8fc0a5179960d62 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.383425:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18200/0xc8fc0a5179960d62 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.383430:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0444c18200 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:2.0:1787780000.383432:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18200/0xc8fc0a5179960d62 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.383437:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18200/0xc8fc0a5179960d62 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.383444:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c0347a4ea00) 00010000:00010000:2.0:1787780000.383447:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787780000.383450:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18200/0xc8fc0a5179960d62 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.383455:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18200/0xc8fc0a5179960d62 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.383468:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a400/0xc8fc0a5179960de0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.383474:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a400/0xc8fc0a5179960de0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.383479:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a400/0xc8fc0a5179960de0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.383489:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0347e4a400 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:2.0:1787780000.383492:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a400/0xc8fc0a5179960de0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.383498:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a400/0xc8fc0a5179960de0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.383506:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9c0341cd1000) 00010000:00010000:2.0:1787780000.383508:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787780000.383511:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a400/0xc8fc0a5179960de0 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.383517:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a400/0xc8fc0a5179960de0 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.383529:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a000/0xc8fc0a5179960e03 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.383535:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a000/0xc8fc0a5179960e03 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.383541:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a000/0xc8fc0a5179960e03 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.383546:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0347e4a000 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:2.0:1787780000.383548:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a000/0xc8fc0a5179960e03 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.383553:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a000/0xc8fc0a5179960e03 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.383568:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9c0341cd1000) 00010000:00010000:2.0:1787780000.383570:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787780000.383573:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a000/0xc8fc0a5179960e03 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.383579:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a000/0xc8fc0a5179960e03 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.383592:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a5179960ed5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.383598:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a5179960ed5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.383603:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a5179960ed5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.383608:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c04766dc400 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:2.0:1787780000.383611:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a5179960ed5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.383616:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a5179960ed5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.383623:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c04533a3600) 00010000:00010000:2.0:1787780000.383625:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787780000.383628:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a5179960ed5 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.383633:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a5179960ed5 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.383652:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4b200/0xc8fc0a5179960f92 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.383657:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4b200/0xc8fc0a5179960f92 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.383663:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4b200/0xc8fc0a5179960f92 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.383667:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0347e4b200 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:2.0:1787780000.383669:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4b200/0xc8fc0a5179960f92 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.383674:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4b200/0xc8fc0a5179960f92 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.383681:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9c0443d81200) 00010000:00010000:2.0:1787780000.383683:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787780000.383686:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4b200/0xc8fc0a5179960f92 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.383704:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4b200/0xc8fc0a5179960f92 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1787780000.383721:0:6544:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:2.0:1787780000.383757:0:6544:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:2.0:1787780000.383870:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c047796cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+16:11439:x1874622863706112:12345-192.168.203.31@tcp:44:lhsmtool_posix.0 Request processed in 4498us (4648us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780000.383878:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 136 00000100:00100000:1.0:1787780000.383947:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881612928 00000100:00100000:1.0:1787780000.383952:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881612928 00000100:00100000:1.0:1787780000.384099:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787780000.384108:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c048134bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3643:x1874622881612928:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1787780000.384122:0:8430:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3 count 1 00010000:00010000:1.0:1787780000.384141:0:8430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009a1c82d7/0xc8fc0a5179960fc3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780000.384155:0:8430:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000091228ed4/0xc8fc0a5179960d70 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1ecc expref: 11 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780000.384163:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1787780000.384166:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787780000.384170:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009a1c82d7/0xc8fc0a5179960fc3 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780000.384206:0:8430:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000091228ed4/0xc8fc0a5179960d70 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1ecc expref: 11 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780000.384220:0:8430:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000091228ed4/0xc8fc0a5179960d70 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1ecc expref: 11 pid: 8427 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787780000.384231:0:8430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346d5ed00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8430:1874622881613184:192.168.203.31@tcp:104: 00000100:00100000:1.0:1787780000.384267:0:8430:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c04717ae600 going to sleep for 11 seconds 00000100:00100000:1.0:1787780000.386905:0:8430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346d5ed00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8430:1874622881613184:192.168.203.31@tcp:104: 00010000:00010000:1.0:1787780000.386941:0:8430:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009a1c82d7/0xc8fc0a5179960fc3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787780000.387759:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787780000.388158:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863706240 00000100:00100000:2.0:1787780000.388178:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863706240 00000100:00100000:2.0:1787780000.388230:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 51 00000100:00100000:2.0:1787780000.388240:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346d5ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+12:2410:x1874622863706240:12345-192.168.203.31@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1787780000.389561:0:9508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:3.0:1787780000.389573:0:9508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000100:00100000:2.0:1787780000.389733:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346d5ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+7:2410:x1874622863706240:12345-192.168.203.31@tcp:16:lhsmtool_posix.0 Request processed in 1493us (1974us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780000.389742:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 51 00000100:00100000:0.0:1787780000.391252:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787780000.391369:0:7921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863706368 00000100:00100000:1.0:1787780000.391377:0:7921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863706368 00010000:00010000:1.0:1787780000.391424:0:7921:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000091228ed4/0xc8fc0a5179960d70 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1ecc expref: 7 pid: 8427 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787780000.391463:0:7921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 73 00000100:00100000:1.0:1787780000.391471:0:7921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046099e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+7:2410:x1874622863706368:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787780000.391485:0:7921:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787780000.391491:0:7921:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000091228ed4/0xc8fc0a5179960d70 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1ecc expref: 7 pid: 8427 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780000.391503:0:7921:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000091228ed4/0xc8fc0a5179960d70 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1ecc expref: 7 pid: 8427 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780000.391526:0:7921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000091228ed4/0xc8fc0a5179960d70 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1ecc expref: 7 pid: 8427 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780000.391543:0:7921:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787780000.391547:0:7921:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787780000.391552:0:7921:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009a1c82d7/0xc8fc0a5179960fc3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780000.391562:0:7921:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009a1c82d7/0xc8fc0a5179960fc3 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780000.391593:0:7921:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787780000.391639:0:7921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046099e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+6:2410:x1874622863706368:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 168us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780000.391656:0:7921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 73 00010000:00010000:3.0:1787780000.391752:0:8430:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009a1c82d7/0xc8fc0a5179960fc3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780000.391762:0:8430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009a1c82d7/0xc8fc0a5179960fc3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780000.391771:0:8430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009a1c82d7/0xc8fc0a5179960fc3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780000.391779:0:8430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009a1c82d7/0xc8fc0a5179960fc3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780000.391803:0:8430:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787780000.392005:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c048134bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3643:x1874622881612928:12345-0@lo:6:osp-syn-1-0.0 Request processed in 7897us (8754us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1787780000.392012:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787780000.392183:0:3643:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:0.0:1787780000.392189:0:3643:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967310 00000004:00080000:0.0:1787780000.392215:0:3643:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c0346cfed00, transno 4294967310 00000100:00100000:0.0:1787780000.392235:0:3643:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9c0346cff480 x1874622881612928/t4294967311(4294967311) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787780016 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1787780000.392246:0:3643:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c0346cff480/2, rc 0, transno 4294967311 00000100:00100000:0.0:1787780000.392251:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346cff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881612928:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1787780000.392565:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787780000.392572:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009a1c82d7/0xc8fc0a5179960fc3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780000.392581:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0347e4bc00 already unused, calling callback (ffffffffc0d97420) 00010000:00010000:1.0:1787780000.392586:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009a1c82d7/0xc8fc0a5179960fc3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780000.392596:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009a1c82d7/0xc8fc0a5179960fc3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780000.392609:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009a1c82d7/0xc8fc0a5179960fc3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780000.392617:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009a1c82d7/0xc8fc0a5179960fc3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780000.392634:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787780000.392636:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787780000.392637:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787780000.396759:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787780000.396829:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863706624 00000100:00100000:1.0:1787780000.396873:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863706624 00000100:00100000:1.0:1787780000.396939:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 137 00000100:00100000:1.0:1787780000.396948:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0481349e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+16:11439:x1874622863706624:12345-192.168.203.31@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787780000.397004:0:7821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787780000.397052:0:7821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4ba00/0xc8fc0a5179960fa7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1f66 expref: 16 pid: 7821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780000.397070:0:7821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9c0443d81200) 00010000:00010000:1.0:1787780000.397075:0:7821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787780000.397103:0:7821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4be00/0xc8fc0a5179960fca lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780000.397116:0:7821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4be00/0xc8fc0a5179960fca lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780000.397127:0:7821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4be00/0xc8fc0a5179960fca lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787780000.397230:0:7821:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000070239311 reply state 0000000044aa7c7f transno 4294967403 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4be00/0xc8fc0a5179960fca lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780000.397243:0:7821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4be00/0xc8fc0a5179960fca lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780000.397249:0:7821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9c0443d81200) 00010000:00010000:1.0:1787780000.397252:0:7821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787780000.397254:0:7821:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787780000.397336:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0481349e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+17:11439:x1874622863706624:12345-192.168.203.31@tcp:36:lhsmtool_posix.0 Request processed in 388us (585us total) trans 4294967403 rc 0/0 00000100:00100000:1.0:1787780000.397343:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 137 00000100:00100000:0.0:1787780000.399596:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787780000.399674:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863706752 00000100:00100000:2.0:1787780000.399683:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863706752 00000100:00100000:2.0:1787780000.399738:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 52 00000100:00100000:2.0:1787780000.399747:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0481348000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+6:2411:x1874622863706752:12345-192.168.203.31@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1787780000.399916:0:8428:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1787780000.399920:0:8428:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 1787780001 -> 1787779999 00002000:00010000:2.0:1787780000.399922:0:8428:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 1787779999 00002000:00010000:2.0:1787780000.399924:0:8428:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 1787780001 -> 1787779999 00002000:00010000:2.0:1787780000.399936:0:8428:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1787780000.399986:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0481348000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+7:2411:x1874622863706752:12345-192.168.203.31@tcp:2:lhsmtool_posix.0 Request processed in 240us (398us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1787780000.399994:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 52 00000100:00100000:0.0:1787780000.402229:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787780000.402376:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863707008 00000100:00100000:2.0:1787780000.402384:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863707008 00000100:00100000:2.0:1787780000.402435:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 138 00000100:00100000:2.0:1787780000.402444:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c048134ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+17:11439:x1874622863707008:12345-192.168.203.31@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1787780000.402506:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18200/0xc8fc0a5179960fd1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.402522:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766ddc00/0xc8fc0a5179960f8b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1f58 expref: 17 pid: 12488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.402547:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18200/0xc8fc0a5179960fd1 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.402578:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766ddc00/0xc8fc0a5179960f8b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1f58 expref: 17 pid: 12488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.402591:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766ddc00/0xc8fc0a5179960f8b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1f58 expref: 17 pid: 12488 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787780000.402606:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348803c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1874622881613312:192.168.203.31@tcp:104: 00000100:00100000:2.0:1787780000.402676:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c04537e0f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787780000.405903:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348803c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1874622881613312:192.168.203.31@tcp:104: 00010000:00010000:2.0:1787780000.405936:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18200/0xc8fc0a5179960fd1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787780000.407030:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787780000.407822:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863707136 00000100:00100000:3.0:1787780000.407830:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863707136 00010000:00010000:2.0:1787780000.408295:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766ddc00/0xc8fc0a5179960f8b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1f58 expref: 18 pid: 12488 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787780000.408367:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 74 00000100:00100000:2.0:1787780000.408377:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c048134a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+18:2411:x1874622863707136:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787780000.408391:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787780000.408398:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766ddc00/0xc8fc0a5179960f8b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1f58 expref: 18 pid: 12488 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.408410:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766ddc00/0xc8fc0a5179960f8b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1f58 expref: 18 pid: 12488 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.408444:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766ddc00/0xc8fc0a5179960f8b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1f58 expref: 18 pid: 12488 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.408460:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9c0443d81200) 00010000:00010000:2.0:1787780000.408466:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18200/0xc8fc0a5179960fd1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.408475:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18200/0xc8fc0a5179960fd1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.408483:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18200/0xc8fc0a5179960fd1 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.408515:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787780000.408572:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c048134a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+17:2411:x1874622863707136:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 195us (1545us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780000.408580:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 74 00010000:00010000:3.0:1787780000.408747:0:6513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18200/0xc8fc0a5179960fd1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780000.408755:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18200/0xc8fc0a5179960fd1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780000.408791:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18200/0xc8fc0a5179960fd1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780000.408805:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18200/0xc8fc0a5179960fd1 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780000.408812:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18200/0xc8fc0a5179960fd1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780000.408817:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0444c18200 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:3.0:1787780000.408822:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18200/0xc8fc0a5179960fd1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780000.408829:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18200/0xc8fc0a5179960fd1 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780000.408870:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9c0443d81200) 00010000:00010000:3.0:1787780000.408874:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1787780000.408878:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18200/0xc8fc0a5179960fd1 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780000.408884:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18200/0xc8fc0a5179960fd1 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787780000.408936:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c048134ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+16:11439:x1874622863707008:12345-192.168.203.31@tcp:55:lhsmtool_posix.0 Request processed in 6488us (6708us total) trans 0 rc -22/-22 00000100:00100000:3.0:1787780000.408944:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 138 00000100:00100000:3.0:1787780000.411809:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787780000.411917:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863707264 00000100:00100000:1.0:1787780000.411925:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863707264 00000100:00100000:1.0:1787780000.411987:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 53 00000100:00100000:1.0:1787780000.411995:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347fea580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+7:2411:x1874622863707264:12345-192.168.203.31@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787780000.412058:0:8427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c51ddabd/0xc8fc0a5179960fd8 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780000.412076:0:8427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f4c09eaf/0xc8fc0a5179960fb5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1f74 expref: 7 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780000.412084:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787780000.412089:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787780000.412094:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c51ddabd/0xc8fc0a5179960fd8 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780000.412124:0:8427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f4c09eaf/0xc8fc0a5179960fb5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1f74 expref: 7 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780000.412137:0:8427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f4c09eaf/0xc8fc0a5179960fb5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1f74 expref: 7 pid: 9899 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787780000.412150:0:8427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346d5e1c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8427:1874622881613440:192.168.203.31@tcp:104: 00000100:00100000:1.0:1787780000.412215:0:8427:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c04717ae6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787780000.415057:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787780000.415133:0:8427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346d5e1c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8427:1874622881613440:192.168.203.31@tcp:104: 00010000:00010000:2.0:1787780000.415157:0:8427:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c51ddabd/0xc8fc0a5179960fd8 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787780000.415319:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863707392 00000100:00100000:0.0:1787780000.415326:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863707392 00010000:00010000:0.0:1787780000.415359:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f4c09eaf/0xc8fc0a5179960fb5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1f74 expref: 8 pid: 9899 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787780000.415553:0:7921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 75 00000100:00100000:3.0:1787780000.415564:0:7921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346d5f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+8:2410:x1874622863707392:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787780000.415579:0:7921:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787780000.415614:0:7921:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f4c09eaf/0xc8fc0a5179960fb5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1f74 expref: 8 pid: 9899 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780000.415628:0:7921:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f4c09eaf/0xc8fc0a5179960fb5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1f74 expref: 8 pid: 9899 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780000.415649:0:7921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f4c09eaf/0xc8fc0a5179960fb5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1f74 expref: 8 pid: 9899 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780000.415670:0:7921:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787780000.415674:0:7921:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787780000.415680:0:7921:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c51ddabd/0xc8fc0a5179960fd8 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780000.415701:0:7921:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c51ddabd/0xc8fc0a5179960fd8 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780000.415726:0:7921:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787780000.415744:0:8427:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c51ddabd/0xc8fc0a5179960fd8 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.415753:0:8427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c51ddabd/0xc8fc0a5179960fd8 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787780000.415774:0:7921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346d5f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+7:2410:x1874622863707392:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 213us (724us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780000.415781:0:7921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 75 00010000:00010000:2.0:1787780000.415782:0:8427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c51ddabd/0xc8fc0a5179960fd8 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.415789:0:8427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c51ddabd/0xc8fc0a5179960fd8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.415797:0:8427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c51ddabd/0xc8fc0a5179960fd8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.415804:0:8427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0347e4a000 already unused, calling callback (ffffffffc0d97420) 00010000:00010000:2.0:1787780000.415808:0:8427:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c51ddabd/0xc8fc0a5179960fd8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.415817:0:8427:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c51ddabd/0xc8fc0a5179960fd8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.415828:0:8427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c51ddabd/0xc8fc0a5179960fd8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.415833:0:8427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c51ddabd/0xc8fc0a5179960fd8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787780000.416081:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347fea580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+6:2411:x1874622863707264:12345-192.168.203.31@tcp:1:lhsmtool_posix.0 Request processed in 4086us (4278us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780000.416089:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 53 00000100:00100000:1.0:1787780000.418296:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787780000.418351:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863707648 00000100:00100000:2.0:1787780000.418358:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863707648 00000100:00100000:2.0:1787780000.418416:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 139 00000100:00100000:2.0:1787780000.418423:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346d5d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+16:11439:x1874622863707648:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787780000.418482:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18600/0xc8fc0a5179960fdf lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.418494:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868e00/0xc8fc0a5179960ece lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1f20 expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.418500:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18600/0xc8fc0a5179960fdf lrc: 4/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.418524:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868e00/0xc8fc0a5179960ece lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1f20 expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.418533:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868e00/0xc8fc0a5179960ece lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1f20 expref: 16 pid: 6513 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787780000.418542:0:6512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348803c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1874622881613568:192.168.203.31@tcp:104: 00000100:00100000:2.0:1787780000.418603:0:6512:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c04537e0f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787780000.420105:0:6512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348803c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1874622881613568:192.168.203.31@tcp:104: 00010000:00010000:2.0:1787780000.420128:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18600/0xc8fc0a5179960fdf lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787780000.420415:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787780000.420674:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863707776 00000100:00100000:2.0:1787780000.420679:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863707776 00010000:00010000:2.0:1787780000.420720:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868e00/0xc8fc0a5179960ece lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1f20 expref: 17 pid: 6513 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787780000.420816:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 76 00000100:00100000:2.0:1787780000.420826:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346d5cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+17:2410:x1874622863707776:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787780000.420909:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787780000.420916:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868e00/0xc8fc0a5179960ece lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1f20 expref: 17 pid: 6513 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.420927:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868e00/0xc8fc0a5179960ece lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1f20 expref: 17 pid: 6513 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.420948:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868e00/0xc8fc0a5179960ece lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1f20 expref: 17 pid: 6513 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.420962:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c04533a3600) 00010000:00010000:2.0:1787780000.420968:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19200/0xc8fc0a5179960f30 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1f43 expref: 16 pid: 7821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.420978:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18600/0xc8fc0a5179960fdf lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.420986:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18600/0xc8fc0a5179960fdf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.420994:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18600/0xc8fc0a5179960fdf lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780000.421054:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18600/0xc8fc0a5179960fdf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.421054:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787780000.421061:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18600/0xc8fc0a5179960fdf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787780000.421101:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346d5cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+16:2410:x1874622863707776:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 276us (686us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780000.421113:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 76 00010000:00010000:3.0:1787780000.421222:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd400/0xc8fc0a5179960fe6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780000.421240:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd600/0xc8fc0a5179960f99 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1f5f expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780000.421247:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd400/0xc8fc0a5179960fe6 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780000.421275:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd600/0xc8fc0a5179960f99 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1f5f expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780000.421286:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd600/0xc8fc0a5179960f99 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1f5f expref: 16 pid: 6514 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787780000.421299:0:6512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347feb480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1874622881613696:192.168.203.31@tcp:104: 00000100:00100000:3.0:1787780000.421400:0:6512:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c04535b00c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787780000.423158:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787780000.423194:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863707904 00000100:00100000:2.0:1787780000.423200:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863707904 00010000:00010000:2.0:1787780000.423230:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd600/0xc8fc0a5179960f99 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1f5f expref: 17 pid: 6514 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787780000.423267:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 77 00000100:00100000:2.0:1787780000.423277:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346d5e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+17:2410:x1874622863707904:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787780000.423291:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787780000.423298:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd600/0xc8fc0a5179960f99 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1f5f expref: 17 pid: 6514 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.423310:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd600/0xc8fc0a5179960f99 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1f5f expref: 17 pid: 6514 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.423327:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9c0443d81200) 00010000:00010000:2.0:1787780000.423333:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd400/0xc8fc0a5179960fe6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.423341:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd400/0xc8fc0a5179960fe6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.423348:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd400/0xc8fc0a5179960fe6 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.423363:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787780000.423407:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346d5e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+17:2410:x1874622863707904:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 132us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780000.423428:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 77 00010000:00010000:3.0:1787780000.423519:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd600/0xc8fc0a5179960f99 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1f5f expref: 16 pid: 6514 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787780000.423534:0:6512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347feb480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1874622881613696:192.168.203.31@tcp:104: 00010000:00010000:3.0:1787780000.423551:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd400/0xc8fc0a5179960fe6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780000.423560:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd400/0xc8fc0a5179960fe6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780000.423565:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd400/0xc8fc0a5179960fe6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787780000.423644:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000001:00080000:3.0:1787780000.423785:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000001:00080000:3.0:1787780000.423826:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000100:00100000:3.0:1787780000.424075:0:6512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347feb480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6512:1874622881613824:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1787780000.424117:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780000.424135:0:6512:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c04497436c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787780000.424189:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881613824 00000100:00100000:0.0:1787780000.424195:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881613824 00000100:00100000:0.0:1787780000.424228:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1787780000.424235:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347feb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6512:x1874622881613824:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1787780000.424317:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347feb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6512:x1874622881613824:12345-0@lo:1000:mdt00_000.0 Request processed in 83us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780000.424324:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1787780000.424382:0:6512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347feb480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6512:1874622881613824:0@lo:1000:mdt00_000.0 00000001:00080000:2.0:1787780000.424478:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00000100:00100000:2.0:1787780000.424571:0:6512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348803c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6512:1874622881613952:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1787780000.424592:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787780000.424611:0:6512:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c04537e0e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787780000.424657:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881613952 00000100:00100000:0.0:1787780000.424662:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881613952 00000100:00100000:0.0:1787780000.424704:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1787780000.424711:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0348801a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6512:x1874622881613952:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1787780000.424803:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0348801a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6512:x1874622881613952:12345-0@lo:1000:mdt00_000.0 Request processed in 92us (207us total) trans 4294967313 rc 0/0 00000100:00100000:0.0:1787780000.424809:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1787780000.424995:0:6512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348803c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6512:1874622881613952:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1787780000.425022:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd400/0xc8fc0a5179960fe6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.425031:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd400/0xc8fc0a5179960fe6 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.425038:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd400/0xc8fc0a5179960fe6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.425043:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c04766dd400 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:2.0:1787780000.425047:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd400/0xc8fc0a5179960fe6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.425054:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd400/0xc8fc0a5179960fe6 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.425066:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9c0443d81200) 00010000:00010000:2.0:1787780000.425069:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787780000.425073:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd400/0xc8fc0a5179960fe6 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.425079:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd400/0xc8fc0a5179960fe6 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.425110:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc000/0xc8fc0a5179960f29 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.425117:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc000/0xc8fc0a5179960f29 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.425123:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc000/0xc8fc0a5179960f29 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.425129:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c04766dc000 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:2.0:1787780000.425132:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc000/0xc8fc0a5179960f29 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.425138:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc000/0xc8fc0a5179960f29 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.425147:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c04533a3600) 00010000:00010000:2.0:1787780000.425150:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787780000.425155:0:6512:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19200/0xc8fc0a5179960f30 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1f43 expref: 19 pid: 7821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.425164:0:6512:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19200/0xc8fc0a5179960f30 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1f43 expref: 19 pid: 7821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.425172:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19200/0xc8fc0a5179960f30 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1f43 expref: 19 pid: 7821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.425197:0:6512:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19200/0xc8fc0a5179960f30 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1f43 expref: 19 pid: 7821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787780000.425219:0:6512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04812aad00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1874622881614080:192.168.203.31@tcp:105: 00000100:00100000:2.0:1787780000.425264:0:6512:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c04537e0e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787780000.427522:0:6512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04812aad00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1874622881614080:192.168.203.31@tcp:105: 00010000:00010000:2.0:1787780000.427546:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc000/0xc8fc0a5179960f29 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.427555:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc000/0xc8fc0a5179960f29 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.427584:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19c00/0xc8fc0a5179960fed lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.427595:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19c00/0xc8fc0a5179960fed lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.427606:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19c00/0xc8fc0a5179960fed lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.427615:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19c00/0xc8fc0a5179960fed lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.427621:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19c00/0xc8fc0a5179960fed lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.427628:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19c00/0xc8fc0a5179960fed lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.427634:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0444c19c00 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:2.0:1787780000.427637:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19c00/0xc8fc0a5179960fed lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.427656:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19c00/0xc8fc0a5179960fed lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.427665:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c04533a3600) 00010000:00010000:2.0:1787780000.427669:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787780000.427673:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19c00/0xc8fc0a5179960fed lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.427678:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19c00/0xc8fc0a5179960fed lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.427806:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18600/0xc8fc0a5179960fdf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.427815:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18600/0xc8fc0a5179960fdf lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.427821:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18600/0xc8fc0a5179960fdf lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.427826:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0444c18600 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:2.0:1787780000.427829:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18600/0xc8fc0a5179960fdf lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.427836:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18600/0xc8fc0a5179960fdf lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.427969:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c04533a3600) 00010000:00010000:2.0:1787780000.427971:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787780000.427975:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18600/0xc8fc0a5179960fdf lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.427991:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18600/0xc8fc0a5179960fdf lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787780000.428214:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787780000.428267:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346d5d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+19:11439:x1874622863707648:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 Request processed in 9842us (9977us total) trans 4294967408 rc 0/0 00000100:00100000:2.0:1787780000.428277:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 139 00000020:00080000:2.0:1787780000.428282:0:6512:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1787780000.428335:0:13794:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787780000.428340:0:13794:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:3.0:1787780000.428736:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863708032 00000100:00100000:3.0:1787780000.428742:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863708032 00000100:00100000:3.0:1787780000.428783:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 31 00000040:00080000:1.0:1787780000.428789:0:13794:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000100:00100000:3.0:1787780000.428791:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c048134b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+19:11437:x1874622863708032:12345-192.168.203.31@tcp:49:lfs.0 00000040:00080000:1.0:1787780000.428802:0:13794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787780000.429051:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c048134b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+19:11437:x1874622863708032:12345-192.168.203.31@tcp:49:lfs.0 Request processed in 249us (826us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780000.429058:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 31 00000100:00100000:1.0:1787780000.430455:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787780000.430527:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863708288 00000100:00100000:2.0:1787780000.430533:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863708288 00000100:00100000:2.0:1787780000.430575:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 32 00000100:00100000:2.0:1787780000.430584:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0443618450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+19:11439:x1874622863708288:12345-192.168.203.31@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1787780000.430807:0:6515:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787780000.430920:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967409 00010000:00010000:2.0:1787780000.431005:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18400/0xc8fc0a5179960ff4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.431020:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18400/0xc8fc0a5179960ff4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.431030:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18400/0xc8fc0a5179960ff4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.431037:0:6515:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18400/0xc8fc0a5179960ff4 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.431043:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18400/0xc8fc0a5179960ff4 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.431050:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18400/0xc8fc0a5179960ff4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780000.431076:0:6515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787780000.431152:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0443618450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+21:11439:x1874622863708288:12345-192.168.203.31@tcp:35:lhsmtool_posix.0 Request processed in 568us (697us total) trans 4294967410 rc 0/0 00000100:00100000:2.0:1787780000.431160:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 32 00000020:00080000:2.0:1787780000.431164:0:6515:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787780000.432179:0:7453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787780000.432188:0:7453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18400/0xc8fc0a5179960ff4 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780000.432206:0:7453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0444c18400 already unused, calling callback (ffffffffc0d97420) 00010000:00010000:0.0:1787780000.432210:0:7453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18400/0xc8fc0a5179960ff4 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780000.432217:0:7453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18400/0xc8fc0a5179960ff4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780000.432229:0:7453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9c0443d81200) 00010000:00010000:0.0:1787780000.432231:0:7453:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787780000.432235:0:7453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18400/0xc8fc0a5179960ff4 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780000.432241:0:7453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18400/0xc8fc0a5179960ff4 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780000.432254:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787780000.432256:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787780000.432257:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787780000.435174:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787780000.435241:0:12488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863708544 00000100:00100000:2.0:1787780000.435251:0:12488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863708544 00000100:00100000:2.0:1787780000.435305:0:12488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 140 00000100:00100000:2.0:1787780000.435315:0:12488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04813492c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:781d29bb-23d2-48e3-b16d-c29e52cd5375+21:11437:x1874622863708544:12345-192.168.203.31@tcp:58:lfs.0 00000040:00080000:2.0:1787780000.435468:0:12488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:2.0:1787780000.435537:0:12488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04813492c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:781d29bb-23d2-48e3-b16d-c29e52cd5375+21:11437:x1874622863708544:12345-192.168.203.31@tcp:58:lfs.0 Request processed in 223us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780000.435544:0:12488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 140 00000100:00100000:1.0:1787780000.451898:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787780000.452156:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863708672 00000100:00100000:3.0:1787780000.452165:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863708672 00000100:00100000:3.0:1787780000.452315:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 141 00000100:00100000:3.0:1787780000.452327:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346d5f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+21:11441:x1874622863708672:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:3.0:1787780000.452347:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787780000.452368:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd600/0xc8fc0a5179960ffb lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea1f7b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780000.452426:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd200/0xc8fc0a5179961002 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780000.452441:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd200/0xc8fc0a5179961002 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780000.452452:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd200/0xc8fc0a5179961002 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780000.452484:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc000/0xc8fc0a5179961009 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780000.452491:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc000/0xc8fc0a5179961009 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780000.452497:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc000/0xc8fc0a5179961009 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780000.452570:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd400/0xc8fc0a5179961010 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780000.452581:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19400/0xc8fc0a5179960f1b lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1f3c expref: 22 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780000.452587:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd400/0xc8fc0a5179961010 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780000.452621:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19400/0xc8fc0a5179960f1b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1f3c expref: 22 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780000.452635:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19400/0xc8fc0a5179960f1b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1f3c expref: 22 pid: 6513 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787780000.452648:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347feb480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1874622881614208:192.168.203.31@tcp:104: 00000100:00100000:3.0:1787780000.452744:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c04497430c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787780000.456907:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347feb480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1874622881614208:192.168.203.31@tcp:104: 00010000:00010000:3.0:1787780000.456937:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd400/0xc8fc0a5179961010 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787780000.457642:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787780000.457700:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863708928 00000100:00100000:2.0:1787780000.457708:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863708928 00000100:00100000:2.0:1787780000.457762:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 33 00000100:00100000:2.0:1787780000.457773:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346d5d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+23:6177:x1874622863708928:12345-192.168.203.31@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787780000.458015:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346d5d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+24:6177:x1874622863708928:12345-192.168.203.31@tcp:35:ldlm_bl.0 Request processed in 244us (374us total) trans 4294967411 rc 0/0 00000100:00100000:2.0:1787780000.458023:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 33 00000100:00100000:1.0:1787780000.461828:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787780000.461997:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863709056 00000100:00100000:0.0:1787780000.462007:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863709056 00010000:00010000:0.0:1787780000.462199:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19400/0xc8fc0a5179960f1b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1f3c expref: 24 pid: 6513 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787780000.462280:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 78 00000100:00100000:0.0:1787780000.462291:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346d5c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+24:2408:x1874622863709056:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787780000.462306:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787780000.462313:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19400/0xc8fc0a5179960f1b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1f3c expref: 24 pid: 6513 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780000.462343:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19400/0xc8fc0a5179960f1b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1f3c expref: 24 pid: 6513 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780000.462366:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19400/0xc8fc0a5179960f1b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1f3c expref: 24 pid: 6513 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780000.462382:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c04533a3600) 00010000:00010000:0.0:1787780000.462387:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd400/0xc8fc0a5179961010 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780000.462395:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd400/0xc8fc0a5179961010 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780000.462402:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd400/0xc8fc0a5179961010 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780000.462433:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787780000.462479:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346d5c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+23:2408:x1874622863709056:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 190us (661us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780000.462491:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 78 00010000:00010000:3.0:1787780000.462627:0:6513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd400/0xc8fc0a5179961010 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780000.462634:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd400/0xc8fc0a5179961010 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787780000.462683:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:3.0:1787780000.462686:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787780000.462712:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd400/0xc8fc0a5179961010 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780000.462724:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd400/0xc8fc0a5179961010 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780000.462734:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd200/0xc8fc0a5179961002 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780000.462741:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd200/0xc8fc0a5179961002 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780000.462748:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd200/0xc8fc0a5179961002 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780000.462754:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c04766dd200 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:3.0:1787780000.462758:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd200/0xc8fc0a5179961002 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780000.462770:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd200/0xc8fc0a5179961002 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780000.462779:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c0443d81900) 00010000:00010000:3.0:1787780000.462791:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787780000.462796:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd200/0xc8fc0a5179961002 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780000.462803:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd200/0xc8fc0a5179961002 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780000.462815:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc000/0xc8fc0a5179961009 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780000.462821:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc000/0xc8fc0a5179961009 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780000.462827:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc000/0xc8fc0a5179961009 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780000.462833:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c04766dc000 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:3.0:1787780000.462872:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc000/0xc8fc0a5179961009 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780000.462880:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc000/0xc8fc0a5179961009 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780000.462889:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9c0443d81c00) 00010000:00010000:3.0:1787780000.462892:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787780000.462896:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc000/0xc8fc0a5179961009 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780000.462902:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc000/0xc8fc0a5179961009 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780000.462942:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd600/0xc8fc0a5179960ffb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1f7b expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780000.462961:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd400/0xc8fc0a5179961010 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1f7b expref: 22 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780000.462966:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c04533a3600) 00010000:00010000:3.0:1787780000.462968:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787780000.462969:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c04766dd400, rc 0) 00000100:00100000:3.0:1787780000.462999:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346d5f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+22:11441:x1874622863708672:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 10675us (11161us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780000.463006:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 141 00010000:00010000:3.0:1787780000.928789:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787780001.053593:0:14307:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787780001.053603:0:14307:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787780001.053636:0:14307:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1787780001.053644:0:14307:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787780001.055146:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348a0a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881614592:0@lo:400:kworker.0 00000100:00100000:2.0:1787780001.055210:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787780001.055261:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348a09e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1874622881615104:0@lo:400:kworker.0 00000100:00100000:3.0:1787780001.055270:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348a09a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874622881614720:0@lo:400:kworker.0 00000100:00100000:2.0:1787780001.055288:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780001.055297:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348a08780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1874622881614464:0@lo:400:kworker.0 00000100:00100000:2.0:1787780001.055319:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348a0b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1874622881615616:0@lo:400:kworker.0 00000100:00100000:2.0:1787780001.055347:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881615104 00000100:00100000:2.0:1787780001.055353:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881615104 00000100:00100000:2.0:1787780001.055403:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:2.0:1787780001.055412:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0348835680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874622881615104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787780001.055420:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780001.055444:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348a0bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1874622881614976:0@lo:400:kworker.0 00000100:00100000:2.0:1787780001.055454:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0348835680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874622881615104:12345-0@lo:400:kworker.0 Request processed in 44us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780001.055461:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:3.0:1787780001.055466:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787780001.055477:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881614464 00000100:00100000:2.0:1787780001.055480:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881614464 00000100:00100000:3.0:1787780001.055493:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348a0a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1874622881615488:0@lo:400:kworker.0 00000100:00100000:2.0:1787780001.055497:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881614976 00000100:00100000:2.0:1787780001.055499:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881614976 00000100:00100000:3.0:1787780001.055513:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787780001.055513:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:2.0:1787780001.055518:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0348a0b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1874622881614464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787780001.055524:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348a0a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881616000:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787780001.055542:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787780001.055544:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0348a0b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1874622881614464:12345-0@lo:400:kworker.0 Request processed in 26us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780001.055549:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:2.0:1787780001.055558:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881615488 00000100:00100000:2.0:1787780001.055561:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881615488 00000100:00100000:2.0:1787780001.055574:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:3.0:1787780001.055575:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348a08780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1874622881614464:0@lo:400:kworker.0 00000100:00100000:2.0:1787780001.055579:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0348a09680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1874622881614976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787780001.055602:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:3.0:1787780001.055610:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0348a083c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1874622881615488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787780001.055610:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0348a09680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1874622881614976:12345-0@lo:400:kworker.0 Request processed in 31us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780001.055615:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:3.0:1787780001.055636:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0348a083c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1874622881615488:12345-0@lo:400:kworker.0 Request processed in 28us (122us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780001.055648:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:3.0:1787780001.055673:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881616000 00000100:00100000:3.0:1787780001.055676:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881616000 00000100:00100000:0.0:1787780001.056057:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881614592 00000100:00100000:0.0:1787780001.056062:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881614592 00000100:00100000:0.0:1787780001.056088:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1787780001.056095:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04812aad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881614592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787780001.056236:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346cfed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1f575176-36bc-4786-83ee-2fea064a12a9:3642:1874622881614336:0@lo:400:kworker.0 00000100:00100000:3.0:1787780001.057149:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1787780001.057158:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0348a08f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881616000:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787780001.057175:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923529728 avail 3691978752 00000100:00100000:1.0:1787780001.058092:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780001.058137:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348a0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881614848:0@lo:400:kworker.0 00000100:00100000:1.0:1787780001.058297:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780001.058326:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348a0ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881615360:0@lo:400:kworker.0 00000100:00100000:1.0:1787780001.058350:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780001.058370:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348a08b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881615872:0@lo:400:kworker.0 00000100:00100000:1.0:1787780001.058393:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787780001.058427:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787780001.058433:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787780001.058436:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787780001.058447:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881614336 00000100:00100000:1.0:1787780001.058453:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881614336 00000100:00100000:1.0:1787780001.058488:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 390 00000100:00100000:1.0:1787780001.058495:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471775050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+24:3642:x1874622881614336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787780001.058535:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471775050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+24:3642:x1874622881614336:12345-0@lo:400:kworker.0 Request processed in 40us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780001.058542:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 390 00000100:00100000:1.0:1787780001.058570:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881615360 00000100:00100000:1.0:1787780001.058574:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881615360 00000100:00100000:1.0:1787780001.058599:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881615872 00000100:00100000:1.0:1787780001.058602:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881615872 00000100:00100000:1.0:1787780001.058636:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1787780001.058642:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346d5c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3642:x1874622881615360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787780001.058674:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346d5c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3642:x1874622881615360:12345-0@lo:400:kworker.0 Request processed in 32us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780001.058680:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1787780001.058702:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1787780001.058707:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346d5e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3642:x1874622881615872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787780001.058734:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346d5e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3642:x1874622881615872:12345-0@lo:400:kworker.0 Request processed in 27us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780001.058740:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1787780001.058776:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346cfed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1f575176-36bc-4786-83ee-2fea064a12a9:3642:1874622881614336:0@lo:400:kworker.0 00000100:00100000:1.0:1787780001.058790:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348a0ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881615360:0@lo:400:kworker.0 00000100:00100000:1.0:1787780001.058799:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348a08b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881615872:0@lo:400:kworker.0 00000100:00100000:2.0:1787780001.058891:0:6517:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:2.0:1787780001.058908:0:6517:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:2.0:1787780001.059310:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881614848 00000100:00100000:2.0:1787780001.059314:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881614848 00000100:00100000:1.0:1787780001.059450:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1787780001.059458:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346d5cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1874622881614848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787780001.059506:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346d5cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1874622881614848:12345-0@lo:400:kworker.0 Request processed in 49us (1208us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780001.059512:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1787780001.059569:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348a0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881614848:0@lo:400:kworker.0 00000100:00100000:0.0:1787780001.060277:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04812aad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881614592:12345-0@lo:400:kworker.0 Request processed in 4179us (5064us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780001.060286:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1787780001.061823:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348a0bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1874622881614976:0@lo:400:kworker.0 00000100:00100000:1.0:1787780001.061855:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348a0a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1874622881615488:0@lo:400:kworker.0 00000100:00100000:3.0:1787780001.063927:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0348a08f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881616000:12345-0@lo:13:osp-pre-1-1.0 Request processed in 6763us (8377us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780001.063954:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1787780001.064196:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348a0a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881616000:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787780001.064480:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787780001.064517:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348a08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881615232:0@lo:400:kworker.0 00000100:00100000:2.0:1787780001.064557:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787780001.064585:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348a092c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881615744:0@lo:400:kworker.0 00000100:00100000:2.0:1787780001.064608:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787780001.064642:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881614720 00000100:00100000:2.0:1787780001.064648:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881614720 00000100:00100000:0.0:1787780001.064708:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881615232 00000100:00100000:0.0:1787780001.064711:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881615232 00000100:00100000:0.0:1787780001.064744:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881615744 00000100:00100000:0.0:1787780001.064747:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881615744 00000100:00100000:0.0:1787780001.064771:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1787780001.064780:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04618e83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881615232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787780001.064826:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04618e83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881615232:12345-0@lo:400:kworker.0 Request processed in 47us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780001.064832:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1787780001.064878:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1787780001.064886:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04764403c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881615744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787780001.064924:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04764403c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881615744:12345-0@lo:400:kworker.0 Request processed in 39us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780001.065211:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00080000:0.0:1787780001.065229:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787780001.065260:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348a08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881615232:0@lo:400:kworker.0 00000100:00100000:0.0:1787780001.065270:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348a092c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881615744:0@lo:400:kworker.0 00000100:00100000:2.0:1787780001.065338:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:2.0:1787780001.065348:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03488be580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874622881614720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787780001.065656:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03488be580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874622881614720:12345-0@lo:400:kworker.0 Request processed in 310us (1176us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780001.065663:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:2.0:1787780001.065706:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787780001.065740:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348a0a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881614592:0@lo:400:kworker.0 00010000:00080000:2.0:1787780001.065753:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0348a09e00 x1874622881615104/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787780017 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787780001.065763:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348a09e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1874622881615104:0@lo:400:kworker.0 00000100:00100000:0.0:1787780001.068437:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348a09a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874622881614720:0@lo:400:kworker.0 00000100:00100000:3.0:1787780001.071508:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881615616 00000100:00100000:3.0:1787780001.071521:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881615616 00000100:00100000:3.0:1787780001.071605:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:3.0:1787780001.071615:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0476441e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1874622881615616:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1787780001.071630:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787780001.071718:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0476441e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1874622881615616:12345-0@lo:400:kworker.0 Request processed in 105us (6011us total) trans 0 rc 0/0 00010000:00080000:0.0:1787780001.071771:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0348a0b0c0 x1874622881615616/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787780017 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787780001.071800:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348a0b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1874622881615616:0@lo:400:kworker.0 00000100:00100000:3.0:1787780001.073640:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000040:00080000:1.0:1787780001.436883:0:13794:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787780001.436892:0:13794:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787780001.437064:0:13794:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1787780001.437081:0:13794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787780001.437259:0:13794:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346d5da40 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13794:1874622881616128:192.168.203.31@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787780001.437742:0:13794:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c04717aecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787780001.447025:0:13794:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346d5da40 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13794:1874622881616128:192.168.203.31@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787780001.466248:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787780001.466311:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863709184 00000100:00100000:0.0:1787780001.466324:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863709184 00000100:00100000:0.0:1787780001.466396:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 142 00000100:00100000:0.0:1787780001.466408:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0348a08780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+22:11453:x1874622863709184:12345-192.168.203.31@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787780001.466451:0:6513:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787780001.466595:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0348a08780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+22:11453:x1874622863709184:12345-192.168.203.31@tcp:53:lhsmtool_posix.0 Request processed in 188us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780001.466603:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 142 00000100:00100000:1.0:1787780001.474764:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787780001.475052:0:12488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863709440 00000100:00100000:2.0:1787780001.475070:0:12488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863709440 00000100:00100000:2.0:1787780001.475148:0:12488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 143 00000100:00100000:2.0:1787780001.475165:0:12488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346d5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:781d29bb-23d2-48e3-b16d-c29e52cd5375+22:11453:x1874622863709440:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787780001.475194:0:12488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787780001.475227:0:12488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18000/0xc8fc0a5179961017 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea1f82 expref: -99 pid: 12488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780001.475403:0:12488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19600/0xc8fc0a517996101e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780001.475424:0:12488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19600/0xc8fc0a517996101e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780001.475445:0:12488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19600/0xc8fc0a517996101e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787780001.475463:0:12488:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:2.0:1787780001.475604:0:12488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18000/0xc8fc0a5179961017 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1f82 expref: 25 pid: 12488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780001.475633:0:12488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19600/0xc8fc0a517996101e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1f82 expref: 24 pid: 12488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780001.475649:0:12488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c04533a3600) 00010000:00010000:2.0:1787780001.475653:0:12488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787780001.475657:0:12488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0444c19600, rc 0) 00000100:00100000:2.0:1787780001.475759:0:12488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346d5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:781d29bb-23d2-48e3-b16d-c29e52cd5375+24:11453:x1874622863709440:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 601us (1010us total) trans 4294967412 rc 0/0 00000100:00100000:2.0:1787780001.475769:0:12488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 143 00000100:00100000:1.0:1787780001.482741:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787780001.483630:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863709568 00000100:00100000:2.0:1787780001.483645:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863709568 00000100:00100000:2.0:1787780001.483738:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 10 00000100:00100000:2.0:1787780001.483748:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346d5fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+24:2410:x1874622863709568:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787780001.483770:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787780001.483821:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19600/0xc8fc0a517996101e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1f82 expref: 24 pid: 12488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780001.483886:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c04533a3600) 00010000:00010000:2.0:1787780001.483892:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787780001.483969:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346d5fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+23:2410:x1874622863709568:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 216us (1230us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780001.483978:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 10 00000100:00100000:1.0:1787780001.487091:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787780001.487184:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863709824 00000100:00100000:3.0:1787780001.487194:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863709824 00000100:00100000:3.0:1787780001.487247:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 144 00000100:00100000:3.0:1787780001.487256:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346d5de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+23:11453:x1874622863709824:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787780001.487327:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc000/0xc8fc0a517996102c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780001.487342:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc000/0xc8fc0a517996102c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780001.487369:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc000/0xc8fc0a517996102c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780001.487508:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc000/0xc8fc0a517996102c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780001.487515:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc000/0xc8fc0a517996102c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780001.487523:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc000/0xc8fc0a517996102c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780001.487530:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c04766dc000 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:3.0:1787780001.487534:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc000/0xc8fc0a517996102c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780001.487542:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc000/0xc8fc0a517996102c lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780001.487552:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c04533a3600) 00010000:00010000:3.0:1787780001.487555:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787780001.487560:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc000/0xc8fc0a517996102c lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780001.487566:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc000/0xc8fc0a517996102c lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787780001.487693:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346d5de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+24:11453:x1874622863709824:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 Request processed in 429us (601us total) trans 4294967413 rc 0/0 00000100:00100000:3.0:1787780001.487702:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 144 00000040:00080000:1.0:1787780001.487890:0:13794:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787780001.487894:0:13794:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787780001.488436:0:13794:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1787780001.488444:0:13794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787780001.489440:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787780001.489508:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863710080 00000100:00100000:3.0:1787780001.489524:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863710080 00000100:00100000:3.0:1787780001.489580:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 34 00000100:00100000:3.0:1787780001.489588:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346d5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+24:11453:x1874622863710080:12345-192.168.203.31@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787780001.489782:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346d5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+25:11453:x1874622863710080:12345-192.168.203.31@tcp:35:lhsmtool_posix.0 Request processed in 188us (339us total) trans 4294967414 rc 0/0 00000100:00100000:3.0:1787780001.489789:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 34 00000100:00100000:2.0:1787780001.564128:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0481348b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881616256:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787780001.564201:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780001.564246:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787780001.564260:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348a0b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874622881616384:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787780001.564291:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787780001.564329:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881616256 00000100:00100000:0.0:1787780001.564338:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881616256 00000100:00100000:0.0:1787780001.564385:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881616384 00000100:00100000:0.0:1787780001.564389:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881616384 00000100:00100000:0.0:1787780001.564405:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1787780001.564413:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477aee940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3644:x1874622881616256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787780001.564434:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923529728 avail 3691978752 00000100:00100000:0.0:1787780001.564490:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477aee940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3644:x1874622881616256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780001.564497:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1787780001.564513:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1787780001.564520:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0348a09a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1874622881616384:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787780001.564536:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787780001.564568:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0481348b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881616256:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787780001.564568:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0348a09a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1874622881616384:12345-0@lo:13:osp-pre-0-1.0 Request processed in 50us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780001.564609:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1787780001.564639:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348a0b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874622881616384:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1787780001.948305:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787780002.076959:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787780002.076982:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346d5da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881616512:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787780002.077050:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780002.077198:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881616512 00000100:00100000:3.0:1787780002.077205:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881616512 00000100:00100000:3.0:1787780002.077267:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1787780002.077276:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477aef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3641:x1874622881616512:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787780002.077307:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787780002.077349:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477aef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3641:x1874622881616512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780002.077356:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1787780002.077494:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346d5da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881616512:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787780002.077583:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787780002.709807:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787780002.709926:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787780002.709958:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787780002.709969:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863710336 00000100:00100000:3.0:1787780002.709981:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863710336 00000100:00100000:2.0:1787780002.709986:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787780002.710007:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787780002.710042:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00080000:1.0:1787780002.710297:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787780002.710408:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787780002.710434:0:12488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863710848 00000100:00100000:2.0:1787780002.710438:0:12488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863710848 00000100:00100000:3.0:1787780002.710483:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863710464 00000100:00100000:3.0:1787780002.710487:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863710464 00000100:00100000:3.0:1787780002.710510:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863710976 00000100:00100000:3.0:1787780002.710513:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863710976 00000100:00100000:3.0:1787780002.710533:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 340 00000100:00080000:1.0:1787780002.710665:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787780002.711845:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863710592 00000100:00100000:0.0:1787780002.711860:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863710592 00000100:00100000:0.0:1787780002.711929:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863710720 00000100:00100000:0.0:1787780002.711932:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863710720 00000100:00100000:0.0:1787780002.711963:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 144 00000100:00100000:0.0:1787780002.711974:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477aec780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:2408:x1874622863710592:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1787780002.712050:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477aec780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:2408:x1874622863710592:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 78us (2123us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780002.712059:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 144 00000100:00100000:0.0:1787780002.712075:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 145 00000100:00100000:0.0:1787780002.712082:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03488e12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+6:2408:x1874622863710720:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1787780002.712104:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03488e12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+6:2408:x1874622863710720:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 22us (2063us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780002.712109:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 145 00000100:00080000:1.0:1787780002.712751:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787780002.712759:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787780002.713186:0:12488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 341 00000100:00100000:2.0:1787780002.713201:0:12488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477aefc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:2408:x1874622863710464:12345-192.168.203.31@tcp:400:kworker.0 00000100:00080000:1.0:1787780002.713514:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787780002.713733:0:12488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477aefc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:2408:x1874622863710464:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 110us (3297us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780002.713758:0:12488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 341 00000100:00100000:2.0:1787780002.713789:0:12488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 342 00000100:00100000:2.0:1787780002.713800:0:12488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03488e0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+5:2408:x1874622863710976:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1787780002.713880:0:12488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03488e0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+5:2408:x1874622863710976:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 83us (3471us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780002.713888:0:12488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 342 00000100:00100000:2.0:1787780002.713905:0:12488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 343 00000100:00100000:2.0:1787780002.713914:0:12488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477aee1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+5:2408:x1874622863710848:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1787780002.713956:0:12488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477aee1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+5:2408:x1874622863710848:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 43us (3996us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780002.713963:0:12488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 343 00000100:00100000:2.0:1787780002.713992:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863710208 00000100:00100000:2.0:1787780002.714000:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863710208 00000100:00100000:2.0:1787780002.714044:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 391 00000100:00100000:2.0:1787780002.714260:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471777050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+13:2408:x1874622863710208:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1787780002.714293:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471777050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+13:2408:x1874622863710208:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 243us (4305us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780002.714300:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 391 00000100:00100000:3.0:1787780002.720835:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477aecf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+25:2408:x1874622863710336:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1787780002.720984:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477aecf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+25:2408:x1874622863710336:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 10441us (11187us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780002.721008:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 340 00010000:00010000:3.0:1787780002.973430:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787780003.045451:0:14359:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787780003.045464:0:14359:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787780003.045511:0:14359:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1787780003.045522:0:14359:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1787780003.052255:0:13797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787780003.279752:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787780003.279918:0:12488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863711232 00000100:00100000:2.0:1787780003.279932:0:12488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863711232 00000100:00100000:2.0:1787780003.280018:0:12488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 145 00000100:00100000:2.0:1787780003.280029:0:12488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346d5e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:781d29bb-23d2-48e3-b16d-c29e52cd5375+25:11473:x1874622863711232:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:2.0:1787780003.280381:0:12488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787780003.280424:0:12488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19e00/0xc8fc0a5179961033 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea1f89 expref: -99 pid: 12488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780003.280695:0:12488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19a00/0xc8fc0a517996103a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780003.280713:0:12488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19a00/0xc8fc0a517996103a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780003.280730:0:12488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19a00/0xc8fc0a517996103a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787780003.280744:0:12488:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:2.0:1787780003.281108:0:12488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19e00/0xc8fc0a5179961033 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1f89 expref: 28 pid: 12488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780003.281137:0:12488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19a00/0xc8fc0a517996103a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1f89 expref: 27 pid: 12488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780003.281147:0:12488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c04533a3600) 00010000:00010000:2.0:1787780003.281150:0:12488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787780003.281154:0:12488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0444c19a00, rc 0) 00000100:00100000:2.0:1787780003.281241:0:12488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346d5e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:781d29bb-23d2-48e3-b16d-c29e52cd5375+27:11473:x1874622863711232:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 1213us (1502us total) trans 4294967415 rc 0/0 00000100:00100000:2.0:1787780003.281249:0:12488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 145 00000100:00100000:0.0:1787780003.286456:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787780003.286551:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863711360 00000100:00100000:1.0:1787780003.286563:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863711360 00000100:00100000:1.0:1787780003.286636:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 146 00000100:00100000:1.0:1787780003.286649:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0481348b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+27:11473:x1874622863711360:12345-192.168.203.31@tcp:54:lfs.0 00010000:00010000:1.0:1787780003.286748:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4b800/0xc8fc0a5179961048 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780003.286771:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4b800/0xc8fc0a5179961048 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780003.286805:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4b800/0xc8fc0a5179961048 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780003.286880:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4b800/0xc8fc0a5179961048 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780003.286888:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4b800/0xc8fc0a5179961048 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780003.286895:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4b800/0xc8fc0a5179961048 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780003.286901:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0347e4b800 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:1.0:1787780003.286906:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4b800/0xc8fc0a5179961048 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780003.286923:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4b800/0xc8fc0a5179961048 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780003.286938:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c04533a3600) 00010000:00010000:1.0:1787780003.286941:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787780003.286946:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4b800/0xc8fc0a5179961048 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780003.286952:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4b800/0xc8fc0a5179961048 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787780003.287038:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0481348b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+27:11473:x1874622863711360:12345-192.168.203.31@tcp:54:lfs.0 Request processed in 391us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780003.287173:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 146 00000100:00100000:1.0:1787780003.393814:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787780003.395707:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863711488 00000100:00100000:0.0:1787780003.395727:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863711488 00000100:00100000:0.0:1787780003.395808:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 54 00000100:00100000:0.0:1787780003.395822:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346d5da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+6:2408:x1874622863711488:12345-192.168.203.31@tcp:101:cat.0 00010000:00010000:0.0:1787780003.395884:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787780003.395911:0:8428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000164ee716/0xc8fc0a517996104f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea1f90 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787780003.395946:0:8428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a8f5b9f, atime: 0x6a8f5b9f, ctime: 0x6a8f5b9f, blocks: 0x8 00010000:00010000:0.0:1787780003.395970:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=411s v=(0 0) 00010000:00010000:0.0:1787780003.395975:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787780003.395987:0:8428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000164ee716/0xc8fc0a517996104f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1f90 expref: 7 pid: 8428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780003.396010:0:8428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000164ee716/0xc8fc0a517996104f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1f90 expref: 7 pid: 8428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780003.396025:0:8428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0477869800, rc 0) 00000100:00100000:0.0:1787780003.396117:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346d5da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+7:2408:x1874622863711488:12345-192.168.203.31@tcp:101:cat.0 Request processed in 299us (2317us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780003.396125:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 54 00000100:00100000:2.0:1787780003.402428:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787780003.402907:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863711616 00000100:00100000:0.0:1787780003.402922:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863711616 00002000:00100000:0.0:1787780003.402997:0:8435:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->4095) req@ffff9c03488e2940 x1874622863711616/t0(0) o3->781d29bb-23d2-48e3-b16d-c29e52cd5375@192.168.203.31@tcp:414/0 lens 488/0 e 0 to 0 dl 1787780014 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787780003.403010:0:8435:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c03488e2940 with x1874622863711616 ext(0->4095) 00002000:00010000:0.0:1787780003.403018:0:8435:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c03488e2940 00000100:00100000:0.0:1787780003.404469:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 3 00000100:00100000:0.0:1787780003.404500:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03488e2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+7:2409:x1874622863711616:12345-192.168.203.31@tcp:3:cat.0 00000100:00100000:0.0:1787780003.404813:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03488e2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+7:2409:x1874622863711616:12345-192.168.203.31@tcp:3:cat.0 Request processed in 327us (2400us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787780003.404821:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 3 00002000:00100000:0.0:1787780003.404831:0:8435:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->4095) req@ffff9c03488e2940 x1874622863711616/t0(0) o3->781d29bb-23d2-48e3-b16d-c29e52cd5375@192.168.203.31@tcp:414/0 lens 488/4536 e 0 to 0 dl 1787780014 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787780003.404864:0:8435:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c03488e2940 with x1874622863711616 ext(0->4095) 00002000:00010000:0.0:1787780003.404871:0:8435:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c03488e2940 00000040:00080000:0.0:1787780003.548806:0:13794:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787780003.548818:0:13794:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787780003.548862:0:13794:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1787780003.548877:0:13794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787780003.615018:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787780003.615050:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346cfed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881616640:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787780003.615163:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780003.616507:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881616640 00000100:00100000:3.0:1787780003.616522:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881616640 00000100:00100000:3.0:1787780003.617497:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1787780003.617513:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03488e3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881616640:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787780003.617562:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:3.0:1787780003.617680:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03488e3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881616640:12345-0@lo:41:osp-pre-0-1.0 Request processed in 172us (2517us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780003.617688:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1787780003.617785:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346cfed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881616640:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1787780003.996072:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787780004.129511:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348a09e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881616768:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787780004.129611:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787780004.130375:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881616768 00000100:00100000:0.0:1787780004.130387:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881616768 00000100:00100000:0.0:1787780004.130465:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1787780004.130477:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346cfed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881616768:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787780004.130524:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787780004.135403:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346cfed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881616768:12345-0@lo:41:osp-pre-1-0.0 Request processed in 4910us (5773us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780004.135422:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1787780004.137534:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348a09e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881616768:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787780005.021939:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787780005.157475:0:8423:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00010000:00010000:3.0:1787780006.044173:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787780006.183544:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348a092c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1f575176-36bc-4786-83ee-2fea064a12a9:3641:1874622881616896:0@lo:400:kworker.0 00000100:00100000:3.0:1787780006.183658:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780006.183725:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348a0bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881617408:0@lo:400:kworker.0 00000100:00100000:3.0:1787780006.183756:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780006.183775:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348a09e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881617920:0@lo:400:kworker.0 00000100:00100000:3.0:1787780006.183800:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780006.183819:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348870000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881618432:0@lo:400:kworker.0 00000100:00100000:3.0:1787780006.183866:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780006.183902:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1787780006.183909:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348a08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874622881617024:0@lo:400:kworker.0 00000100:00100000:3.0:1787780006.183940:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780006.183958:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348a0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1874622881617536:0@lo:400:kworker.0 00000100:00100000:3.0:1787780006.183978:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780006.184007:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348a0a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1874622881618048:0@lo:400:kworker.0 00000100:00100000:3.0:1787780006.184032:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780006.184064:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348a0a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881617152:0@lo:400:kworker.0 00000100:00100000:3.0:1787780006.184090:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780006.184109:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348a08b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1874622881617664:0@lo:400:kworker.0 00000100:00100000:3.0:1787780006.184130:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780006.184148:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348a0b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1874622881618176:0@lo:400:kworker.0 00000100:00100000:3.0:1787780006.184168:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780006.184183:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1787780006.184188:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348a0a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874622881617280:0@lo:400:kworker.0 00000100:00100000:3.0:1787780006.184205:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780006.184213:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348a0ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881617792:0@lo:400:kworker.0 00000100:00100000:3.0:1787780006.184229:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780006.184241:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347feb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881618304:0@lo:400:kworker.0 00000100:00100000:3.0:1787780006.184257:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780006.184291:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881616896 00000100:00100000:3.0:1787780006.184300:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881616896 00000100:00100000:3.0:1787780006.184350:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 392 00000100:00100000:3.0:1787780006.184360:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471774850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+24:3641:x1874622881616896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787780006.184411:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471774850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+24:3641:x1874622881616896:12345-0@lo:400:kworker.0 Request processed in 52us (762us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780006.184419:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 392 00000100:00100000:3.0:1787780006.184454:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881617408 00000100:00100000:3.0:1787780006.184457:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881617408 00000100:00100000:3.0:1787780006.184476:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881617152 00000100:00100000:3.0:1787780006.184478:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881617152 00000100:00100000:3.0:1787780006.184499:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1787780006.184504:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0348872d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874622881617408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787780006.184536:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0348872d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874622881617408:12345-0@lo:400:kworker.0 Request processed in 32us (780us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780006.184542:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1787780006.184553:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1787780006.184558:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0348873840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881617152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787780006.184584:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0348873840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881617152:12345-0@lo:400:kworker.0 Request processed in 26us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780006.184590:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1787780006.184608:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881617920 00000100:00100000:3.0:1787780006.184612:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881617920 00000100:00100000:3.0:1787780006.184645:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881618432 00000100:00100000:3.0:1787780006.184658:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881618432 00000100:00100000:3.0:1787780006.184674:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881617792 00000100:00100000:3.0:1787780006.184677:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881617792 00000100:00100000:3.0:1787780006.184689:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881618304 00000100:00100000:3.0:1787780006.184691:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881618304 00000100:00100000:3.0:1787780006.184722:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1787780006.184728:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03488721c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874622881617920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787780006.184762:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03488721c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874622881617920:12345-0@lo:400:kworker.0 Request processed in 34us (961us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780006.184767:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1787780006.184779:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1787780006.184784:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03488730c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3641:x1874622881618432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787780006.184812:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03488730c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3641:x1874622881618432:12345-0@lo:400:kworker.0 Request processed in 27us (946us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780006.184827:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1787780006.184865:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1787780006.184873:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0348870780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881617792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787780006.184902:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0348870780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881617792:12345-0@lo:400:kworker.0 Request processed in 31us (671us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780006.184907:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1787780006.184921:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1787780006.184927:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0348872580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881618304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787780006.184952:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0348872580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881618304:12345-0@lo:400:kworker.0 Request processed in 26us (694us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780006.184958:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1787780006.184982:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881617024 00000100:00100000:3.0:1787780006.184985:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881617024 00000100:00100000:3.0:1787780006.185004:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881617536 00000100:00100000:3.0:1787780006.185007:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881617536 00000100:00100000:3.0:1787780006.185019:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881618048 00000100:00100000:3.0:1787780006.185022:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881618048 00000100:00100000:3.0:1787780006.185034:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881617664 00000100:00100000:3.0:1787780006.185037:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881617664 00000100:00100000:3.0:1787780006.185046:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881618176 00000100:00100000:3.0:1787780006.185048:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881618176 00000100:00100000:3.0:1787780006.185063:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881617280 00000100:00100000:3.0:1787780006.185065:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881617280 00000100:00100000:3.0:1787780006.185077:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:3.0:1787780006.185083:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03488712c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874622881617024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787780006.185115:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03488712c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874622881617024:12345-0@lo:400:kworker.0 Request processed in 32us (1174us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780006.185122:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:3.0:1787780006.185143:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:3.0:1787780006.185149:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0348870b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874622881617536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787780006.185178:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0348870b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874622881617536:12345-0@lo:400:kworker.0 Request processed in 29us (1198us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780006.185184:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:3.0:1787780006.185193:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:3.0:1787780006.185199:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0348872940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1874622881618048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787780006.185220:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0348872940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1874622881618048:12345-0@lo:400:kworker.0 Request processed in 22us (1187us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780006.185225:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:3.0:1787780006.185234:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:3.0:1787780006.185239:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0348871680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1874622881617664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787780006.185260:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0348871680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1874622881617664:12345-0@lo:400:kworker.0 Request processed in 22us (1130us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780006.185266:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:3.0:1787780006.185274:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:3.0:1787780006.185279:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03488703c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1874622881618176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787780006.185299:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03488703c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1874622881618176:12345-0@lo:400:kworker.0 Request processed in 20us (1130us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780006.185304:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:3.0:1787780006.185312:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:3.0:1787780006.185317:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0348870f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1874622881617280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787780006.185337:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0348870f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1874622881617280:12345-0@lo:400:kworker.0 Request processed in 20us (1131us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780006.185342:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:3.0:1787780006.185411:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348a08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874622881617024:0@lo:400:kworker.0 00000100:00100000:3.0:1787780006.185423:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348a0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1874622881617536:0@lo:400:kworker.0 00000100:00100000:3.0:1787780006.185433:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348a0a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1874622881618048:0@lo:400:kworker.0 00000100:00100000:3.0:1787780006.185442:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348a092c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1f575176-36bc-4786-83ee-2fea064a12a9:3641:1874622881616896:0@lo:400:kworker.0 00000100:00100000:3.0:1787780006.185453:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348a0bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881617408:0@lo:400:kworker.0 00000100:00100000:3.0:1787780006.185462:0:3641:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:3.0:1787780006.185468:0:3641:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967304 committed transno 4294967305 00000004:00080000:3.0:1787780006.185497:0:3641:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c0347febc00, transno 4294967305 00000100:00100000:3.0:1787780006.185511:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348a09e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881617920:0@lo:400:kworker.0 00000100:00100000:3.0:1787780006.185523:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348870000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881618432:0@lo:400:kworker.0 00000100:00100000:3.0:1787780006.185558:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348a0a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874622881617280:0@lo:400:kworker.0 00000100:00100000:3.0:1787780006.185568:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348a0ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881617792:0@lo:400:kworker.0 00000100:00100000:3.0:1787780006.185578:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347feb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881618304:0@lo:400:kworker.0 00000100:00100000:3.0:1787780006.185588:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348a0a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881617152:0@lo:400:kworker.0 00010000:00080000:3.0:1787780006.185599:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0348a08b40 x1874622881617664/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787780022 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787780006.185612:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348a08b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1874622881617664:0@lo:400:kworker.0 00010000:00080000:3.0:1787780006.185622:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0348a0b0c0 x1874622881618176/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787780022 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787780006.185631:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348a0b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1874622881618176:0@lo:400:kworker.0 00000100:00080000:3.0:1787780006.185674:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787780006.185680:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787780006.185683:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787780006.185685:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1787780006.195129:0:6491:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000020:00080000:0.0:1787780006.195180:0:6491:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9c04537e03c0 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:0.0:1787780006.195187:0:6491:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c0477a7e800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9c04537e0f00 00000020:00080000:0.0:1787780006.195200:0:6491:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c0477a7eb00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9c034792fe00 00000020:00080000:0.0:1787780006.195228:0:6491:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:0.0:1787780006.195263:0:6544:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:0.0:1787780006.195373:0:6544:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00010000:00010000:1.0:1787780006.195436:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4be00/0xc8fc0a5179960fca lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780006.195451:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4be00/0xc8fc0a5179960fca lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780006.195461:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4be00/0xc8fc0a5179960fca lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780006.195468:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0347e4be00 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:1.0:1787780006.195474:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4be00/0xc8fc0a5179960fca lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780006.195483:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4be00/0xc8fc0a5179960fca lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780006.195505:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9c0443d81200) 00010000:00010000:1.0:1787780006.195508:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787780006.195515:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4be00/0xc8fc0a5179960fca lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780006.195522:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4be00/0xc8fc0a5179960fca lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787780006.196350:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787780006.196377:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348870000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881618560:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787780006.196475:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780006.196538:0:8529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881618560 00000100:00100000:3.0:1787780006.196548:0:8529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881618560 00000100:00100000:3.0:1787780006.196624:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1787780006.196635:0:8529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0348871a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881618560:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787780006.196685:0:8529:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1787780006.196740:0:8529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0348871a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881618560:12345-0@lo:13:osp-pre-1-1.0 Request processed in 106us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780006.196749:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1787780006.196807:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348870000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881618560:0@lo:13:osp-pre-1-1.0 00000001:00080000:0.0:1787780006.200549:0:9508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967313 is committed 00000001:00080000:0.0:1787780006.200567:0:9508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00000100:00100000:2.0:1787780006.689340:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787780006.689365:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348870000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881618688:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787780006.689437:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780006.689787:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881618688 00000100:00100000:3.0:1787780006.689795:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881618688 00000100:00100000:3.0:1787780006.689854:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1787780006.689864:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03488e03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881618688:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787780006.689910:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787780006.689959:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03488e03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881618688:12345-0@lo:13:osp-pre-0-1.0 Request processed in 97us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780006.689967:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1787780006.691104:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348870000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881618688:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787780006.701663:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787780006.701705:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0481348f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881618816:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787780006.701805:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787780006.708784:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881618816 00000100:00100000:0.0:1787780006.708812:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881618816 00000100:00100000:0.0:1787780006.708915:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1787780006.708927:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0348873480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881618816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787780006.709291:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1787780006.709408:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0348873480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881618816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 482us (7603us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780006.709417:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1787780006.709555:0:3643:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967313 gen 2 00000004:00080000:3.0:1787780006.709563:0:3643:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c0346cff480, transno 4294967311 00000004:00080000:3.0:1787780006.709583:0:3643:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967313 committed transno 4294967313 00000100:00100000:3.0:1787780006.709617:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0481348f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881618816:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787780007.069227:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787780007.197798:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346cff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881618944:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787780007.197925:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780007.198178:0:8529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881618944 00000100:00100000:1.0:1787780007.198188:0:8529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881618944 00000100:00100000:1.0:1787780007.198251:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1787780007.198261:0:8529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347ebd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874622881618944:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787780007.198291:0:8529:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787780007.198347:0:8529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347ebd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874622881618944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780007.198355:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1787780007.198414:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346cff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881618944:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787780007.854466:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787780007.854528:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787780007.854567:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787780007.854607:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787780007.854672:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787780007.854698:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787780007.854726:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787780007.854774:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863712000 00000100:00100000:0.0:1787780007.854786:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863712000 00000100:00100000:0.0:1787780007.854881:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863712512 00000100:00100000:0.0:1787780007.854885:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863712512 00000100:00100000:0.0:1787780007.854903:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863711872 00000100:00100000:0.0:1787780007.854906:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863711872 00000100:00100000:0.0:1787780007.854920:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863712384 00000100:00100000:0.0:1787780007.854923:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863712384 00000100:00100000:0.0:1787780007.854944:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 350 00000100:00100000:0.0:1787780007.854955:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c048134b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:2411:x1874622863712000:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1787780007.855069:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c048134b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:2411:x1874622863712000:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 116us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780007.855079:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 350 00000100:00100000:0.0:1787780007.855103:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 351 00000100:00100000:0.0:1787780007.855110:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347fa8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+5:2411:x1874622863712512:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1787780007.855135:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347fa8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+5:2411:x1874622863712512:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 26us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780007.855142:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 351 00000100:00100000:0.0:1787780007.855169:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 352 00000100:00100000:0.0:1787780007.855175:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03489f7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+13:2411:x1874622863711872:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1787780007.855202:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03489f7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+13:2411:x1874622863711872:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 27us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780007.855209:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 352 00000100:00100000:0.0:1787780007.855220:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 353 00000100:00100000:0.0:1787780007.855226:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03489f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+5:2411:x1874622863712384:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1787780007.855248:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03489f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+5:2411:x1874622863712384:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 22us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780007.855254:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 353 00000100:00100000:0.0:1787780007.855283:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863712256 00000100:00100000:0.0:1787780007.855287:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863712256 00000100:00100000:0.0:1787780007.855315:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863712128 00000100:00100000:0.0:1787780007.855318:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863712128 00000100:00100000:0.0:1787780007.855339:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 150 00000100:00100000:0.0:1787780007.855346:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0481348f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+6:2411:x1874622863712256:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1787780007.855384:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0481348f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+6:2411:x1874622863712256:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 38us (816us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780007.855391:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 150 00000100:00100000:0.0:1787780007.855404:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 151 00000100:00100000:0.0:1787780007.855410:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03489f5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:2411:x1874622863712128:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1787780007.855433:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03489f5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:2411:x1874622863712128:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 23us (735us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780007.855440:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 151 00000100:00080000:0.0:1787780007.855461:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787780007.855465:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787780007.855468:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787780007.855470:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787780007.857544:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863711744 00000100:00100000:2.0:1787780007.857564:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863711744 00000100:00100000:2.0:1787780007.857659:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 393 00000100:00100000:2.0:1787780007.857671:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471777450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+13:2411:x1874622863711744:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1787780007.857750:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471777450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+13:2411:x1874622863711744:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 80us (3298us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780007.857759:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 393 00010000:00010000:1.0:1787780008.098076:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787780008.732544:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477af3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874622881619072:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787780008.732657:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780008.733336:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881619072 00000100:00100000:1.0:1787780008.733348:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881619072 00000100:00100000:1.0:1787780008.733417:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1787780008.733429:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046c82d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1874622881619072:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787780008.733475:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:1.0:1787780008.733561:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046c82d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1874622881619072:12345-0@lo:41:osp-pre-0-1.0 Request processed in 135us (904us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780008.733569:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1787780008.736123:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477af3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874622881619072:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1787780009.124516:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787780009.244208:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348873c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881619200:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787780009.244310:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787780009.246644:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881619200 00000100:00100000:2.0:1787780009.246662:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881619200 00000100:00100000:2.0:1787780009.246906:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1787780009.246921:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03489f6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881619200:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787780009.246974:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787780009.247094:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03489f6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881619200:12345-0@lo:41:osp-pre-1-0.0 Request processed in 177us (2784us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780009.247102:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1787780009.247203:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348873c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881619200:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787780010.135908:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787780010.143525:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863712640 00000100:00100000:0.0:1787780010.143542:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863712640 00010000:00010000:2.0:1787780010.150145:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787780010.151465:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 147 00000100:00080000:0.0:1787780010.151512:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787780010.166545:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0348871e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+13:11118:x1874622863712640:12345-192.168.203.31@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1787780010.166765:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0348871e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+13:11118:x1874622863712640:12345-192.168.203.31@tcp:60:lhsmtool_posix.0 Request processed in 15275us (30862us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780010.166778:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 147 00000100:00100000:0.0:1787780010.207588:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787780010.207648:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863712768 00000100:00100000:0.0:1787780010.207679:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863712768 00000100:00100000:0.0:1787780010.210186:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 148 00000100:00100000:0.0:1787780010.210236:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03489f61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:11118:x1874622863712768:12345-192.168.203.31@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1787780010.210439:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03489f61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:11118:x1874622863712768:12345-192.168.203.31@tcp:60:lhsmtool_posix.0 Request processed in 223us (2854us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780010.210449:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 148 00000100:00080000:0.0:1787780010.210516:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787780010.215608:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787780010.216031:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863713024 00000100:00100000:3.0:1787780010.216045:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863713024 00000100:00100000:3.0:1787780010.216108:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 35 00000100:00100000:3.0:1787780010.216120:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03489f70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+13:11118:x1874622863713024:12345-192.168.203.31@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787780010.217090:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03489f70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+14:11118:x1874622863713024:12345-192.168.203.31@tcp:35:lhsmtool_posix.0 Request processed in 965us (1489us total) trans 4294967416 rc 0/0 00000100:00100000:3.0:1787780010.217101:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 35 00000100:00100000:3.0:1787780010.547423:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787780010.547766:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863713152 00000100:00100000:0.0:1787780010.547778:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863713152 00000100:00100000:0.0:1787780010.547929:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 149 00000100:00100000:0.0:1787780010.547942:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0348873c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+5:11933:x1874622863713152:12345-192.168.203.31@tcp:101:lsof.0 00010000:00010000:0.0:1787780010.547969:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787780010.547999:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868c00/0xc8fc0a5179961056 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea1f97 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780010.548083:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868e00/0xc8fc0a517996105d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780010.548101:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868e00/0xc8fc0a517996105d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780010.548115:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868e00/0xc8fc0a517996105d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787780010.548175:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787780010.548179:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787780010.548242:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868e00/0xc8fc0a517996105d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780010.548296:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868c00/0xc8fc0a5179961056 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1f97 expref: 7 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780010.548319:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868e00/0xc8fc0a517996105d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1f97 expref: 6 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780010.548329:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c0341cd4600) 00010000:00010000:0.0:1787780010.548333:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787780010.548337:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0477868e00, rc 0) 00000100:00100000:0.0:1787780010.548415:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0348873c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+6:11933:x1874622863713152:12345-192.168.203.31@tcp:101:lsof.0 Request processed in 476us (1008us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780010.548423:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 149 00000100:00080000:2.0:1787780010.549122:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787780011.164143:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787780011.294462:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348872d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881619328:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787780011.294534:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780011.294808:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881619328 00000100:00100000:3.0:1787780011.294817:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881619328 00000100:00100000:3.0:1787780011.294918:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1787780011.294929:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477af03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881619328:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787780011.294959:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1787780011.295016:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477af03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881619328:12345-0@lo:13:osp-pre-1-1.0 Request processed in 89us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780011.295023:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00080000:1.0:1787780011.295131:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787780011.295403:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c03488e0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1874622881619584:0@lo:400:kworker.0 00000100:00100000:2.0:1787780011.295439:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787780011.295470:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c03488e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1874622881620096:0@lo:400:kworker.0 00000100:00100000:2.0:1787780011.295495:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787780011.295516:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c03488e2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1874622881620608:0@lo:400:kworker.0 00000100:00100000:2.0:1787780011.295535:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787780011.295557:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1787780011.295563:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c03488e1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1f575176-36bc-4786-83ee-2fea064a12a9:3642:1874622881619456:0@lo:400:kworker.0 00000100:00100000:2.0:1787780011.295589:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787780011.295610:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c03488e1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881619968:0@lo:400:kworker.0 00000100:00100000:2.0:1787780011.295649:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787780011.295666:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c03488e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881620480:0@lo:400:kworker.0 00000100:00100000:2.0:1787780011.295694:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787780011.295713:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881619584 00000100:00100000:0.0:1787780011.295728:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881619584 00000100:00100000:2.0:1787780011.295734:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881619456 00000100:00100000:2.0:1787780011.295741:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881619456 00000100:00100000:2.0:1787780011.295779:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 394 00000100:00100000:2.0:1787780011.295788:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471776850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+24:3642:x1874622881619456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787780011.295808:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881620096 00000100:00100000:0.0:1787780011.295815:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881620096 00000100:00100000:0.0:1787780011.295887:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881620608 00000100:00100000:0.0:1787780011.295892:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881620608 00000100:00100000:0.0:1787780011.295913:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:0.0:1787780011.295923:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03488e3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1874622881619584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787780011.295994:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881619968 00000100:00100000:1.0:1787780011.296002:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881619968 00000100:00100000:0.0:1787780011.296015:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03488e3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1874622881619584:12345-0@lo:400:kworker.0 Request processed in 93us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780011.296025:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:1.0:1787780011.296045:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1787780011.296056:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:1.0:1787780011.296062:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03488bc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1874622881619968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787780011.296074:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03488bda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1874622881620096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787780011.296136:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03488bc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1874622881619968:12345-0@lo:400:kworker.0 Request processed in 80us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780011.296142:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03488bda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1874622881620096:12345-0@lo:400:kworker.0 Request processed in 73us (644us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780011.296159:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1787780011.296179:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:1.0:1787780011.296208:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:1.0:1787780011.296227:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03488bf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1874622881620608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787780011.296269:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03488bf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1874622881620608:12345-0@lo:400:kworker.0 Request processed in 53us (733us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780011.296306:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471776850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+24:3642:x1874622881619456:12345-0@lo:400:kworker.0 Request processed in 48us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780011.296315:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 394 00000100:00100000:2.0:1787780011.296365:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c03488e1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1f575176-36bc-4786-83ee-2fea064a12a9:3642:1874622881619456:0@lo:400:kworker.0 00000100:00100000:2.0:1787780011.296377:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c03488e1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881619968:0@lo:400:kworker.0 00000100:00100000:2.0:1787780011.296388:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c03488e0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1874622881619584:0@lo:400:kworker.0 00000100:00100000:2.0:1787780011.296399:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c03488e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1874622881620096:0@lo:400:kworker.0 00000100:00100000:2.0:1787780011.296407:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c03488e2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1874622881620608:0@lo:400:kworker.0 00000100:00100000:3.0:1787780011.297067:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881620480 00000100:00100000:3.0:1787780011.297073:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881620480 00000100:00100000:3.0:1787780011.297124:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1787780011.297132:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346d4da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3642:x1874622881620480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787780011.297179:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346d4da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3642:x1874622881620480:12345-0@lo:400:kworker.0 Request processed in 49us (1485us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780011.297186:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00080000:3.0:1787780011.297205:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787780011.297210:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787780011.297242:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c03488e0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881619712:0@lo:400:kworker.0 00000100:00100000:3.0:1787780011.297272:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780011.297289:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c03488e3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1874622881620224:0@lo:400:kworker.0 00000100:00100000:3.0:1787780011.297310:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780011.297338:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c03488e21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1874622881620736:0@lo:400:kworker.0 00000100:00100000:3.0:1787780011.297360:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780011.297379:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1787780011.297384:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c03488e2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874622881619840:0@lo:400:kworker.0 00000100:00100000:3.0:1787780011.297405:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780011.297420:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c03488e1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881620352:0@lo:400:kworker.0 00000100:00100000:3.0:1787780011.297440:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780011.297456:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c03488e30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881620864:0@lo:400:kworker.0 00000100:00100000:3.0:1787780011.297475:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780011.297499:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881620352 00000100:00100000:3.0:1787780011.297503:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881620352 00000100:00100000:3.0:1787780011.297529:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881620864 00000100:00100000:3.0:1787780011.297531:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881620864 00000100:00100000:3.0:1787780011.297545:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1787780011.297550:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0348801a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881620352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787780011.297592:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0348801a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881620352:12345-0@lo:400:kworker.0 Request processed in 41us (151us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780011.297599:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1787780011.297610:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1787780011.297628:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0348803c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881620864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787780011.297654:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0348803c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881620864:12345-0@lo:400:kworker.0 Request processed in 27us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780011.297659:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1787780011.297675:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881620224 00000100:00100000:3.0:1787780011.297678:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881620224 00000100:00100000:2.0:1787780011.298044:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881619712 00000100:00100000:2.0:1787780011.298049:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881619712 00000100:00100000:2.0:1787780011.298077:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1787780011.298084:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0348873840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881619712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787780011.298119:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0348873840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881619712:12345-0@lo:400:kworker.0 Request processed in 36us (847us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780011.298125:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1787780011.298161:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c03488e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881620480:0@lo:400:kworker.0 00000100:00100000:2.0:1787780011.298268:0:12488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881620736 00000100:00100000:2.0:1787780011.298272:0:12488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881620736 00000100:00100000:0.0:1787780011.301937:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881619840 00000100:00100000:0.0:1787780011.301955:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881619840 00000100:00100000:0.0:1787780011.302017:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:0.0:1787780011.302028:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0348803840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1874622881619840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787780011.302152:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0348803840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1874622881619840:12345-0@lo:400:kworker.0 Request processed in 127us (4746us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780011.302160:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00080000:0.0:1787780011.302263:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787780011.302271:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787780011.302275:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787780011.302325:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c03488e2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874622881619840:0@lo:400:kworker.0 00000100:00100000:0.0:1787780011.302344:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c03488e1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881620352:0@lo:400:kworker.0 00000100:00100000:0.0:1787780011.302358:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c03488e30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881620864:0@lo:400:kworker.0 00000100:00100000:0.0:1787780011.302371:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c03488e0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881619712:0@lo:400:kworker.0 00000100:00100000:0.0:1787780011.302453:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348872d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881619328:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787780011.306375:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:3.0:1787780011.308582:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:3.0:1787780011.308602:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0348870000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1874622881620224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787780011.308728:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0348870000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1874622881620224:12345-0@lo:400:kworker.0 Request processed in 136us (11416us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780011.308736:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00010000:00080000:1.0:1787780011.309071:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c03488e3c00 x1874622881620224/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787780027 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787780011.309085:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c03488e3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1874622881620224:0@lo:400:kworker.0 00000100:00100000:2.0:1787780011.309381:0:12488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:2.0:1787780011.309393:0:12488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0348801680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1874622881620736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787780011.309450:0:12488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0348801680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1874622881620736:12345-0@lo:400:kworker.0 Request processed in 61us (12089us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780011.309457:0:12488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00010000:00080000:1.0:1787780011.309515:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c03488e21c0 x1874622881620736/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787780027 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787780011.309525:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c03488e21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1874622881620736:0@lo:400:kworker.0 00000100:00100000:2.0:1787780011.804157:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c03489f52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881621120:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787780011.804229:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787780011.804299:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787780011.804306:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347fea1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874622881620992:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787780011.804331:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787780011.804381:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881621120 00000100:00100000:2.0:1787780011.804389:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881621120 00000100:00100000:2.0:1787780011.804452:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881620992 00000100:00100000:2.0:1787780011.804456:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881620992 00000100:00100000:2.0:1787780011.804476:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1787780011.804503:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346d4d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1874622881621120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787780011.804539:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1787780011.804742:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346d4d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1874622881621120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 251us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780011.804751:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1787780011.804772:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1787780011.804779:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346d4f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1874622881620992:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787780011.804800:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787780011.804831:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346d4f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1874622881620992:12345-0@lo:13:osp-pre-0-1.0 Request processed in 53us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780011.804867:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1787780011.804914:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347fea1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874622881620992:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787780011.804927:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c03489f52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881621120:0@lo:13:osp-pre-1-0.0 00000001:00080000:3.0:1787780011.810775:0:6491:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967416 is committed 00000020:00080000:3.0:1787780011.810792:0:6491:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:0.0:1787780011.811024:0:6544:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:0.0:1787780011.811035:0:6544:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:3.0:1787780012.188007:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787780012.316630:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477af2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881621248:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787780012.316706:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780012.318884:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881621248 00000100:00100000:3.0:1787780012.318896:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881621248 00000100:00100000:3.0:1787780012.318966:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1787780012.318975:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03489f4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881621248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787780012.318999:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787780012.319089:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03489f4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881621248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 115us (2383us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780012.319096:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1787780012.319164:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477af2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881621248:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787780012.951053:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787780012.951101:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787780012.951135:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787780012.951166:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787780012.951228:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863713280 00000100:00100000:1.0:1787780012.951237:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863713280 00000100:00100000:1.0:1787780012.951287:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 395 00000100:00100000:1.0:1787780012.951298:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471777c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+13:2410:x1874622863713280:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1787780012.951370:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471777c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+13:2410:x1874622863713280:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 74us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780012.951378:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 395 00000100:00100000:3.0:1787780012.951463:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787780012.951477:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863713792 00000100:00100000:2.0:1787780012.951481:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863713792 00000100:00100000:2.0:1787780012.951525:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 155 00000100:00100000:2.0:1787780012.951532:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347feb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+6:2410:x1874622863713792:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1787780012.951560:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347feb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+6:2410:x1874622863713792:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 29us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780012.951566:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 155 00000100:00080000:2.0:1787780012.951682:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787780012.959259:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863713536 00000100:00100000:0.0:1787780012.959274:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863713536 00000100:00080000:0.0:1787780012.959359:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787780012.959444:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863714048 00000100:00100000:0.0:1787780012.959448:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863714048 00000100:00100000:0.0:1787780012.959482:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 360 00000100:00100000:2.0:1787780012.959747:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 361 00000100:00100000:2.0:1787780012.959755:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347febc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+5:2410:x1874622863714048:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1787780012.959831:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347febc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+5:2410:x1874622863714048:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 77us (8663us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780012.959865:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 361 00000100:00100000:0.0:1787780012.961076:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347fea940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:2410:x1874622863713536:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1787780012.961142:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347fea940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:2410:x1874622863713536:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 1651us (10039us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780012.961151:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 360 00000100:00080000:0.0:1787780012.961182:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787780012.961974:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787780012.962004:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787780012.962054:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863713664 00000100:00100000:0.0:1787780012.962061:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863713664 00000100:00100000:0.0:1787780012.962130:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 156 00000100:00100000:0.0:1787780012.962138:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347fea1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:2410:x1874622863713664:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1787780012.962186:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347fea1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:2410:x1874622863713664:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 48us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780012.962192:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 156 00000100:00100000:2.0:1787780012.962409:0:12488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863713408 00000100:00100000:2.0:1787780012.962416:0:12488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863713408 00000100:00100000:2.0:1787780012.962457:0:12488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863713920 00000100:00100000:2.0:1787780012.962460:0:12488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863713920 00000100:00100000:2.0:1787780012.962482:0:12488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 362 00000100:00100000:2.0:1787780012.962489:0:12488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347feb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:781d29bb-23d2-48e3-b16d-c29e52cd5375+13:2410:x1874622863713408:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1787780012.962543:0:12488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347feb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:781d29bb-23d2-48e3-b16d-c29e52cd5375+13:2410:x1874622863713408:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 54us (11079us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780012.962550:0:12488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 362 00000100:00100000:2.0:1787780012.962565:0:12488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 363 00000100:00100000:2.0:1787780012.962572:0:12488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0348a0b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+6:2410:x1874622863713920:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1787780012.962597:0:12488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0348a0b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+6:2410:x1874622863713920:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 26us (592us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780012.962616:0:12488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 363 00000100:00080000:1.0:1787780012.966450:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787780012.966461:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787780013.213337:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787780013.276489:0:13797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1787780013.789688:0:13794:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787780013.789698:0:13794:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787780013.789815:0:13794:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:1.0:1787780013.789856:0:13794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787780013.854739:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477af30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881621376:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787780013.854923:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780013.855135:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881621376 00000100:00100000:3.0:1787780013.855145:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881621376 00000100:00100000:3.0:1787780013.855209:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1787780013.855220:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03489f6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881621376:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787780013.855265:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:3.0:1787780013.859337:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03489f6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881621376:12345-0@lo:41:osp-pre-0-1.0 Request processed in 4104us (4400us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780013.859356:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1787780013.859518:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477af30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881621376:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1787780014.238223:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787780014.367747:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787780014.367768:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348a08b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881621504:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787780014.367865:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787780014.368149:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881621504 00000100:00100000:0.0:1787780014.368158:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881621504 00000100:00100000:0.0:1787780014.368218:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1787780014.368227:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0348a0a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1874622881621504:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787780014.368261:0:14310:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787780014.368305:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0348a0a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1874622881621504:12345-0@lo:41:osp-pre-1-0.0 Request processed in 80us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780014.368325:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1787780014.368676:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348a08b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881621504:0@lo:41:osp-pre-1-0.0 00000001:02000400:1.0:1787780014.992229:0:14557:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 17:33:33 (1787780013) 00010000:00010000:3.0:1787780015.260032:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787780016.284046:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787780016.412180:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348a08b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874622881621632:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787780016.412255:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780016.412367:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881621632 00000100:00100000:3.0:1787780016.412374:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881621632 00000100:00100000:3.0:1787780016.412425:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1787780016.412435:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03489f5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1874622881621632:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787780016.412463:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1787780016.412798:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477af2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881622016:0@lo:400:kworker.0 00000100:00100000:2.0:1787780016.412831:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787780016.412891:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881622016 00000100:00100000:2.0:1787780016.412896:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881622016 00000100:00100000:2.0:1787780016.412923:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1787780016.412930:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346d4cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881622016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787780016.412970:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346d4cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881622016:12345-0@lo:400:kworker.0 Request processed in 40us (138us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780016.412990:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1787780016.413029:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477af2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881622016:0@lo:400:kworker.0 00000100:00100000:2.0:1787780016.413064:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477af30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874622881621888:0@lo:400:kworker.0 00000100:00100000:2.0:1787780016.413093:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787780016.413113:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787780016.413119:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477af2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1f575176-36bc-4786-83ee-2fea064a12a9:3644:1874622881621760:0@lo:400:kworker.0 00000100:00100000:2.0:1787780016.413145:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787780016.413176:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881621760 00000100:00100000:2.0:1787780016.413179:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881621760 00000100:00100000:2.0:1787780016.413203:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 396 00000100:00100000:2.0:1787780016.413209:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471776c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+24:3644:x1874622881621760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787780016.413244:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471776c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+24:3644:x1874622881621760:12345-0@lo:400:kworker.0 Request processed in 34us (97us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780016.413249:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 396 00000100:00100000:2.0:1787780016.413279:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477af2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1f575176-36bc-4786-83ee-2fea064a12a9:3644:1874622881621760:0@lo:400:kworker.0 00000100:00080000:2.0:1787780016.413308:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787780016.413324:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881621888 00000100:00100000:2.0:1787780016.413328:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881621888 00000100:00100000:2.0:1787780016.413351:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:2.0:1787780016.413357:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03488e21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874622881621888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787780016.413388:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03488e21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874622881621888:12345-0@lo:400:kworker.0 Request processed in 32us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780016.413394:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:2.0:1787780016.413420:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477af30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874622881621888:0@lo:400:kworker.0 00000100:00100000:3.0:1787780016.415697:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03489f5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1874622881621632:12345-0@lo:13:osp-pre-1-1.0 Request processed in 3256us (3433us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780016.415726:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1787780016.416028:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477af2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1874622881622528:0@lo:400:kworker.0 00000100:00100000:2.0:1787780016.416081:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787780016.416115:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477940000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1874622881623040:0@lo:400:kworker.0 00000100:00100000:2.0:1787780016.416138:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787780016.416162:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1787780016.416169:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477af3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874622881622144:0@lo:400:kworker.0 00000100:00100000:2.0:1787780016.416189:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787780016.416206:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347ee0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881622656:0@lo:400:kworker.0 00000100:00100000:2.0:1787780016.416230:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787780016.416247:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477940b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881623168:0@lo:400:kworker.0 00000100:00100000:2.0:1787780016.416267:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787780016.416295:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881622528 00000100:00100000:2.0:1787780016.416301:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881622528 00000100:00100000:2.0:1787780016.416346:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881623040 00000100:00100000:2.0:1787780016.416349:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881623040 00000100:00100000:2.0:1787780016.416366:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881622144 00000100:00100000:2.0:1787780016.416369:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881622144 00000100:00100000:2.0:1787780016.416383:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:2.0:1787780016.416390:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03488e3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1874622881622528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787780016.416433:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03488e3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1874622881622528:12345-0@lo:400:kworker.0 Request processed in 44us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780016.416439:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:2.0:1787780016.416452:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:2.0:1787780016.416458:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03488e0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1874622881623040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787780016.416485:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03488e0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1874622881623040:12345-0@lo:400:kworker.0 Request processed in 28us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780016.416512:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:2.0:1787780016.416525:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:2.0:1787780016.416531:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03488e30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874622881622144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787780016.416559:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03488e30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874622881622144:12345-0@lo:400:kworker.0 Request processed in 29us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780016.416565:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00100000:2.0:1787780016.416594:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881622656 00000100:00100000:2.0:1787780016.416598:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881622656 00000100:00100000:2.0:1787780016.416622:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881623168 00000100:00100000:2.0:1787780016.416624:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881623168 00000100:00100000:2.0:1787780016.416645:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1787780016.416652:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03488e1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881622656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787780016.416682:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03488e1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881622656:12345-0@lo:400:kworker.0 Request processed in 31us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780016.416688:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1787780016.416698:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1787780016.416704:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03488e2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1874622881623168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787780016.416730:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03488e2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1874622881623168:12345-0@lo:400:kworker.0 Request processed in 27us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780016.416736:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00080000:2.0:1787780016.416765:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787780016.416768:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787780016.416771:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787780016.416784:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477af2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1874622881622400:0@lo:400:kworker.0 00000100:00100000:2.0:1787780016.416808:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787780016.416825:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477942580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1874622881622912:0@lo:400:kworker.0 00000100:00100000:2.0:1787780016.416879:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787780016.416898:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787780016.416904:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477af30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881622272:0@lo:400:kworker.0 00000100:00100000:2.0:1787780016.416925:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787780016.416941:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347ee2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881622784:0@lo:400:kworker.0 00000100:00100000:2.0:1787780016.416959:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787780016.416981:0:12488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881622400 00000100:00100000:2.0:1787780016.416984:0:12488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881622400 00000100:00100000:2.0:1787780016.417009:0:12488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881622912 00000100:00100000:2.0:1787780016.417011:0:12488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881622912 00000100:00100000:2.0:1787780016.417025:0:12488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:2.0:1787780016.417030:0:12488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03488e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1874622881622400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787780016.417061:0:12488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03488e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1874622881622400:12345-0@lo:400:kworker.0 Request processed in 31us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780016.417067:0:12488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:2.0:1787780016.417077:0:12488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:2.0:1787780016.417083:0:12488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03488e2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1874622881622912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787780016.417107:0:12488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03488e2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1874622881622912:12345-0@lo:400:kworker.0 Request processed in 24us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780016.417112:0:12488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00000100:00080000:2.0:1787780016.417124:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787780016.417139:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881622784 00000100:00100000:2.0:1787780016.417143:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881622784 00000100:00100000:2.0:1787780016.417166:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1787780016.417172:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03488e0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881622784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787780016.417200:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03488e0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881622784:12345-0@lo:400:kworker.0 Request processed in 28us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780016.417215:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00080000:2.0:1787780016.417230:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787780016.417271:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347ee2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881622784:0@lo:400:kworker.0 00000100:00100000:2.0:1787780016.417283:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477af2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1874622881622400:0@lo:400:kworker.0 00000100:00100000:2.0:1787780016.417292:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477942580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1874622881622912:0@lo:400:kworker.0 00000100:00100000:2.0:1787780016.417324:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477af3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874622881622144:0@lo:400:kworker.0 00000100:00100000:2.0:1787780016.417335:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347ee0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881622656:0@lo:400:kworker.0 00000100:00100000:2.0:1787780016.417343:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477940b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881623168:0@lo:400:kworker.0 00010000:00080000:2.0:1787780016.417355:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0477af2580 x1874622881622528/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787780032 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787780016.417367:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477af2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1874622881622528:0@lo:400:kworker.0 00010000:00080000:2.0:1787780016.417376:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0477940000 x1874622881623040/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787780032 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787780016.417385:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477940000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1874622881623040:0@lo:400:kworker.0 00000100:00100000:3.0:1787780016.417822:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881622272 00000100:00100000:3.0:1787780016.417827:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881622272 00000100:00100000:3.0:1787780016.417883:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1787780016.417890:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03488e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881622272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787780016.417931:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03488e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881622272:12345-0@lo:400:kworker.0 Request processed in 42us (1005us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780016.417936:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1787780016.417965:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477af30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881622272:0@lo:400:kworker.0 00000100:00100000:0.0:1787780016.418127:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348a08b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874622881621632:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787780016.711174:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787780016.711532:0:12488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863714304 00000100:00100000:2.0:1787780016.711546:0:12488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863714304 00000100:00100000:2.0:1787780016.711661:0:12488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 150 00000100:00100000:2.0:1787780016.711673:0:12488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0348a0ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:781d29bb-23d2-48e3-b16d-c29e52cd5375+13:12200:x1874622863714304:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787780016.711703:0:12488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787780016.711731:0:12488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19800/0xc8fc0a5179961064 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea1f9e expref: -99 pid: 12488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780016.712333:0:12488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18c00/0xc8fc0a517996106b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780016.712500:0:12488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18c00/0xc8fc0a517996106b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780016.712519:0:12488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18c00/0xc8fc0a517996106b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780016.712616:0:12488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18800/0xc8fc0a5179961072 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780016.712625:0:12488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18800/0xc8fc0a5179961072 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780016.712631:0:12488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18800/0xc8fc0a5179961072 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787780016.712703:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787780016.712791:0:12488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18200/0xc8fc0a5179961079 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780016.712802:0:12488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18200/0xc8fc0a5179961079 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780016.712809:0:12488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18200/0xc8fc0a5179961079 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787780016.712820:0:12488:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1787780016.712947:0:12488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18c00/0xc8fc0a517996106b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780016.712971:0:12488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18c00/0xc8fc0a517996106b lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780016.712978:0:12488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18c00/0xc8fc0a517996106b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780016.712985:0:12488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0444c18c00 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:2.0:1787780016.712989:0:12488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18c00/0xc8fc0a517996106b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780016.712996:0:12488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18c00/0xc8fc0a517996106b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780016.713007:0:12488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9c0347a50600) 00010000:00010000:2.0:1787780016.713010:0:12488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787780016.713014:0:12488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18c00/0xc8fc0a517996106b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780016.713020:0:12488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18c00/0xc8fc0a517996106b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780016.713035:0:12488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18800/0xc8fc0a5179961072 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780016.713041:0:12488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18800/0xc8fc0a5179961072 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780016.713046:0:12488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18800/0xc8fc0a5179961072 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780016.713051:0:12488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0444c18800 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:2.0:1787780016.713060:0:12488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18800/0xc8fc0a5179961072 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780016.713067:0:12488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18800/0xc8fc0a5179961072 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780016.713076:0:12488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9c0347a4e800) 00010000:00010000:2.0:1787780016.713079:0:12488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787780016.713082:0:12488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18800/0xc8fc0a5179961072 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780016.713088:0:12488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18800/0xc8fc0a5179961072 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780016.713370:0:12488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19800/0xc8fc0a5179961064 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1f9e expref: 16 pid: 12488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780016.713386:0:12488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18200/0xc8fc0a5179961079 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1f9e expref: 15 pid: 12488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780016.713394:0:12488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c0347a50800) 00010000:00010000:2.0:1787780016.713396:0:12488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787780016.713398:0:12488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0444c18200, rc 0) 00000100:00100000:2.0:1787780016.713479:0:12488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0348a0ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:781d29bb-23d2-48e3-b16d-c29e52cd5375+15:12200:x1874622863714304:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 1807us (2322us total) trans 4294967417 rc 0/0 00000100:00100000:2.0:1787780016.713489:0:12488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 150 00000100:00100000:2.0:1787780016.733109:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787780016.733634:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787780016.733766:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863714560 00000100:00100000:1.0:1787780016.733785:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863714560 00000100:00100000:0.0:1787780016.733801:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863714432 00000100:00100000:0.0:1787780016.733812:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863714432 00000100:00100000:0.0:1787780016.733897:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 151 00000100:00100000:0.0:1787780016.733910:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03488e1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+16:12200:x1874622863714432:12345-192.168.203.31@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1787780016.733951:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 11 00000100:00100000:1.0:1787780016.733965:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046099c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+16:2409:x1874622863714560:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787780016.733996:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1787780016.734029:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03488e1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+16:12200:x1874622863714432:12345-192.168.203.31@tcp:59:lhsmtool_posix.0 Request processed in 121us (927us total) trans 0 rc 0/0 00010000:00010000:1.0:1787780016.734033:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18200/0xc8fc0a5179961079 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1f9e expref: 16 pid: 12488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787780016.734049:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 151 00010000:00010000:1.0:1787780016.734075:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c0347a50800) 00010000:00010000:1.0:1787780016.734083:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787780016.734136:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046099c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+14:2409:x1874622863714560:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 174us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780016.734144:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 11 00000100:00100000:3.0:1787780016.743153:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787780016.743349:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863714688 00000100:00100000:1.0:1787780016.743363:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863714688 00000100:00100000:1.0:1787780016.743461:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 152 00000100:00100000:1.0:1787780016.743473:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0348a0a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:12200:x1874622863714688:12345-192.168.203.31@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1787780016.743626:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0348a0a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:12200:x1874622863714688:12345-192.168.203.31@tcp:59:lhsmtool_posix.0 Request processed in 153us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780016.743634:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 152 00000100:00080000:0.0:1787780016.743717:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000040:00080000:3.0:1787780016.867190:0:13794:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787780016.867204:0:13794:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787780016.867759:0:13794:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1787780016.867775:0:13794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787780016.924001:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787780016.924034:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348a09e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881623296:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787780016.924131:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787780016.924187:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881623296 00000100:00100000:0.0:1787780016.924196:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881623296 00000100:00100000:3.0:1787780016.924209:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c03489f43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881623424:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787780016.924235:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780016.925483:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881623424 00000100:00100000:3.0:1787780016.925497:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881623424 00000100:00100000:3.0:1787780016.925542:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1787780016.925552:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0348a0bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881623296:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787780016.925603:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787780016.925687:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0348a0bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881623296:12345-0@lo:13:osp-pre-0-1.0 Request processed in 136us (1557us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780016.925723:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1787780016.925746:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1787780016.925754:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0348a092c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881623424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787780016.925766:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1787780016.925797:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0348a092c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881623424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 45us (1561us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780016.925804:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1787780016.926082:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c03489f43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881623424:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787780016.926100:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348a09e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881623296:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1787780017.315035:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787780017.372540:0:13797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787780017.453544:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477940b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881623552:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787780017.453652:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780017.453752:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881623552 00000100:00100000:1.0:1787780017.453763:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881623552 00000100:00100000:1.0:1787780017.453864:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1787780017.453875:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477942580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874622881623552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787780017.453907:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787780017.453958:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477942580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874622881623552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780017.453965:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1787780017.454023:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477940b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881623552:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787780018.091812:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787780018.092037:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787780018.092074:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787780018.092093:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787780018.092112:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787780018.092131:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787780018.092153:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787780018.092180:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863715072 00000100:00100000:0.0:1787780018.092214:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863715072 00000100:00100000:3.0:1787780018.092223:0:12488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863715584 00000100:00100000:3.0:1787780018.092227:0:12488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863715584 00000100:00100000:1.0:1787780018.092294:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863715328 00000100:00100000:1.0:1787780018.092299:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863715328 00000100:00100000:1.0:1787780018.092335:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863715200 00000100:00100000:1.0:1787780018.092338:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863715200 00000100:00100000:1.0:1787780018.092359:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 160 00000100:00100000:1.0:1787780018.092369:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03489f4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+6:2411:x1874622863715328:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1787780018.093528:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863714944 00000100:00100000:0.0:1787780018.093534:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863714944 00000100:00100000:1.0:1787780018.093700:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03489f4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+6:2411:x1874622863715328:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 1330us (1622us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780018.093710:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 160 00000100:00100000:1.0:1787780018.093730:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 161 00000100:00100000:1.0:1787780018.093738:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03489f5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:2411:x1874622863715200:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1787780018.093768:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03489f5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:2411:x1874622863715200:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 31us (1637us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780018.093775:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 161 00000100:00100000:2.0:1787780018.097945:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863714816 00000100:00100000:2.0:1787780018.098025:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863714816 00000100:00100000:2.0:1787780018.098109:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 397 00000100:00100000:2.0:1787780018.098119:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471777850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+13:2411:x1874622863714816:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1787780018.098189:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471777850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+13:2411:x1874622863714816:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 71us (6385us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780018.098197:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 397 00000100:00100000:2.0:1787780018.098239:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863715456 00000100:00100000:2.0:1787780018.098248:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863715456 00000100:00100000:3.0:1787780018.099734:0:12488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 370 00000100:00100000:3.0:1787780018.099748:0:12488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03489f43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:2411:x1874622863715072:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1787780018.099795:0:12488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03489f43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:2411:x1874622863715072:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 52us (7758us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780018.099802:0:12488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 370 00000100:00080000:1.0:1787780018.100089:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787780018.100095:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787780018.100098:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787780018.100101:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787780018.100117:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 371 00000100:00100000:1.0:1787780018.100142:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03489f4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+5:2411:x1874622863715584:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1787780018.100174:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03489f4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+5:2411:x1874622863715584:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 35us (8080us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780018.100180:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 371 00000100:00100000:0.0:1787780018.100492:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 372 00000100:00100000:0.0:1787780018.100503:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03489f6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+14:2411:x1874622863714944:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1787780018.100536:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03489f6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+14:2411:x1874622863714944:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 36us (8422us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780018.100542:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 372 00000100:00100000:2.0:1787780018.110717:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 373 00000100:00100000:2.0:1787780018.110742:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03489f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+6:2411:x1874622863715456:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1787780018.110827:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03489f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+6:2411:x1874622863715456:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 98us (18672us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780018.110854:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 373 00010000:00010000:3.0:1787780018.332027:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787780018.974169:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477940000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874622881623680:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787780018.974235:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780018.974316:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881623680 00000100:00100000:1.0:1787780018.974323:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881623680 00000100:00100000:1.0:1787780018.974366:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1787780018.974374:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477940b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1874622881623680:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787780018.974407:0:14310:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:1.0:1787780018.974453:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477940b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1874622881623680:12345-0@lo:41:osp-pre-0-1.0 Request processed in 79us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780018.974460:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1787780018.974505:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477940000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874622881623680:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787780019.134417:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787780019.136294:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863715712 00000100:00100000:0.0:1787780019.136307:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863715712 00000100:00100000:2.0:1787780019.136620:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 153 00000100:00100000:2.0:1787780019.136631:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03488e1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+14:12242:x1874622863715712:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:2.0:1787780019.136663:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787780019.136686:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19c00/0xc8fc0a5179961087 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea1fa5 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780019.136761:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18a00/0xc8fc0a517996108e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780019.136776:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18a00/0xc8fc0a517996108e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780019.136814:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18a00/0xc8fc0a517996108e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780019.136832:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19000/0xc8fc0a5179961095 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780019.136866:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19000/0xc8fc0a5179961095 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780019.136874:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19000/0xc8fc0a5179961095 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780019.136989:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18a00/0xc8fc0a517996108e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780019.136998:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18a00/0xc8fc0a517996108e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780019.137005:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18a00/0xc8fc0a517996108e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780019.137012:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0444c18a00 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:2.0:1787780019.137016:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18a00/0xc8fc0a517996108e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780019.137025:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18a00/0xc8fc0a517996108e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780019.137039:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c0341cd4600) 00010000:00010000:2.0:1787780019.137042:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787780019.137047:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18a00/0xc8fc0a517996108e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780019.137061:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18a00/0xc8fc0a517996108e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780019.137074:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19000/0xc8fc0a5179961095 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780019.137080:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19000/0xc8fc0a5179961095 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780019.137087:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19000/0xc8fc0a5179961095 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780019.137093:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0444c19000 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:2.0:1787780019.137096:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19000/0xc8fc0a5179961095 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780019.137103:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19000/0xc8fc0a5179961095 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780019.137112:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9c0347a4e800) 00010000:00010000:2.0:1787780019.137115:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787780019.137118:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19000/0xc8fc0a5179961095 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780019.137124:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19000/0xc8fc0a5179961095 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780019.137155:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19c00/0xc8fc0a5179961087 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1fa5 expref: 15 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780019.137179:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c0341cd4600) 00010000:00010000:2.0:1787780019.137181:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787780019.137186:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19c00/0xc8fc0a5179961087 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1fa5 expref: 15 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780019.137196:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0444c19c00, rc 0) 00000100:00100000:2.0:1787780019.137430:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03488e1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+14:12242:x1874622863715712:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 799us (3020us total) trans 0 rc 301/301 00000100:00100000:2.0:1787780019.137439:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 153 00000100:00100000:0.0:1787780019.148449:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787780019.148526:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863715968 00000100:00100000:1.0:1787780019.148536:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863715968 00000100:00100000:1.0:1787780019.148609:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 154 00000100:00100000:1.0:1787780019.148618:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03489f52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+14:12242:x1874622863715968:12345-192.168.203.31@tcp:36:lfs.0 00010000:00010000:1.0:1787780019.148673:0:7821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787780019.148700:0:7821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd7600/0xc8fc0a51799609db lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1dc9 expref: 14 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780019.148717:0:7821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c0341cd4600) 00010000:00010000:1.0:1787780019.148722:0:7821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787780019.148790:0:7821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a200/0xc8fc0a517996109c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780019.148803:0:7821:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868e00/0xc8fc0a517996105d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1f97 expref: 5 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780019.148810:0:7821:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a200/0xc8fc0a517996109c lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780019.148875:0:7821:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868e00/0xc8fc0a517996105d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1f97 expref: 5 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780019.148888:0:7821:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868e00/0xc8fc0a517996105d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1f97 expref: 5 pid: 6514 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787780019.148901:0:7821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477940000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7821:1874622881623808:192.168.203.31@tcp:104: 00000100:00100000:1.0:1787780019.148982:0:7821:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c04764c50c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787780019.154648:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787780019.154687:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863716096 00000100:00100000:1.0:1787780019.154696:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863716096 00010000:00010000:1.0:1787780019.154735:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868e00/0xc8fc0a517996105d lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1f97 expref: 6 pid: 6514 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787780019.154771:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 79 00000100:00100000:1.0:1787780019.154780:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c048134a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+6:2411:x1874622863716096:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787780019.154795:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787780019.154815:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868e00/0xc8fc0a517996105d lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1f97 expref: 6 pid: 6514 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780019.154864:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868e00/0xc8fc0a517996105d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1f97 expref: 6 pid: 6514 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780019.154888:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c0341cd4600) 00010000:00010000:1.0:1787780019.154893:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a200/0xc8fc0a517996109c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780019.154902:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a200/0xc8fc0a517996109c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780019.154909:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a200/0xc8fc0a517996109c lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780019.154927:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787780019.154977:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c048134a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+6:2411:x1874622863716096:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 198us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780019.154985:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 79 00010000:00010000:2.0:1787780019.155112:0:7821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868e00/0xc8fc0a517996105d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1f97 expref: 5 pid: 6514 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787780019.155128:0:7821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477940000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7821:1874622881623808:192.168.203.31@tcp:104: 00010000:00010000:2.0:1787780019.155146:0:7821:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a200/0xc8fc0a517996109c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780019.155155:0:7821:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a200/0xc8fc0a517996109c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780019.155160:0:7821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a200/0xc8fc0a517996109c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780019.155182:0:7821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18000/0xc8fc0a51799610a3 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780019.155191:0:7821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18000/0xc8fc0a51799610a3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780019.155209:0:7821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18000/0xc8fc0a51799610a3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780019.155756:0:7821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19600/0xc8fc0a51799610aa lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780019.155767:0:7821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19600/0xc8fc0a51799610aa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780019.155775:0:7821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19600/0xc8fc0a51799610aa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787780019.155791:0:7821:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d2da684f reply state 0000000003b45e60 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19600/0xc8fc0a51799610aa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780019.155802:0:7821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19600/0xc8fc0a51799610aa lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780019.155809:0:7821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c0347a4e700) 00010000:00010000:2.0:1787780019.155812:0:7821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787780019.155814:0:7821:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1787780019.155820:0:7821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1787780019.155827:0:7821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a200/0xc8fc0a517996109c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780019.155834:0:7821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a200/0xc8fc0a517996109c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780019.155861:0:7821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a200/0xc8fc0a517996109c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780019.155866:0:7821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0347e4a200 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:2.0:1787780019.155877:0:7821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a200/0xc8fc0a517996109c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780019.155885:0:7821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a200/0xc8fc0a517996109c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780019.155894:0:7821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c0341cd4600) 00010000:00010000:2.0:1787780019.155897:0:7821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787780019.155900:0:7821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a200/0xc8fc0a517996109c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780019.155907:0:7821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a200/0xc8fc0a517996109c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787780019.155922:0:7821:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d2da684f reply state 0000000003b45e60 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18000/0xc8fc0a51799610a3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780019.155931:0:7821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18000/0xc8fc0a51799610a3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780019.155937:0:7821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9c0347a4ea00) 00010000:00010000:2.0:1787780019.155939:0:7821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787780019.155941:0:7821:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1787780019.155993:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03489f52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+15:12242:x1874622863715968:12345-192.168.203.31@tcp:36:lfs.0 Request processed in 7376us (7552us total) trans 4294967418 rc 0/0 00000100:00100000:2.0:1787780019.156000:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 154 00000001:00080000:2.0:1787780019.160670:0:6491:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967418 is committed 00010000:00010000:0.0:1787780019.160800:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18000/0xc8fc0a51799610a3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780019.160813:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18000/0xc8fc0a51799610a3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780019.160821:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18000/0xc8fc0a51799610a3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780019.160828:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0444c18000 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:0.0:1787780019.160833:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18000/0xc8fc0a51799610a3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780019.160869:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18000/0xc8fc0a51799610a3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780019.160887:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9c0347a4ea00) 00010000:00010000:0.0:1787780019.160890:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787780019.160895:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18000/0xc8fc0a51799610a3 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780019.160910:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18000/0xc8fc0a51799610a3 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780019.160929:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19600/0xc8fc0a51799610aa lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780019.160936:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19600/0xc8fc0a51799610aa lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780019.160942:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19600/0xc8fc0a51799610aa lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780019.160948:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0444c19600 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:0.0:1787780019.160951:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19600/0xc8fc0a51799610aa lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780019.160958:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19600/0xc8fc0a51799610aa lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780019.160967:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c0347a4e700) 00010000:00010000:0.0:1787780019.160969:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787780019.160972:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19600/0xc8fc0a51799610aa lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780019.160978:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19600/0xc8fc0a51799610aa lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787780019.286370:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787780019.287579:0:12488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863716224 00000100:00100000:3.0:1787780019.287591:0:12488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863716224 00000100:00100000:3.0:1787780019.287659:0:12488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 155 00000100:00100000:3.0:1787780019.287670:0:12488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c047796de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:781d29bb-23d2-48e3-b16d-c29e52cd5375+12:12250:x1874622863716224:12345-192.168.203.31@tcp:101:lctl.0 00010000:00010000:3.0:1787780019.287693:0:12488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787780019.287715:0:12488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd600/0xc8fc0a51799610b1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea1fac expref: -99 pid: 12488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780019.287778:0:12488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc000/0xc8fc0a51799610b8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780019.287807:0:12488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc000/0xc8fc0a51799610b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780019.287819:0:12488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc000/0xc8fc0a51799610b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787780019.287886:0:12488:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787780019.287890:0:12488:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787780019.287913:0:12488:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc000/0xc8fc0a51799610b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780019.287938:0:12488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd600/0xc8fc0a51799610b1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1fac expref: 14 pid: 12488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780019.287955:0:12488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc000/0xc8fc0a51799610b8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1fac expref: 13 pid: 12488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780019.287963:0:12488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c0443d81000) 00010000:00010000:3.0:1787780019.287966:0:12488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787780019.287969:0:12488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c04766dc000, rc 0) 00000100:00100000:3.0:1787780019.288030:0:12488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c047796de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:781d29bb-23d2-48e3-b16d-c29e52cd5375+13:12250:x1874622863716224:12345-192.168.203.31@tcp:101:lctl.0 Request processed in 362us (1669us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780019.288037:0:12488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 155 00010000:00010000:2.0:1787780019.356122:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787780019.360632:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787780019.360769:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863716352 00000100:00100000:2.0:1787780019.360779:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863716352 00000100:00100000:2.0:1787780019.360876:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 156 00000100:00100000:2.0:1787780019.360886:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c047796e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+13:12256:x1874622863716352:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:2.0:1787780019.360920:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787780019.360942:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19c00/0xc8fc0a51799610bf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea1fb3 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780019.361016:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19000/0xc8fc0a51799610c6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780019.361031:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19000/0xc8fc0a51799610c6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780019.361042:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19000/0xc8fc0a51799610c6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780019.361057:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18a00/0xc8fc0a51799610cd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780019.361063:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18a00/0xc8fc0a51799610cd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780019.361070:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18a00/0xc8fc0a51799610cd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780019.361423:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19e00/0xc8fc0a51799610d4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780019.361433:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19e00/0xc8fc0a51799610d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780019.361440:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19e00/0xc8fc0a51799610d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787780019.361475:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1787780019.361485:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787780019.361516:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19e00/0xc8fc0a51799610d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780019.361527:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19000/0xc8fc0a51799610c6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780019.361533:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19000/0xc8fc0a51799610c6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780019.361539:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19000/0xc8fc0a51799610c6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780019.361545:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0444c19000 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:2.0:1787780019.361549:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19000/0xc8fc0a51799610c6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780019.361565:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19000/0xc8fc0a51799610c6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780019.361577:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c0443d81000) 00010000:00010000:2.0:1787780019.361579:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787780019.361583:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19000/0xc8fc0a51799610c6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780019.361589:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19000/0xc8fc0a51799610c6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780019.361600:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18a00/0xc8fc0a51799610cd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780019.361605:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18a00/0xc8fc0a51799610cd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780019.361622:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18a00/0xc8fc0a51799610cd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780019.361627:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0444c18a00 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:2.0:1787780019.361630:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18a00/0xc8fc0a51799610cd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780019.361636:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18a00/0xc8fc0a51799610cd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780019.361643:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9c04478d7700) 00010000:00010000:2.0:1787780019.361645:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787780019.361647:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18a00/0xc8fc0a51799610cd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780019.361663:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18a00/0xc8fc0a51799610cd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780019.361692:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19c00/0xc8fc0a51799610bf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1fb3 expref: 15 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780019.361704:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19e00/0xc8fc0a51799610d4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1fb3 expref: 14 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780019.361712:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c04478d7d00) 00010000:00010000:2.0:1787780019.361714:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787780019.361716:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0444c19e00, rc 0) 00000100:00100000:2.0:1787780019.361786:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c047796e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+14:12256:x1874622863716352:12345-192.168.203.31@tcp:101:bash.0 Request processed in 901us (1164us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780019.362110:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 156 00000100:00100000:1.0:1787780019.366445:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787780019.366523:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863716608 00000100:00100000:2.0:1787780019.366532:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863716608 00000100:00100000:2.0:1787780019.366597:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 157 00000100:00100000:2.0:1787780019.366606:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c047796c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+14:12256:x1874622863716608:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:2.0:1787780019.366637:0:7821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787780019.366659:0:7821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19600/0xc8fc0a51799610db lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea1fba expref: -99 pid: 7821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780019.366767:0:7821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18000/0xc8fc0a51799610e2 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780019.366782:0:7821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18000/0xc8fc0a51799610e2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780019.366793:0:7821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18000/0xc8fc0a51799610e2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780019.366817:0:7821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18600/0xc8fc0a51799610e9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780019.366824:0:7821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18600/0xc8fc0a51799610e9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780019.366831:0:7821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18600/0xc8fc0a51799610e9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787780019.367300:0:7821:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x4:0x0], index 0: 0 00010000:00010000:2.0:1787780019.367443:0:7821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19c00/0xc8fc0a51799610f0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780019.367465:0:7821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19c00/0xc8fc0a51799610f0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780019.367473:0:7821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19c00/0xc8fc0a51799610f0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780019.367505:0:7821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18000/0xc8fc0a51799610e2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780019.367513:0:7821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18000/0xc8fc0a51799610e2 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780019.367520:0:7821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18000/0xc8fc0a51799610e2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780019.367526:0:7821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0444c18000 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:2.0:1787780019.367530:0:7821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18000/0xc8fc0a51799610e2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780019.367537:0:7821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18000/0xc8fc0a51799610e2 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780019.367549:0:7821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c04478d7d00) 00010000:00010000:2.0:1787780019.367552:0:7821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787780019.367566:0:7821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18000/0xc8fc0a51799610e2 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780019.367574:0:7821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18000/0xc8fc0a51799610e2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787780019.367586:0:7821:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d3800b58 reply state 000000001027bd6d transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18600/0xc8fc0a51799610e9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780019.367604:0:7821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18600/0xc8fc0a51799610e9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780019.367610:0:7821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9c04478d7500) 00010000:00010000:2.0:1787780019.367612:0:7821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787780019.367614:0:7821:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787780019.367641:0:7821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19600/0xc8fc0a51799610db lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1fba expref: 17 pid: 7821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780019.367655:0:7821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19c00/0xc8fc0a51799610f0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1fba expref: 16 pid: 7821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780019.367663:0:7821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c04478d7700) 00010000:00010000:2.0:1787780019.367665:0:7821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787780019.367668:0:7821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0444c19c00, rc 0) 00000100:00100000:2.0:1787780019.367734:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c047796c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+17:12256:x1874622863716608:12345-192.168.203.31@tcp:101:bash.0 Request processed in 1128us (1296us total) trans 4294967419 rc 0/0 00000100:00100000:2.0:1787780019.367742:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 157 00000100:00100000:1.0:1787780019.376967:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787780019.377142:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863716736 00000100:00100000:2.0:1787780019.377152:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863716736 00000100:00100000:2.0:1787780019.377211:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 55 00000100:00100000:2.0:1787780019.377222:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c047798ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:2411:x1874622863716736:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:2.0:1787780019.377239:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787780019.377259:0:8427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ef76f78/0xc8fc0a51799610fe lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea1fc1 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787780019.377284:0:8427:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787780019.377317:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=427s v=(0 0) 00010000:00010000:2.0:1787780019.377322:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787780019.377333:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ef76f78/0xc8fc0a51799610fe lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1fc1 expref: 6 pid: 8427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780019.377354:0:8427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009ef76f78/0xc8fc0a51799610fe lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1fc1 expref: 6 pid: 8427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780019.377367:0:8427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0444c19600, rc 0) 00000100:00100000:2.0:1787780019.377426:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c047798ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+6:2411:x1874622863716736:12345-192.168.203.31@tcp:101:bash.0 Request processed in 205us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780019.377433:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 55 00000100:00100000:1.0:1787780019.391767:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787780019.392025:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863716864 00000100:00100000:3.0:1787780019.392035:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863716864 00000100:00100000:3.0:1787780019.392097:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 56 00000100:00100000:3.0:1787780019.392108:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c047785ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+6:12256:x1874622863716864:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:3.0:1787780019.392126:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787780019.392159:0:8430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ae9b9d28/0xc8fc0a5179961105 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea1fc8 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780019.392191:0:8430:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009ef76f78/0xc8fc0a51799610fe lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1fc1 expref: 7 pid: 8427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780019.392201:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787780019.392205:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787780019.392211:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ae9b9d28/0xc8fc0a5179961105 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1fc8 expref: 7 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780019.392243:0:8430:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009ef76f78/0xc8fc0a51799610fe lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1fc1 expref: 7 pid: 8427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780019.392257:0:8430:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009ef76f78/0xc8fc0a51799610fe lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1fc1 expref: 7 pid: 8427 timeout: 527 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787780019.392271:0:8430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348a0a580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8430:1874622881623936:192.168.203.31@tcp:104: 00000100:00100000:3.0:1787780019.392367:0:8430:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0451537840 going to sleep for 11 seconds 00000100:00100000:1.0:1787780019.403391:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787780019.403477:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863716992 00000100:00100000:0.0:1787780019.403486:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863716992 00010000:00010000:0.0:1787780019.403525:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009ef76f78/0xc8fc0a51799610fe lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1fc1 expref: 8 pid: 8427 timeout: 527 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787780019.403598:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 80 00000100:00100000:0.0:1787780019.403608:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c047785e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+8:2410:x1874622863716992:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787780019.403623:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787780019.403644:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009ef76f78/0xc8fc0a51799610fe lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1fc1 expref: 8 pid: 8427 timeout: 527 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780019.403657:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009ef76f78/0xc8fc0a51799610fe lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1fc1 expref: 8 pid: 8427 timeout: 527 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780019.403685:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787780019.403690:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787780019.403698:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ae9b9d28/0xc8fc0a5179961105 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1fc8 expref: 8 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780019.403708:0:6497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ae9b9d28/0xc8fc0a5179961105 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1fc8 expref: 8 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780019.403744:0:6497:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000ae9b9d28/0xc8fc0a5179961105 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1fc8 expref: 8 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787780019.403759:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c03489f7840 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6497:1874622881624064:192.168.203.31@tcp:105: 00000100:00100000:0.0:1787780019.403893:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0347ec6240 going to sleep for 11 seconds 00010000:00010000:3.0:1787780019.404130:0:8430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ef76f78/0xc8fc0a51799610fe lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1fc1 expref: 8 pid: 8427 timeout: 527 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787780019.404147:0:8430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348a0a580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8430:1874622881623936:192.168.203.31@tcp:104: 00010000:00010000:3.0:1787780019.404168:0:8430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ae9b9d28/0xc8fc0a5179961105 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1fc8 expref: 7 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780019.404191:0:8430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c04766dd600, rc 0) 00000100:00100000:3.0:1787780019.404220:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c047785ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+7:12256:x1874622863716864:12345-192.168.203.31@tcp:101:bash.0 Request processed in 12115us (12463us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780019.404229:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 56 00000100:00100000:0.0:1787780019.414038:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c03489f7840 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6497:1874622881624064:192.168.203.31@tcp:105: 00010000:00010000:0.0:1787780019.414082:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787780019.414139:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c047785e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+6:2410:x1874622863716992:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 10531us (10757us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780019.414150:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 80 00000100:00100000:2.0:1787780019.427532:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787780019.427636:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863717248 00000100:00100000:0.0:1787780019.427645:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863717248 00000100:00100000:0.0:1787780019.427757:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 36 00000100:00100000:0.0:1787780019.427767:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477940000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+17:12256:x1874622863717248:12345-192.168.203.31@tcp:35:bash.0 00000100:00100000:0.0:1787780019.428240:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477940000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+18:12256:x1874622863717248:12345-192.168.203.31@tcp:35:bash.0 Request processed in 472us (715us total) trans 4294967420 rc 0/0 00000100:00100000:0.0:1787780019.428248:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 36 00000100:00100000:0.0:1787780019.484105:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787780019.484128:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348a0a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881624192:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787780019.484196:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780019.485042:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881624192 00000100:00100000:3.0:1787780019.485050:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881624192 00000100:00100000:3.0:1787780019.485109:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1787780019.485119:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03489f7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881624192:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787780019.485152:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787780019.485213:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03489f7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881624192:12345-0@lo:41:osp-pre-1-0.0 Request processed in 95us (1016us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780019.485220:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1787780019.485314:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348a0a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881624192:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787780019.564977:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787780019.565070:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863717504 00000100:00100000:0.0:1787780019.565079:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863717504 00000100:00100000:0.0:1787780019.565136:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 158 00000100:00100000:0.0:1787780019.565145:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0476440000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+18:12266:x1874622863717504:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:0.0:1787780019.565166:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787780019.565185:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868400/0xc8fc0a517996110c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea1fcf expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787780019.565287:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1787780019.565371:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868400/0xc8fc0a517996110c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1fcf expref: 20 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780019.565401:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c0443d81000) 00010000:00010000:0.0:1787780019.565404:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787780019.565408:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868400/0xc8fc0a517996110c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1fcf expref: 20 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780019.565420:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0477868400, rc 0) 00000100:00100000:0.0:1787780019.565480:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0476440000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+19:12266:x1874622863717504:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 335us (511us total) trans 4294967421 rc 301/301 00000100:00100000:0.0:1787780019.565488:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 158 00000100:00100000:1.0:1787780019.570466:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787780019.570542:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863717760 00000100:00100000:2.0:1787780019.570551:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863717760 00000100:00100000:2.0:1787780019.570611:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 37 00000100:00100000:2.0:1787780019.570620:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04764430c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+19:12266:x1874622863717760:12345-192.168.203.31@tcp:35:lfs.0 00000100:00100000:2.0:1787780019.570829:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04764430c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+20:12266:x1874622863717760:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 209us (372us total) trans 4294967422 rc 0/0 00000100:00100000:2.0:1787780019.570871:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 37 00000100:00100000:2.0:1787780019.676693:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787780019.676790:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863717888 00000100:00100000:3.0:1787780019.676807:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863717888 00000100:00100000:3.0:1787780019.676880:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 159 00000100:00100000:3.0:1787780019.676891:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477af30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+20:12272:x1874622863717888:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:3.0:1787780019.676914:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787780019.676935:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd200/0xc8fc0a517996111a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea1fd6 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780019.676998:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766ddc00/0xc8fc0a5179961121 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780019.677012:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766ddc00/0xc8fc0a5179961121 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780019.677040:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766ddc00/0xc8fc0a5179961121 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787780019.677085:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1787780019.677088:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787780019.677105:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766ddc00/0xc8fc0a5179961121 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780019.677132:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd200/0xc8fc0a517996111a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1fd6 expref: 22 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780019.677150:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766ddc00/0xc8fc0a5179961121 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1fd6 expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780019.677159:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c04478d7d00) 00010000:00010000:3.0:1787780019.677162:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787780019.677165:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c04766ddc00, rc 0) 00000100:00100000:3.0:1787780019.677225:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477af30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+21:12272:x1874622863717888:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 336us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780019.677232:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 159 00000100:00100000:1.0:1787780019.681034:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787780019.681394:0:12488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863718144 00000100:00100000:3.0:1787780019.681403:0:12488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863718144 00000100:00100000:3.0:1787780019.681458:0:12488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 160 00000100:00100000:3.0:1787780019.681469:0:12488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0476443480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:781d29bb-23d2-48e3-b16d-c29e52cd5375+21:12272:x1874622863718144:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:3.0:1787780019.681488:0:12488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787780019.681507:0:12488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a5179961128 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea1fdd expref: -99 pid: 12488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780019.681648:0:12488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc600/0xc8fc0a517996112f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780019.681663:0:12488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc600/0xc8fc0a517996112f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780019.681675:0:12488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc600/0xc8fc0a517996112f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787780019.681685:0:12488:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1787780019.682399:0:12488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a5179961128 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1fdd expref: 24 pid: 12488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780019.682421:0:12488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc600/0xc8fc0a517996112f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1fdd expref: 23 pid: 12488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780019.682431:0:12488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c04478d7700) 00010000:00010000:3.0:1787780019.682434:0:12488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787780019.682437:0:12488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c04766dc600, rc 0) 00000100:00100000:3.0:1787780019.682504:0:12488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0476443480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:781d29bb-23d2-48e3-b16d-c29e52cd5375+23:12272:x1874622863718144:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 1037us (1479us total) trans 4294967423 rc 0/0 00000100:00100000:3.0:1787780019.682513:0:12488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 160 00000100:00100000:1.0:1787780019.686655:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787780019.686713:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787780019.686812:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863718400 00000100:00100000:3.0:1787780019.686821:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863718400 00000100:00100000:3.0:1787780019.686899:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 161 00000100:00100000:3.0:1787780019.686909:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0476441a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+23:12272:x1874622863718400:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:3.0:1787780019.686932:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787780019.686957:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd200/0xc8fc0a517996113d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea1fe4 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780019.687056:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dca00/0xc8fc0a5179961144 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780019.687070:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dca00/0xc8fc0a5179961144 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780019.687082:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dca00/0xc8fc0a5179961144 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787780019.687093:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1787780019.687190:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd200/0xc8fc0a517996113d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1fe4 expref: 26 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780019.687207:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dca00/0xc8fc0a5179961144 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1fe4 expref: 25 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780019.687214:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c04478d7700) 00010000:00010000:3.0:1787780019.687216:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787780019.687219:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c04766dca00, rc 0) 00000100:00100000:3.0:1787780019.687287:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0476441a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+25:12272:x1874622863718400:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 379us (641us total) trans 4294967424 rc 0/0 00000100:00100000:3.0:1787780019.687294:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 161 00000100:00100000:2.0:1787780019.688208:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863718528 00000100:00100000:2.0:1787780019.688215:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863718528 00000100:00100000:2.0:1787780019.688276:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 12 00000100:00100000:2.0:1787780019.688285:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347e54b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+25:2409:x1874622863718528:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787780019.688296:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787780019.688333:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc600/0xc8fc0a517996112f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1fdd expref: 25 pid: 12488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780019.688348:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c04478d7700) 00010000:00010000:2.0:1787780019.688352:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787780019.688394:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347e54b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+24:2409:x1874622863718528:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 111us (1681us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780019.688402:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 12 00000100:00100000:1.0:1787780019.703257:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787780019.703368:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863718656 00000100:00100000:2.0:1787780019.703377:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863718656 00000100:00100000:2.0:1787780019.703434:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 57 00000100:00100000:2.0:1787780019.703489:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347e552c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+6:2411:x1874622863718656:12345-192.168.203.31@tcp:1:lfs.0 00010000:00010000:2.0:1787780019.703535:0:8427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000680b322/0xc8fc0a5179961152 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780019.703567:0:8427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ae9b9d28/0xc8fc0a5179961105 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1fc8 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780019.703577:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787780019.703583:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787780019.703588:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000680b322/0xc8fc0a5179961152 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780019.703624:0:8427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ae9b9d28/0xc8fc0a5179961105 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1fc8 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780019.703639:0:8427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ae9b9d28/0xc8fc0a5179961105 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1fc8 expref: 6 pid: 8430 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787780019.703670:0:8427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477af2580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1874622881624320:192.168.203.31@tcp:104: 00000100:00100000:2.0:1787780019.703766:0:8427:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0346ef7c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787780019.710245:0:8427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477af2580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1874622881624320:192.168.203.31@tcp:104: 00010000:00010000:2.0:1787780019.710275:0:8427:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000680b322/0xc8fc0a5179961152 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787780019.710388:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787780019.710469:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863718784 00000100:00100000:2.0:1787780019.710476:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863718784 00002000:00100000:2.0:1787780019.710520:0:8434:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff9c0348a0b480 x1874622863718784/t0(0) o4->781d29bb-23d2-48e3-b16d-c29e52cd5375@192.168.203.31@tcp:430/0 lens 504/0 e 0 to 0 dl 1787780030 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787780019.710530:0:8434:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c0348a0b480 with x1874622863718784 ext(0->12) 00010000:00010000:2.0:1787780019.710537:0:8434:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000ae9b9d28/0xc8fc0a5179961105 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1fc8 expref: 7 pid: 8430 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780019.710551:0:8434:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000ae9b9d28/0xc8fc0a5179961105 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1fc8 expref: 7 pid: 8430 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787780019.710579:0:8434:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9c0348a0b480 00000100:00100000:2.0:1787780019.710610:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 2 00000100:00100000:2.0:1787780019.710620:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0348a0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+7:2410:x1874622863718784:12345-192.168.203.31@tcp:4:lfs.0 00000100:00100000:2.0:1787780019.712411:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0348a0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+9:2410:x1874622863718784:12345-192.168.203.31@tcp:4:lfs.0 Request processed in 1783us (2015us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1787780019.712424:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 2 00002000:00100000:2.0:1787780019.712448:0:8434:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff9c0348a0b480 x1874622863718784/t4294967306(0) o4->781d29bb-23d2-48e3-b16d-c29e52cd5375@192.168.203.31@tcp:430/0 lens 504/448 e 0 to 0 dl 1787780030 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787780019.712457:0:8434:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c0348a0b480 with x1874622863718784 ext(0->12) 00010000:00010000:2.0:1787780019.712466:0:8434:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000ae9b9d28/0xc8fc0a5179961105 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1fc8 expref: 9 pid: 8430 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780019.712481:0:8434:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000ae9b9d28/0xc8fc0a5179961105 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1fc8 expref: 9 pid: 8430 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787780019.712488:0:8434:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9c0348a0b480 00000100:00100000:1.0:1787780019.715690:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787780019.715940:0:7921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863718912 00000100:00100000:3.0:1787780019.715949:0:7921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863718912 00010000:00010000:3.0:1787780019.715991:0:7921:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ae9b9d28/0xc8fc0a5179961105 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1fc8 expref: 9 pid: 8430 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787780019.716059:0:7921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 81 00000100:00100000:3.0:1787780019.716069:0:7921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347e54780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+9:2411:x1874622863718912:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787780019.716088:0:7921:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1787780019.716108:0:7921:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1787780019.716111:0:7921:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1787780020 00002000:00010000:3.0:1787780019.716114:0:7921:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 1787780020 00002000:00010000:3.0:1787780019.716116:0:7921:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 0 -> 1787780020 00002000:00010000:3.0:1787780019.716121:0:7921:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1787780019.716127:0:7921:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ae9b9d28/0xc8fc0a5179961105 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1fc8 expref: 9 pid: 8430 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780019.716141:0:7921:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ae9b9d28/0xc8fc0a5179961105 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1fc8 expref: 9 pid: 8430 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780019.716170:0:7921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ae9b9d28/0xc8fc0a5179961105 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1fc8 expref: 9 pid: 8430 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780019.716192:0:7921:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787780019.716197:0:7921:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787780019.716202:0:7921:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000680b322/0xc8fc0a5179961152 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780019.716219:0:7921:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000680b322/0xc8fc0a5179961152 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780019.717502:0:7921:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787780019.717587:0:7921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347e54780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+8:2411:x1874622863718912:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 1514us (1902us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780019.717598:0:7921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 81 00010000:00010000:2.0:1787780019.719734:0:8427:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000680b322/0xc8fc0a5179961152 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780019.719753:0:8427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000680b322/0xc8fc0a5179961152 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780019.719794:0:8427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000680b322/0xc8fc0a5179961152 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780019.719805:0:8427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000680b322/0xc8fc0a5179961152 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780019.719812:0:8427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000680b322/0xc8fc0a5179961152 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780019.719819:0:8427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0444c19400 already unused, calling callback (ffffffffc0d97420) 00010000:00010000:2.0:1787780019.719864:0:8427:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000680b322/0xc8fc0a5179961152 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780019.719874:0:8427:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000680b322/0xc8fc0a5179961152 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780019.719893:0:8427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000680b322/0xc8fc0a5179961152 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780019.719901:0:8427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000680b322/0xc8fc0a5179961152 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787780019.719983:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347e552c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+7:2411:x1874622863718656:12345-192.168.203.31@tcp:1:lfs.0 Request processed in 16536us (16732us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780019.719993:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 57 00000100:00100000:0.0:1787780019.722948:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787780019.723076:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863719168 00000100:00100000:2.0:1787780019.723085:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863719168 00000100:00100000:2.0:1787780019.723141:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 38 00000100:00100000:2.0:1787780019.723151:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0443619450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+24:12272:x1874622863719168:12345-192.168.203.31@tcp:35:lfs.0 00000004:00010000:2.0:1787780019.723213:0:6515:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dca00/0xc8fc0a5179961144 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1fe4 expref: 24 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787780019.723395:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:2.0:1787780019.723428:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:2.0:1787780019.723701:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00010000:00010000:2.0:1787780019.723738:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18400/0xc8fc0a5179961159 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780019.723783:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19c00/0xc8fc0a51799610f0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1fba expref: 28 pid: 7821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780019.723794:0:6515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18400/0xc8fc0a5179961159 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780019.723827:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19c00/0xc8fc0a51799610f0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1fba expref: 28 pid: 7821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780019.723875:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19c00/0xc8fc0a51799610f0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1fba expref: 28 pid: 7821 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787780019.723892:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477af2580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6515:1874622881624448:192.168.203.31@tcp:104: 00000100:00100000:2.0:1787780019.723966:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0346ef7c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787780019.731477:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477af2580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6515:1874622881624448:192.168.203.31@tcp:104: 00010000:00010000:2.0:1787780019.731506:0:6515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18400/0xc8fc0a5179961159 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787780019.732985:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787780019.733090:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863719296 00000100:00100000:2.0:1787780019.733100:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863719296 00010000:00010000:2.0:1787780019.733137:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19c00/0xc8fc0a51799610f0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1fba expref: 29 pid: 7821 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787780019.733168:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 82 00000100:00100000:2.0:1787780019.733178:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0348872d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+29:2411:x1874622863719296:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787780019.733192:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787780019.733213:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19c00/0xc8fc0a51799610f0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1fba expref: 29 pid: 7821 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780019.733225:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19c00/0xc8fc0a51799610f0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1fba expref: 29 pid: 7821 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780019.733248:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19c00/0xc8fc0a51799610f0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1fba expref: 29 pid: 7821 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780019.733262:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c04478d7700) 00010000:00010000:2.0:1787780019.733266:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18400/0xc8fc0a5179961159 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780019.733274:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18400/0xc8fc0a5179961159 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780019.733281:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18400/0xc8fc0a5179961159 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780019.733320:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787780019.733375:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0348872d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+28:2411:x1874622863719296:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 199us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780019.733383:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 82 00010000:00010000:3.0:1787780019.733787:0:6515:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18400/0xc8fc0a5179961159 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780019.733806:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18400/0xc8fc0a5179961159 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787780019.733966:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000001:00080000:3.0:1787780019.734084:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:3.0:1787780019.734169:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348a08000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6515:1874622881624576:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787780019.734217:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780019.734244:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0477835b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787780019.734496:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881624576 00000100:00100000:2.0:1787780019.734502:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881624576 00000100:00100000:2.0:1787780019.734541:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1787780019.734562:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0348a0a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6515:x1874622881624576:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787780019.734645:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0348a0a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6515:x1874622881624576:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 96us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780019.734667:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00080000:1.0:1787780019.735817:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787780019.736207:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348a08000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6515:1874622881624576:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1787780019.736348:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00000100:00100000:3.0:1787780019.736414:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348a08000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6515:1874622881624704:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787780019.736460:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780019.736481:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0477835240 going to sleep for 11 seconds 00000100:00100000:1.0:1787780019.737914:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881624704 00000100:00100000:1.0:1787780019.737925:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881624704 00000100:00100000:1.0:1787780019.737981:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1787780019.737990:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0348a09e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6515:x1874622881624704:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787780019.738163:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0348a09e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6515:x1874622881624704:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 174us (1702us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1787780019.738170:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1787780019.738610:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348a08000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6515:1874622881624704:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1787780019.738667:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:3.0:1787780019.738721:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18400/0xc8fc0a5179961159 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780019.738731:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18400/0xc8fc0a5179961159 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780019.738752:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18400/0xc8fc0a5179961159 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780019.738758:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0444c18400 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:3.0:1787780019.738762:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18400/0xc8fc0a5179961159 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780019.738770:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18400/0xc8fc0a5179961159 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780019.738784:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c04478d7700) 00010000:00010000:3.0:1787780019.738787:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1787780019.738791:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18400/0xc8fc0a5179961159 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780019.738806:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18400/0xc8fc0a5179961159 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787780019.739235:0:6515:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1787780019.739296:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:3.0:1787780019.739307:0:6515:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 427743467550ns, next at 428743465112ns, rc = 0 00000001:00080000:3.0:1787780019.739313:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967432 00010000:00010000:3.0:1787780019.739337:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c04478d7700) 00010000:00010000:3.0:1787780019.739340:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787780019.739346:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dca00/0xc8fc0a5179961144 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1fe4 expref: 32 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787780019.739447:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0443619450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+31:12272:x1874622863719168:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 16297us (16506us total) trans 4294967433 rc 0/0 00000100:00100000:3.0:1787780019.739467:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 38 00000020:00080000:3.0:1787780019.739472:0:6515:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1787780019.746395:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787780019.746517:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863719424 00000100:00100000:2.0:1787780019.746527:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863719424 00000100:00100000:2.0:1787780019.746597:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 162 00000100:00100000:2.0:1787780019.746607:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0476496940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+31:12272:x1874622863719424:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:2.0:1787780019.746630:0:7821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787780019.746659:0:7821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19c00/0xc8fc0a5179961160 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea1feb expref: -99 pid: 7821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780019.746710:0:7821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19c00/0xc8fc0a5179961160 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1feb expref: 32 pid: 7821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780019.746722:0:7821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19c00/0xc8fc0a5179961160 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1feb expref: 32 pid: 7821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780019.746736:0:7821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c04478d7400) 00010000:00010000:2.0:1787780019.746739:0:7821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787780019.746741:0:7821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0444c19c00, rc 0) 00000100:00100000:2.0:1787780019.746800:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0476496940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+32:12272:x1874622863719424:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 194us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780019.746806:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 162 00000100:00100000:1.0:1787780019.750130:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787780019.750238:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863719680 00000100:00100000:0.0:1787780019.750247:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863719680 00000100:00100000:0.0:1787780019.750299:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 39 00000100:00100000:0.0:1787780019.750310:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347e55680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+32:12272:x1874622863719680:12345-192.168.203.31@tcp:35:lfs.0 00000100:00100000:0.0:1787780019.750547:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347e55680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+33:12272:x1874622863719680:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 238us (425us total) trans 4294967434 rc 0/0 00000100:00100000:0.0:1787780019.750563:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 39 00000100:00100000:0.0:1787780019.865955:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787780019.866039:0:12488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863719936 00000100:00100000:3.0:1787780019.866049:0:12488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863719936 00000100:00100000:3.0:1787780019.866117:0:12488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 163 00000100:00100000:3.0:1787780019.866126:0:12488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0476497c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:781d29bb-23d2-48e3-b16d-c29e52cd5375+33:12282:x1874622863719936:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:3.0:1787780019.866148:0:12488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787780019.866168:0:12488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dca00/0xc8fc0a5179961167 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea1ff2 expref: -99 pid: 12488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787780019.866266:0:12488:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1787780019.866362:0:12488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dca00/0xc8fc0a5179961167 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1ff2 expref: 35 pid: 12488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780019.866377:0:12488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c0443d81000) 00010000:00010000:3.0:1787780019.866380:0:12488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787780019.866385:0:12488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dca00/0xc8fc0a5179961167 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1ff2 expref: 35 pid: 12488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780019.866398:0:12488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c04766dca00, rc 0) 00000100:00100000:3.0:1787780019.866460:0:12488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0476497c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:781d29bb-23d2-48e3-b16d-c29e52cd5375+34:12282:x1874622863719936:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 335us (517us total) trans 4294967435 rc 301/301 00000100:00100000:3.0:1787780019.866467:0:12488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 163 00000100:00100000:1.0:1787780019.872654:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787780019.872790:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863720064 00000100:00100000:0.0:1787780019.872809:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863720064 00000100:00100000:0.0:1787780019.872902:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 164 00000100:00100000:0.0:1787780019.872911:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347e57c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+34:12282:x1874622863720064:12345-192.168.203.31@tcp:34:lfs.0 00010000:00010000:0.0:1787780019.872980:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869c00/0xc8fc0a5179961175 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780019.873010:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869c00/0xc8fc0a5179961175 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780019.873021:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869c00/0xc8fc0a5179961175 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780019.873033:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868800/0xc8fc0a517996117c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780019.873040:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868800/0xc8fc0a517996117c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780019.873046:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868800/0xc8fc0a517996117c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780019.873117:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868c00/0xc8fc0a5179961183 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780019.873125:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868c00/0xc8fc0a5179961183 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780019.873133:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868c00/0xc8fc0a5179961183 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787780019.873176:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868c00/0xc8fc0a5179961183 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780019.873188:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869c00/0xc8fc0a5179961175 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780019.873195:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869c00/0xc8fc0a5179961175 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780019.873211:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869c00/0xc8fc0a5179961175 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780019.873532:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0477869c00 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:0.0:1787780019.873541:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869c00/0xc8fc0a5179961175 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780019.873550:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869c00/0xc8fc0a5179961175 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780019.873572:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c04478d7d00) 00010000:00010000:0.0:1787780019.873575:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787780019.873579:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869c00/0xc8fc0a5179961175 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780019.873586:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869c00/0xc8fc0a5179961175 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780019.873599:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868800/0xc8fc0a517996117c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780019.873606:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868800/0xc8fc0a517996117c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780019.873612:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868800/0xc8fc0a517996117c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780019.873618:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0477868800 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:0.0:1787780019.873621:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868800/0xc8fc0a517996117c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780019.873640:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868800/0xc8fc0a517996117c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780019.873648:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9c04478d7500) 00010000:00010000:0.0:1787780019.873650:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787780019.873653:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868800/0xc8fc0a517996117c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780019.873660:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868800/0xc8fc0a517996117c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780019.873669:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868c00/0xc8fc0a5179961183 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780019.873676:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868c00/0xc8fc0a5179961183 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780019.875022:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868c00/0xc8fc0a5179961183 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780019.875034:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0477868c00 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:0.0:1787780019.875037:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868c00/0xc8fc0a5179961183 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780019.875045:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868c00/0xc8fc0a5179961183 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780019.875056:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c04478d7400) 00010000:00010000:0.0:1787780019.875059:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787780019.875062:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868c00/0xc8fc0a5179961183 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780019.875083:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868c00/0xc8fc0a5179961183 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787780019.875183:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347e57c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+34:12282:x1874622863720064:12345-192.168.203.31@tcp:34:lfs.0 Request processed in 2269us (2535us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780019.875193:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 164 00000100:00100000:1.0:1787780019.883008:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787780019.883080:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863720320 00000100:00100000:0.0:1787780019.883089:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863720320 00000100:00100000:0.0:1787780019.883142:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 40 00000100:00100000:0.0:1787780019.883153:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347ebe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+34:12282:x1874622863720320:12345-192.168.203.31@tcp:35:lfs.0 00000100:00100000:0.0:1787780019.883371:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347ebe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+35:12282:x1874622863720320:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 219us (371us total) trans 4294967436 rc 0/0 00000100:00100000:0.0:1787780019.883379:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 40 00000100:00100000:1.0:1787780019.963440:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787780019.963695:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863720576 00000100:00100000:2.0:1787780019.963705:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863720576 00000100:00100000:2.0:1787780019.963770:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 165 00000100:00100000:2.0:1787780019.963782:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347ebc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+35:12285:x1874622863720576:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:2.0:1787780019.963815:0:7821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787780019.963889:0:7821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19400/0xc8fc0a517996118a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea1ff9 expref: -99 pid: 7821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780019.963975:0:7821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18e00/0xc8fc0a5179961191 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780019.963989:0:7821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18e00/0xc8fc0a5179961191 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780019.963998:0:7821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18e00/0xc8fc0a5179961191 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780019.964007:0:7821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18c00/0xc8fc0a5179961198 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780019.964013:0:7821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18c00/0xc8fc0a5179961198 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780019.964018:0:7821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18c00/0xc8fc0a5179961198 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780019.964124:0:7821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18800/0xc8fc0a517996119f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780019.964133:0:7821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18800/0xc8fc0a517996119f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780019.964140:0:7821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18800/0xc8fc0a517996119f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787780019.964149:0:7821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1787780019.964221:0:7821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18e00/0xc8fc0a5179961191 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780019.964239:0:7821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18e00/0xc8fc0a5179961191 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780019.964246:0:7821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18e00/0xc8fc0a5179961191 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780019.964252:0:7821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0444c18e00 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:2.0:1787780019.964256:0:7821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18e00/0xc8fc0a5179961191 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780019.964264:0:7821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18e00/0xc8fc0a5179961191 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780019.964276:0:7821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c04478d7d00) 00010000:00010000:2.0:1787780019.964279:0:7821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787780019.964283:0:7821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18e00/0xc8fc0a5179961191 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780019.964289:0:7821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18e00/0xc8fc0a5179961191 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780019.964304:0:7821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18c00/0xc8fc0a5179961198 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780019.964309:0:7821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18c00/0xc8fc0a5179961198 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780019.964314:0:7821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18c00/0xc8fc0a5179961198 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780019.964319:0:7821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0444c18c00 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:2.0:1787780019.964329:0:7821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18c00/0xc8fc0a5179961198 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780019.964335:0:7821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18c00/0xc8fc0a5179961198 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780019.964342:0:7821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9c04478d7500) 00010000:00010000:2.0:1787780019.964345:0:7821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787780019.964347:0:7821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18c00/0xc8fc0a5179961198 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780019.964352:0:7821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18c00/0xc8fc0a5179961198 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780019.964388:0:7821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19400/0xc8fc0a517996118a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1ff9 expref: 38 pid: 7821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780019.964401:0:7821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18800/0xc8fc0a517996119f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1ff9 expref: 37 pid: 7821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780019.964408:0:7821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c04478d7400) 00010000:00010000:2.0:1787780019.964411:0:7821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787780019.964413:0:7821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0444c18800, rc 0) 00000100:00100000:2.0:1787780019.964476:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347ebc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+37:12285:x1874622863720576:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 696us (1045us total) trans 4294967437 rc 0/0 00000100:00100000:2.0:1787780019.964485:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 165 00000100:00100000:1.0:1787780019.967958:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787780019.968043:0:12488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863720704 00000100:00100000:3.0:1787780019.968053:0:12488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863720704 00000100:00100000:3.0:1787780019.968110:0:12488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 166 00000100:00100000:3.0:1787780019.968119:0:12488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347ebc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:781d29bb-23d2-48e3-b16d-c29e52cd5375+37:12285:x1874622863720704:12345-192.168.203.31@tcp:54:lfs.0 00010000:00010000:3.0:1787780019.968212:0:12488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dca00/0xc8fc0a51799611ad lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780019.968227:0:12488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dca00/0xc8fc0a51799611ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780019.968238:0:12488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dca00/0xc8fc0a51799611ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780019.968268:0:12488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dca00/0xc8fc0a51799611ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780019.968275:0:12488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dca00/0xc8fc0a51799611ad lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780019.968281:0:12488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dca00/0xc8fc0a51799611ad lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780019.968287:0:12488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c04766dca00 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:3.0:1787780019.968291:0:12488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dca00/0xc8fc0a51799611ad lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780019.968297:0:12488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dca00/0xc8fc0a51799611ad lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780019.968318:0:12488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c04478d7400) 00010000:00010000:3.0:1787780019.968322:0:12488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787780019.968327:0:12488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dca00/0xc8fc0a51799611ad lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780019.968333:0:12488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dca00/0xc8fc0a51799611ad lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787780019.968420:0:12488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347ebc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:781d29bb-23d2-48e3-b16d-c29e52cd5375+37:12285:x1874622863720704:12345-192.168.203.31@tcp:54:lfs.0 Request processed in 302us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780019.968428:0:12488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 166 00000100:00100000:1.0:1787780019.976059:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787780019.976170:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863720960 00000100:00100000:0.0:1787780019.976180:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863720960 00000100:00100000:0.0:1787780019.976237:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 41 00000100:00100000:0.0:1787780019.976246:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346d5d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+37:12285:x1874622863720960:12345-192.168.203.31@tcp:35:lfs.0 00000100:00100000:0.0:1787780019.976472:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346d5d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+38:12285:x1874622863720960:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 227us (421us total) trans 4294967438 rc 0/0 00000100:00100000:0.0:1787780019.976479:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 41 00010000:00010000:2.0:1787780020.381123:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787780020.449033:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787780020.449124:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863721216 00000100:00100000:3.0:1787780020.449134:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863721216 00000100:00100000:3.0:1787780020.449213:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 167 00000100:00100000:3.0:1787780020.449224:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04764970c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+38:12316:x1874622863721216:12345-192.168.203.31@tcp:101:cat.0 00010000:00010000:3.0:1787780020.449262:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787780020.449283:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dca00/0xc8fc0a51799611b4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea2000 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780020.449397:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd600/0xc8fc0a51799611bb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780020.449411:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd600/0xc8fc0a51799611bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780020.449424:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd600/0xc8fc0a51799611bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787780020.449435:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1787780020.449535:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dca00/0xc8fc0a51799611b4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea2000 expref: 41 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780020.449563:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd600/0xc8fc0a51799611bb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea2000 expref: 40 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780020.449572:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c04478d7400) 00010000:00010000:3.0:1787780020.449588:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787780020.449593:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c04766dd600, rc 0) 00000100:00100000:3.0:1787780020.449654:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04764970c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+40:12316:x1874622863721216:12345-192.168.203.31@tcp:101:cat.0 Request processed in 432us (629us total) trans 4294967439 rc 0/0 00000100:00100000:3.0:1787780020.449661:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 167 00000100:00080000:1.0:1787780020.449733:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787780020.454339:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787780020.454425:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863721472 00000100:00100000:0.0:1787780020.454434:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863721472 00000100:00100000:0.0:1787780020.454492:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 42 00000100:00100000:0.0:1787780020.454502:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346d5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+40:12316:x1874622863721472:12345-192.168.203.31@tcp:35:cat.0 00000100:00100000:0.0:1787780020.454767:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346d5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+41:12316:x1874622863721472:12345-192.168.203.31@tcp:35:cat.0 Request processed in 266us (437us total) trans 4294967440 rc 0/0 00000100:00100000:0.0:1787780020.454787:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 42 00000100:00100000:1.0:1787780020.455479:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787780020.455832:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863721600 00000100:00100000:2.0:1787780020.455859:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863721600 00000100:00100000:2.0:1787780020.455919:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 13 00000100:00100000:2.0:1787780020.455938:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346d5f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+41:2411:x1874622863721600:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787780020.455952:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787780020.455975:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd600/0xc8fc0a51799611bb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea2000 expref: 41 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780020.455992:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c04478d7400) 00010000:00010000:2.0:1787780020.455996:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787780020.456035:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346d5f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+40:2411:x1874622863721600:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 99us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780020.456042:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 13 00000100:00100000:1.0:1787780020.510383:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787780020.510517:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863721856 00000100:00100000:3.0:1787780020.510527:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863721856 00000100:00100000:3.0:1787780020.510597:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 168 00000100:00100000:3.0:1787780020.510608:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346d5cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+40:12322:x1874622863721856:12345-192.168.203.31@tcp:101:dd.0 00010000:00010000:3.0:1787780020.510630:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787780020.510633:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787780020.510658:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766ddc00/0xc8fc0a5179961121 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1fd6 expref: 40 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780020.510687:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c04478d7d00) 00010000:00010000:3.0:1787780020.510692:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787780020.510705:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dca00/0xc8fc0a51799611c9 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea2007 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780020.510819:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd200/0xc8fc0a51799611d0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780020.510831:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18800/0xc8fc0a517996119f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1ff9 expref: 40 pid: 7821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780020.510879:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd200/0xc8fc0a51799611d0 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780020.510908:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18800/0xc8fc0a517996119f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1ff9 expref: 40 pid: 7821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780020.510935:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18800/0xc8fc0a517996119f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1ff9 expref: 40 pid: 7821 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787780020.510948:0:6512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348a08b40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1874622881624832:192.168.203.31@tcp:104: 00000100:00100000:3.0:1787780020.511165:0:6512:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0477835840 going to sleep for 11 seconds 00000100:00100000:3.0:1787780020.524313:0:6512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348a08b40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1874622881624832:192.168.203.31@tcp:104: 00010000:00010000:3.0:1787780020.524339:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd200/0xc8fc0a51799611d0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787780020.527129:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787780020.527216:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863721984 00000100:00100000:2.0:1787780020.527225:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863721984 00010000:00010000:2.0:1787780020.527263:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18800/0xc8fc0a517996119f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1ff9 expref: 41 pid: 7821 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787780020.527310:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 83 00000100:00100000:2.0:1787780020.527322:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046099d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+41:2411:x1874622863721984:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787780020.527336:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787780020.527342:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18800/0xc8fc0a517996119f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1ff9 expref: 41 pid: 7821 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780020.527355:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18800/0xc8fc0a517996119f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1ff9 expref: 41 pid: 7821 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780020.527377:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18800/0xc8fc0a517996119f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea1ff9 expref: 41 pid: 7821 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780020.527414:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c04478d7400) 00010000:00010000:2.0:1787780020.527419:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd200/0xc8fc0a51799611d0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780020.527428:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd200/0xc8fc0a51799611d0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780020.527436:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd200/0xc8fc0a51799611d0 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780020.527467:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787780020.527533:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046099d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+40:2411:x1874622863721984:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 211us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780020.527542:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 83 00010000:00010000:3.0:1787780020.527650:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd200/0xc8fc0a51799611d0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780020.527659:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd200/0xc8fc0a51799611d0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787780020.527686:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1787780020.527815:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dca00/0xc8fc0a51799611c9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea2007 expref: 41 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780020.527830:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd200/0xc8fc0a51799611d0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea2007 expref: 40 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780020.527883:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c04478d7400) 00010000:00010000:3.0:1787780020.527886:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787780020.527889:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c04766dd200, rc 0) 00000100:00100000:3.0:1787780020.527914:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346d5cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+40:12322:x1874622863721856:12345-192.168.203.31@tcp:101:dd.0 Request processed in 17308us (17540us total) trans 4294967441 rc 0/0 00000100:00100000:3.0:1787780020.527930:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 168 00000100:00100000:0.0:1787780020.530927:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787780020.531106:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863722112 00000100:00100000:1.0:1787780020.531115:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863722112 00000100:00100000:1.0:1787780020.531166:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 169 00000100:00100000:1.0:1787780020.531176:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347fa8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+40:12322:x1874622863722112:12345-192.168.203.31@tcp:101:dd.0 00010000:00010000:1.0:1787780020.531199:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787780020.531218:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a200/0xc8fc0a51799611de lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea200e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780020.531268:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4b000/0xc8fc0a51799611e5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780020.531281:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4b000/0xc8fc0a51799611e5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780020.531302:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4b000/0xc8fc0a51799611e5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780020.531410:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a200/0xc8fc0a51799611de lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea200e expref: 42 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780020.531429:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4b000/0xc8fc0a51799611e5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea200e expref: 41 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780020.531438:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c04478d7400) 00010000:00010000:1.0:1787780020.531441:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787780020.531444:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0347e4b000, rc 0) 00000100:00100000:1.0:1787780020.531504:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347fa8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+41:12322:x1874622863722112:12345-192.168.203.31@tcp:101:dd.0 Request processed in 330us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780020.531512:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 169 00000100:00100000:0.0:1787780020.542784:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787780020.543075:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863722368 00000100:00100000:1.0:1787780020.543085:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863722368 00000100:00100000:1.0:1787780020.543148:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 170 00000100:00100000:1.0:1787780020.543158:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347fab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+41:12322:x1874622863722368:12345-192.168.203.31@tcp:36:dd.0 00010000:00010000:1.0:1787780020.543384:0:7821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a200/0xc8fc0a51799611ec lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780020.543419:0:7821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a200/0xc8fc0a51799611ec lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780020.543431:0:7821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a200/0xc8fc0a51799611ec lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787780020.543475:0:7821:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967442 00000004:00010000:1.0:1787780020.543497:0:7821:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e358903f reply state 00000000e2037154 transno 4294967443 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a200/0xc8fc0a51799611ec lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780020.543510:0:7821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a200/0xc8fc0a51799611ec lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780020.543518:0:7821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c04478d7400) 00010000:00010000:1.0:1787780020.543521:0:7821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787780020.543524:0:7821:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787780020.543623:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347fab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+44:12322:x1874622863722368:12345-192.168.203.31@tcp:36:dd.0 Request processed in 465us (848us total) trans 4294967443 rc 0/0 00000100:00100000:1.0:1787780020.543631:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 170 00000020:00080000:1.0:1787780020.543636:0:7821:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787780021.000131:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787780021.000212:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863722496 00000100:00100000:3.0:1787780021.000223:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863722496 00000100:00100000:3.0:1787780021.000297:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 171 00000100:00100000:3.0:1787780021.000308:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347fab0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+44:12336:x1874622863722496:12345-192.168.203.31@tcp:101:stat.0 00010000:00010000:3.0:1787780021.000329:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787780021.000349:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dca00/0xc8fc0a51799611f3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea2015 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780021.000416:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766ddc00/0xc8fc0a51799611fa lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780021.000430:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766ddc00/0xc8fc0a51799611fa lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780021.000441:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766ddc00/0xc8fc0a51799611fa lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780021.000450:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc200/0xc8fc0a5179961201 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780021.000456:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc200/0xc8fc0a5179961201 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780021.000463:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc200/0xc8fc0a5179961201 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780021.000529:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a5179961208 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780021.000575:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd200/0xc8fc0a51799611d0 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea2007 expref: 45 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780021.000585:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a5179961208 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780021.000617:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd200/0xc8fc0a51799611d0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea2007 expref: 45 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780021.000631:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd200/0xc8fc0a51799611d0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea2007 expref: 45 pid: 6512 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787780021.000645:0:6512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348a08b40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1874622881624960:192.168.203.31@tcp:104: 00000100:00100000:3.0:1787780021.001198:0:6512:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0477835840 going to sleep for 11 seconds 00000100:00100000:0.0:1787780021.007120:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787780021.007292:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863722752 00000100:00100000:1.0:1787780021.007300:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863722752 00000100:00100000:1.0:1787780021.007347:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 43 00000100:00100000:1.0:1787780021.007354:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347fa9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+46:6177:x1874622863722752:12345-192.168.203.31@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1787780021.007639:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347fa9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+47:6177:x1874622863722752:12345-192.168.203.31@tcp:35:ldlm_bl.0 Request processed in 284us (528us total) trans 4294967444 rc 0/0 00000100:00100000:1.0:1787780021.007647:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 43 00000100:00100000:3.0:1787780021.008522:0:6512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348a08b40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1874622881624960:192.168.203.31@tcp:104: 00010000:00010000:3.0:1787780021.008556:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a5179961208 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787780021.020698:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787780021.020763:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863722880 00000100:00100000:2.0:1787780021.020783:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863722880 00010000:00010000:2.0:1787780021.020832:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd200/0xc8fc0a51799611d0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea2007 expref: 47 pid: 6512 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787780021.020914:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 84 00000100:00100000:2.0:1787780021.020924:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04812a8f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+47:2410:x1874622863722880:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787780021.020937:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787780021.020942:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd200/0xc8fc0a51799611d0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea2007 expref: 47 pid: 6512 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780021.020952:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd200/0xc8fc0a51799611d0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea2007 expref: 47 pid: 6512 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780021.020982:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd200/0xc8fc0a51799611d0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea2007 expref: 47 pid: 6512 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780021.020993:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c04478d7400) 00010000:00010000:2.0:1787780021.020997:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a5179961208 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780021.021003:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a5179961208 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780021.021008:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a5179961208 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780021.021032:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787780021.021067:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a5179961208 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780021.021075:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a5179961208 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787780021.021091:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04812a8f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+46:2410:x1874622863722880:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 169us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780021.021097:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 84 00000004:00200000:0.0:1787780021.021125:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:0.0:1787780021.021129:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787780021.021152:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a5179961208 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780021.021164:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a5179961208 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780021.021174:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766ddc00/0xc8fc0a51799611fa lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780021.021181:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766ddc00/0xc8fc0a51799611fa lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780021.021192:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766ddc00/0xc8fc0a51799611fa lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780021.021208:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c04766ddc00 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:0.0:1787780021.021212:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766ddc00/0xc8fc0a51799611fa lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780021.021218:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766ddc00/0xc8fc0a51799611fa lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780021.021227:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c04478d7d00) 00010000:00010000:0.0:1787780021.021230:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787780021.021234:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766ddc00/0xc8fc0a51799611fa lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780021.021239:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766ddc00/0xc8fc0a51799611fa lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780021.021249:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc200/0xc8fc0a5179961201 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780021.021254:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc200/0xc8fc0a5179961201 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780021.021259:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc200/0xc8fc0a5179961201 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780021.021263:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c04766dc200 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:0.0:1787780021.021265:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc200/0xc8fc0a5179961201 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780021.021270:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc200/0xc8fc0a5179961201 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780021.021287:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9c04478d7500) 00010000:00010000:0.0:1787780021.021289:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787780021.021292:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc200/0xc8fc0a5179961201 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780021.021298:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc200/0xc8fc0a5179961201 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780021.021328:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dca00/0xc8fc0a51799611f3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea2015 expref: 46 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780021.021340:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a5179961208 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea2015 expref: 45 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780021.021348:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c04478d7400) 00010000:00010000:0.0:1787780021.021350:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787780021.021353:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c04766dc400, rc 0) 00000100:00100000:0.0:1787780021.021395:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347fab0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+45:12336:x1874622863722496:12345-192.168.203.31@tcp:101:stat.0 Request processed in 21088us (21272us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780021.021402:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 171 00000100:00100000:0.0:1787780021.106290:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787780021.107242:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863723136 00000100:00100000:3.0:1787780021.107252:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863723136 00000100:00100000:3.0:1787780021.107314:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 172 00000100:00100000:3.0:1787780021.107324:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04812aa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+45:12342:x1874622863723136:12345-192.168.203.31@tcp:36:truncate.0 00010000:00010000:3.0:1787780021.107379:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787780021.107404:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a5179961208 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea2015 expref: 45 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780021.107442:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c04478d7400) 00010000:00010000:3.0:1787780021.107448:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787780021.107620:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dca00/0xc8fc0a517996120f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780021.107634:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dca00/0xc8fc0a517996120f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780021.107644:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dca00/0xc8fc0a517996120f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787780021.107680:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967445 00000004:00010000:3.0:1787780021.107697:0:6513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007d44b211 reply state 00000000376a80f2 transno 4294967446 ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dca00/0xc8fc0a517996120f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780021.107708:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dca00/0xc8fc0a517996120f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780021.107714:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c04478d7400) 00010000:00010000:3.0:1787780021.107717:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787780021.107719:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787780021.107800:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04812aa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+47:12342:x1874622863723136:12345-192.168.203.31@tcp:36:truncate.0 Request processed in 477us (1519us total) trans 4294967446 rc 0/0 00000100:00100000:3.0:1787780021.107808:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 172 00000020:00080000:3.0:1787780021.107813:0:6513:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787780021.286588:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787780021.286673:0:12488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863723264 00000100:00100000:3.0:1787780021.286683:0:12488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863723264 00000100:00100000:3.0:1787780021.286742:0:12488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 173 00000100:00100000:3.0:1787780021.286752:0:12488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346d5e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:781d29bb-23d2-48e3-b16d-c29e52cd5375+47:12357:x1874622863723264:12345-192.168.203.31@tcp:101:stat.0 00010000:00010000:3.0:1787780021.286794:0:12488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787780021.286817:0:12488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a5179961216 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea201c expref: -99 pid: 12488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780021.286916:0:12488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc200/0xc8fc0a517996121d lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780021.286931:0:12488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc200/0xc8fc0a517996121d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780021.286942:0:12488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc200/0xc8fc0a517996121d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780021.286953:0:12488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd200/0xc8fc0a5179961224 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780021.286960:0:12488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd200/0xc8fc0a5179961224 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780021.286967:0:12488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd200/0xc8fc0a5179961224 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780021.287044:0:12488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766ddc00/0xc8fc0a517996122b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780021.287053:0:12488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766ddc00/0xc8fc0a517996122b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780021.287060:0:12488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766ddc00/0xc8fc0a517996122b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787780021.287103:0:12488:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00000004:00200000:3.0:1787780021.287112:0:12488:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787780021.287134:0:12488:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766ddc00/0xc8fc0a517996122b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780021.287145:0:12488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766ddc00/0xc8fc0a517996122b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780021.287162:0:12488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc200/0xc8fc0a517996121d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780021.287169:0:12488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc200/0xc8fc0a517996121d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780021.287176:0:12488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc200/0xc8fc0a517996121d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780021.287182:0:12488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c04766dc200 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:3.0:1787780021.287185:0:12488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc200/0xc8fc0a517996121d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780021.287194:0:12488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc200/0xc8fc0a517996121d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780021.287205:0:12488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c04478d7d00) 00010000:00010000:3.0:1787780021.287209:0:12488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787780021.287214:0:12488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc200/0xc8fc0a517996121d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780021.287221:0:12488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc200/0xc8fc0a517996121d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780021.287235:0:12488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd200/0xc8fc0a5179961224 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780021.287251:0:12488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd200/0xc8fc0a5179961224 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780021.287257:0:12488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd200/0xc8fc0a5179961224 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780021.287261:0:12488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c04766dd200 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:3.0:1787780021.287264:0:12488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd200/0xc8fc0a5179961224 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780021.287270:0:12488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd200/0xc8fc0a5179961224 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780021.287279:0:12488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9c04478d7500) 00010000:00010000:3.0:1787780021.287281:0:12488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787780021.287285:0:12488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd200/0xc8fc0a5179961224 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780021.287291:0:12488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd200/0xc8fc0a5179961224 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780021.287317:0:12488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a5179961216 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea201c expref: 49 pid: 12488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780021.287331:0:12488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766ddc00/0xc8fc0a517996122b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea201c expref: 48 pid: 12488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780021.287338:0:12488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c04478d7400) 00010000:00010000:3.0:1787780021.287341:0:12488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787780021.287350:0:12488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c04766ddc00, rc 0) 00000100:00100000:3.0:1787780021.287425:0:12488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346d5e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:781d29bb-23d2-48e3-b16d-c29e52cd5375+48:12357:x1874622863723264:12345-192.168.203.31@tcp:101:stat.0 Request processed in 674us (846us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780021.287433:0:12488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 173 00010000:00010000:3.0:1787780021.404268:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787780021.410719:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787780021.411061:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863723520 00000100:00100000:3.0:1787780021.411132:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863723520 00000100:00100000:3.0:1787780021.411258:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 174 00000100:00100000:3.0:1787780021.411269:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04812aad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+48:12367:x1874622863723520:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:3.0:1787780021.411289:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787780021.411309:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a5179961232 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea2023 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787780021.411584:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1787780021.411679:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a5179961232 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea2023 expref: 50 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780021.411693:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c0443d81000) 00010000:00010000:3.0:1787780021.411695:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787780021.411700:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a5179961232 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea2023 expref: 50 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780021.411713:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c04766dc400, rc 0) 00000100:00100000:3.0:1787780021.412749:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04812aad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+49:12367:x1874622863723520:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 1477us (2033us total) trans 4294967447 rc 301/301 00000100:00100000:3.0:1787780021.412758:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 174 00000100:00100000:3.0:1787780021.419341:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787780021.426207:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863723776 00000100:00100000:1.0:1787780021.426277:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863723776 00000100:00100000:1.0:1787780021.426878:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 44 00000100:00100000:1.0:1787780021.426901:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0443618c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+49:12367:x1874622863723776:12345-192.168.203.31@tcp:35:lfs.0 00000100:00100000:1.0:1787780021.427136:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0443618c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+50:12367:x1874622863723776:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 248us (7812us total) trans 4294967448 rc 0/0 00000100:00100000:1.0:1787780021.427144:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 44 00000100:00100000:2.0:1787780021.532194:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787780021.532217:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348a08b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881625088:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787780021.532281:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780021.532397:0:8529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881625088 00000100:00100000:3.0:1787780021.532428:0:8529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881625088 00000100:00100000:3.0:1787780021.532492:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1787780021.532502:0:8529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477af2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881625088:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787780021.532533:0:8529:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1787780021.532591:0:8529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477af2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881625088:12345-0@lo:13:osp-pre-1-1.0 Request processed in 90us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780021.532598:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1787780021.532642:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348a08b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881625088:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1787780021.534587:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787780021.535016:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c048134a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881625472:0@lo:400:kworker.0 00000100:00100000:0.0:1787780021.535094:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780021.535338:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477af3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1f575176-36bc-4786-83ee-2fea064a12a9:3641:1874622881625216:0@lo:400:kworker.0 00000100:00100000:1.0:1787780021.535377:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780021.535406:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787780021.535535:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881625216 00000100:00100000:3.0:1787780021.535554:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881625216 00000100:00100000:3.0:1787780021.535595:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 398 00000100:00100000:3.0:1787780021.535604:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471776050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+24:3641:x1874622881625216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787780021.535649:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471776050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+24:3641:x1874622881625216:12345-0@lo:400:kworker.0 Request processed in 46us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780021.535656:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 398 00000100:00100000:3.0:1787780021.535703:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881625472 00000100:00100000:3.0:1787780021.535708:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881625472 00000100:00100000:3.0:1787780021.535733:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1787780021.535740:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346cff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881625472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787780021.535992:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477af2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874622881625344:0@lo:400:kworker.0 00000100:00100000:1.0:1787780021.536023:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780021.536054:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477af3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1f575176-36bc-4786-83ee-2fea064a12a9:3641:1874622881625216:0@lo:400:kworker.0 00000100:00100000:1.0:1787780021.536097:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881625344 00000100:00100000:1.0:1787780021.536101:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881625344 00000100:00100000:1.0:1787780021.536130:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:1.0:1787780021.536974:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346d5d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874622881625344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787780021.537025:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346d5d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874622881625344:12345-0@lo:400:kworker.0 Request processed in 889us (1001us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780021.537033:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00100000:1.0:1787780021.537071:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477af2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874622881625344:0@lo:400:kworker.0 00000100:00100000:1.0:1787780021.537112:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047785e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874622881625600:0@lo:400:kworker.0 00000100:00100000:1.0:1787780021.537334:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780021.537383:0:12488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881625600 00000100:00100000:1.0:1787780021.537401:0:12488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881625600 00000100:00100000:1.0:1787780021.537444:0:12488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 375 00000100:00100000:1.0:1787780021.537451:0:12488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346d5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1874622881625600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787780021.537487:0:12488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346d5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1874622881625600:12345-0@lo:400:kworker.0 Request processed in 37us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780021.537493:0:12488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 375 00000100:00100000:1.0:1787780021.537518:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047785e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874622881625600:0@lo:400:kworker.0 00000100:00100000:2.0:1787780021.539852:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347e55680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1874622881625856:0@lo:400:kworker.0 00000100:00100000:2.0:1787780021.539929:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787780021.539958:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347ee0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1874622881626368:0@lo:400:kworker.0 00000100:00100000:2.0:1787780021.539991:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787780021.540010:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787780021.540015:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047785e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881625728:0@lo:400:kworker.0 00000100:00100000:2.0:1787780021.540051:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787780021.541511:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348872d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881626240:0@lo:400:kworker.0 00000100:00100000:2.0:1787780021.541607:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787780021.541649:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881626240 00000100:00100000:2.0:1787780021.541656:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881626240 00000100:00100000:2.0:1787780021.541705:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1787780021.541713:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347e59e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3642:x1874622881626240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787780021.541757:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347e59e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3642:x1874622881626240:12345-0@lo:400:kworker.0 Request processed in 45us (151us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780021.541763:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00080000:1.0:1787780021.541950:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787780021.541965:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347e54780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881626112:0@lo:400:kworker.0 00000100:00100000:1.0:1787780021.542388:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780021.542423:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c048131da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881626624:0@lo:400:kworker.0 00000100:00100000:2.0:1787780021.542581:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881625728 00000100:00100000:2.0:1787780021.542587:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881625728 00000100:00100000:2.0:1787780021.542616:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1787780021.542622:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347e5a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1874622881625728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787780021.542659:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347e5a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1874622881625728:12345-0@lo:400:kworker.0 Request processed in 37us (2607us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780021.542670:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1787780021.542704:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047785e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881625728:0@lo:400:kworker.0 00000100:00100000:2.0:1787780021.542714:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348872d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881626240:0@lo:400:kworker.0 00000100:00100000:2.0:1787780021.542855:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881625856 00000100:00100000:2.0:1787780021.542860:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881625856 00000100:00100000:2.0:1787780021.542891:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881626368 00000100:00100000:2.0:1787780021.542905:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881626368 00000100:00100000:2.0:1787780021.542928:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:2.0:1787780021.542934:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04618e8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1874622881625856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787780021.542973:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04618e8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1874622881625856:12345-0@lo:400:kworker.0 Request processed in 39us (3043us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780021.542979:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00100000:2.0:1787780021.543006:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00000100:00100000:2.0:1787780021.543012:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04618eb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1874622881626368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787780021.543058:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04618eb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1874622881626368:12345-0@lo:400:kworker.0 Request processed in 46us (3068us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780021.543064:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00000100:00100000:1.0:1787780021.543423:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780021.544054:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787780021.544064:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347e54b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1874622881625984:0@lo:400:kworker.0 00000100:00100000:1.0:1787780021.544537:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780021.544574:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347ee2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1874622881626496:0@lo:400:kworker.0 00000100:00100000:1.0:1787780021.544598:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780021.544640:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881626112 00000100:00100000:1.0:1787780021.544646:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881626112 00000100:00100000:1.0:1787780021.544682:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881626624 00000100:00100000:1.0:1787780021.544686:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881626624 00000100:00100000:1.0:1787780021.544710:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1787780021.544718:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346d5c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881626112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787780021.544760:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346d5c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881626112:12345-0@lo:400:kworker.0 Request processed in 43us (2372us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780021.544767:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1787780021.544930:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1787780021.544938:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346d5fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881626624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787780021.544971:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346d5fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881626624:12345-0@lo:400:kworker.0 Request processed in 34us (1559us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780021.544977:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00080000:1.0:1787780021.544994:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787780021.544997:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787780021.544999:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787780021.545034:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347e54780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881626112:0@lo:400:kworker.0 00000100:00100000:1.0:1787780021.545060:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c048131da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881626624:0@lo:400:kworker.0 00000100:00100000:2.0:1787780021.545384:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347e55680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1874622881625856:0@lo:400:kworker.0 00000100:00100000:2.0:1787780021.545401:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347ee0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1874622881626368:0@lo:400:kworker.0 00000100:00100000:2.0:1787780021.545434:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881625984 00000100:00100000:2.0:1787780021.545437:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881625984 00000100:00100000:2.0:1787780021.545463:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881626496 00000100:00100000:2.0:1787780021.545466:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881626496 00000100:00100000:2.0:1787780021.545478:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:2.0:1787780021.545483:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346d5cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874622881625984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787780021.545516:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346d5cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874622881625984:12345-0@lo:400:kworker.0 Request processed in 33us (989us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780021.545522:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00100000:2.0:1787780021.545533:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 379 00000100:00100000:2.0:1787780021.545551:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346d5f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1874622881626496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787780021.545578:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346d5f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1874622881626496:12345-0@lo:400:kworker.0 Request processed in 39us (980us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780021.545583:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 379 00010000:00080000:1.0:1787780021.546240:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0347e54b40 x1874622881625984/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787780037 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787780021.546253:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347e54b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1874622881625984:0@lo:400:kworker.0 00010000:00080000:1.0:1787780021.546263:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0347ee2940 x1874622881626496/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787780037 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787780021.546271:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347ee2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1874622881626496:0@lo:400:kworker.0 00000100:00080000:1.0:1787780021.546292:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787780021.551626:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346cff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881625472:12345-0@lo:400:kworker.0 Request processed in 15875us (16520us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780021.551642:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1787780021.552509:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c048134a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881625472:0@lo:400:kworker.0 00000100:00100000:1.0:1787780021.566360:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787780021.567083:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863724032 00000100:00100000:2.0:1787780021.567094:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863724032 00000100:00100000:2.0:1787780021.567276:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 175 00000100:00100000:2.0:1787780021.567286:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c048131da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+50:12373:x1874622863724032:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:2.0:1787780021.567310:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787780021.567344:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18800/0xc8fc0a5179961240 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea202a expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780021.567523:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19400/0xc8fc0a5179961247 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780021.567549:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766ddc00/0xc8fc0a517996122b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea201c expref: 51 pid: 12488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780021.567559:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19400/0xc8fc0a5179961247 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780021.567592:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766ddc00/0xc8fc0a517996122b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea201c expref: 51 pid: 12488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780021.567606:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766ddc00/0xc8fc0a517996122b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea201c expref: 51 pid: 12488 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787780021.567619:0:6512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347e58000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1874622881626752:192.168.203.31@tcp:104: 00000100:00100000:2.0:1787780021.567717:0:6512:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0346ef7600 going to sleep for 11 seconds 00000100:00100000:0.0:1787780021.577341:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787780021.578080:0:6512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347e58000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1874622881626752:192.168.203.31@tcp:104: 00010000:00010000:2.0:1787780021.578107:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19400/0xc8fc0a5179961247 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787780021.579647:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863724160 00000100:00100000:1.0:1787780021.579659:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863724160 00010000:00010000:1.0:1787780021.579705:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766ddc00/0xc8fc0a517996122b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea201c expref: 52 pid: 12488 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787780021.579818:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 85 00000100:00100000:1.0:1787780021.579829:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346cff0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+52:2411:x1874622863724160:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787780021.579970:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787780021.579977:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766ddc00/0xc8fc0a517996122b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea201c expref: 52 pid: 12488 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780021.579990:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766ddc00/0xc8fc0a517996122b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea201c expref: 52 pid: 12488 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780021.580012:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766ddc00/0xc8fc0a517996122b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea201c expref: 52 pid: 12488 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780021.580027:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c04478d7400) 00010000:00010000:1.0:1787780021.580031:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19400/0xc8fc0a5179961247 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780021.580041:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19400/0xc8fc0a5179961247 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780021.580048:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19400/0xc8fc0a5179961247 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780021.580083:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787780021.580140:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346cff0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+51:2411:x1874622863724160:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 312us (2810us total) trans 0 rc 0/0 00010000:00010000:3.0:1787780021.580637:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19400/0xc8fc0a5179961247 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780021.580645:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19400/0xc8fc0a5179961247 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787780021.580674:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00000100:00100000:1.0:1787780021.580791:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 85 00010000:00010000:3.0:1787780021.581015:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18800/0xc8fc0a5179961240 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea202a expref: 52 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780021.581033:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19400/0xc8fc0a5179961247 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea202a expref: 51 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780021.581042:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c04478d7400) 00010000:00010000:3.0:1787780021.581044:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787780021.581047:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0444c19400, rc 0) 00000100:00100000:3.0:1787780021.581327:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c048131da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+51:12373:x1874622863724032:12345-192.168.203.31@tcp:101:bash.0 Request processed in 14041us (14974us total) trans 4294967449 rc 0/0 00000100:00100000:3.0:1787780021.581335:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 175 00000100:00100000:0.0:1787780021.595625:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787780021.595754:0:12488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863724416 00000100:00100000:1.0:1787780021.595765:0:12488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863724416 00000100:00100000:1.0:1787780021.596262:0:12488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 176 00000100:00100000:1.0:1787780021.596273:0:12488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346cfe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:781d29bb-23d2-48e3-b16d-c29e52cd5375+51:12373:x1874622863724416:12345-192.168.203.31@tcp:36:bash.0 00010000:00010000:1.0:1787780021.597375:0:12488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a600/0xc8fc0a5179961255 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780021.597399:0:12488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a600/0xc8fc0a5179961255 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780021.597422:0:12488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a600/0xc8fc0a5179961255 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787780021.597479:0:12488:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967450 00000004:00010000:1.0:1787780021.597503:0:12488:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007ee0f843 reply state 00000000a81fb67e transno 4294967451 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a600/0xc8fc0a5179961255 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780021.597516:0:12488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a600/0xc8fc0a5179961255 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780021.597524:0:12488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c04478d7400) 00010000:00010000:1.0:1787780021.597526:0:12488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787780021.597530:0:12488:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787780021.597681:0:12488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346cfe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:781d29bb-23d2-48e3-b16d-c29e52cd5375+54:12373:x1874622863724416:12345-192.168.203.31@tcp:36:bash.0 Request processed in 1408us (2063us total) trans 4294967451 rc 0/0 00000100:00100000:1.0:1787780021.597690:0:12488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 176 00000020:00080000:1.0:1787780021.597694:0:12488:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787780021.604471:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787780021.604594:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863724544 00000100:00100000:1.0:1787780021.604604:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863724544 00000100:00100000:1.0:1787780021.604666:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 177 00000100:00100000:1.0:1787780021.604677:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346cfc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+54:12373:x1874622863724544:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:1.0:1787780021.604700:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787780021.604721:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4b800/0xc8fc0a517996125c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea2031 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780021.605340:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a000/0xc8fc0a5179961263 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780021.605357:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19400/0xc8fc0a5179961247 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea202a expref: 55 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780021.605364:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a000/0xc8fc0a5179961263 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780021.605398:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19400/0xc8fc0a5179961247 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea202a expref: 55 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780021.605421:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19400/0xc8fc0a5179961247 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea202a expref: 55 pid: 6512 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787780021.605639:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477af2940 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1874622881626880:192.168.203.31@tcp:104: 00000100:00100000:1.0:1787780021.605877:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c04764c5540 going to sleep for 11 seconds 00000100:00100000:0.0:1787780021.611719:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787780021.612164:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863724672 00000100:00100000:2.0:1787780021.612173:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863724672 00010000:00010000:2.0:1787780021.612212:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19400/0xc8fc0a5179961247 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea202a expref: 56 pid: 6512 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787780021.612278:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 86 00000100:00100000:2.0:1787780021.612287:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346cffc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+56:2410:x1874622863724672:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787780021.612302:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787780021.612309:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19400/0xc8fc0a5179961247 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea202a expref: 56 pid: 6512 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780021.612320:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19400/0xc8fc0a5179961247 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea202a expref: 56 pid: 6512 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780021.612353:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c04478d7400) 00010000:00010000:2.0:1787780021.612358:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a000/0xc8fc0a5179961263 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780021.612367:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a000/0xc8fc0a5179961263 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780021.612375:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a000/0xc8fc0a5179961263 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780021.612396:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787780021.612564:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346cffc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+56:2410:x1874622863724672:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 277us (853us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780021.612573:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 86 00010000:00010000:1.0:1787780021.613660:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19400/0xc8fc0a5179961247 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea202a expref: 55 pid: 6512 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787780021.613681:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477af2940 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1874622881626880:192.168.203.31@tcp:104: 00010000:00010000:1.0:1787780021.613705:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a000/0xc8fc0a5179961263 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780021.613715:0:6513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a000/0xc8fc0a5179961263 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780021.613739:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a000/0xc8fc0a5179961263 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787780021.614096:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:1.0:1787780021.614101:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787780021.614124:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a000/0xc8fc0a5179961263 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780021.614169:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4b800/0xc8fc0a517996125c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea2031 expref: 55 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780021.614186:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a000/0xc8fc0a5179961263 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea2031 expref: 54 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780021.614195:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c04478d7400) 00010000:00010000:1.0:1787780021.614198:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787780021.614201:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0347e4a000, rc 0) 00000100:00100000:1.0:1787780021.614263:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346cfc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+54:12373:x1874622863724544:12345-192.168.203.31@tcp:101:bash.0 Request processed in 9587us (9810us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780021.614271:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 177 00000100:00100000:0.0:1787780021.625994:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787780021.626673:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863724928 00000100:00100000:2.0:1787780021.626684:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863724928 00000100:00100000:2.0:1787780021.626742:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 45 00000100:00100000:2.0:1787780021.626752:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346cfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+54:12373:x1874622863724928:12345-192.168.203.31@tcp:35:bash.0 00000100:00100000:2.0:1787780021.627232:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346cfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+55:12373:x1874622863724928:12345-192.168.203.31@tcp:35:bash.0 Request processed in 479us (1258us total) trans 4294967452 rc 0/0 00000100:00100000:2.0:1787780021.627242:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 45 00000100:00100000:2.0:1787780021.752365:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787780021.753020:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863725184 00000100:00100000:3.0:1787780021.753030:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863725184 00000100:00100000:3.0:1787780021.753093:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 178 00000100:00100000:3.0:1787780021.753102:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347e58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+55:12383:x1874622863725184:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:3.0:1787780021.753125:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787780021.753146:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a517996126a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea2038 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787780021.753246:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1787780021.753675:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a517996126a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea2038 expref: 57 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780021.753691:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c0443d81000) 00010000:00010000:3.0:1787780021.753706:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787780021.753713:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a517996126a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea2038 expref: 57 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780021.753727:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c04766dc400, rc 0) 00000100:00100000:3.0:1787780021.754196:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347e58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+56:12383:x1874622863725184:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 1093us (1838us total) trans 4294967453 rc 301/301 00000100:00100000:3.0:1787780021.754205:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 178 00000100:00100000:0.0:1787780021.758712:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787780021.760278:0:12488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863725312 00000100:00100000:0.0:1787780021.760292:0:12488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863725312 00000100:00100000:0.0:1787780021.760361:0:12488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 179 00000100:00100000:0.0:1787780021.760371:0:12488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346cfd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:781d29bb-23d2-48e3-b16d-c29e52cd5375+56:12383:x1874622863725312:12345-192.168.203.31@tcp:34:lfs.0 00010000:00010000:0.0:1787780021.760458:0:12488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868200/0xc8fc0a5179961278 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780021.760474:0:12488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868200/0xc8fc0a5179961278 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780021.760485:0:12488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868200/0xc8fc0a5179961278 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780021.760496:0:12488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868e00/0xc8fc0a517996127f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780021.760503:0:12488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868e00/0xc8fc0a517996127f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780021.760509:0:12488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868e00/0xc8fc0a517996127f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780021.760591:0:12488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869200/0xc8fc0a5179961286 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780021.760601:0:12488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869200/0xc8fc0a5179961286 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780021.760622:0:12488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869200/0xc8fc0a5179961286 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787780021.760666:0:12488:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869200/0xc8fc0a5179961286 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780021.760678:0:12488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868200/0xc8fc0a5179961278 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780021.760684:0:12488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868200/0xc8fc0a5179961278 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780021.760690:0:12488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868200/0xc8fc0a5179961278 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780021.760696:0:12488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0477868200 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:0.0:1787780021.760699:0:12488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868200/0xc8fc0a5179961278 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780021.760707:0:12488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868200/0xc8fc0a5179961278 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780021.760717:0:12488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c04478d7d00) 00010000:00010000:0.0:1787780021.760720:0:12488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787780021.760724:0:12488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868200/0xc8fc0a5179961278 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780021.760730:0:12488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868200/0xc8fc0a5179961278 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780021.760740:0:12488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868e00/0xc8fc0a517996127f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780021.760752:0:12488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868e00/0xc8fc0a517996127f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780021.760757:0:12488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868e00/0xc8fc0a517996127f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780021.760762:0:12488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0477868e00 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:0.0:1787780021.760765:0:12488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868e00/0xc8fc0a517996127f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780021.760771:0:12488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868e00/0xc8fc0a517996127f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780021.760778:0:12488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9c04478d7500) 00010000:00010000:0.0:1787780021.760882:0:12488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787780021.760887:0:12488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868e00/0xc8fc0a517996127f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780021.760894:0:12488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868e00/0xc8fc0a517996127f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780021.760905:0:12488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869200/0xc8fc0a5179961286 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780021.760911:0:12488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869200/0xc8fc0a5179961286 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780021.760916:0:12488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869200/0xc8fc0a5179961286 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780021.760921:0:12488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0477869200 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:0.0:1787780021.760931:0:12488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869200/0xc8fc0a5179961286 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780021.760938:0:12488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869200/0xc8fc0a5179961286 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780021.760946:0:12488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c04478d7400) 00010000:00010000:0.0:1787780021.760949:0:12488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787780021.760952:0:12488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869200/0xc8fc0a5179961286 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780021.760957:0:12488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869200/0xc8fc0a5179961286 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787780021.761071:0:12488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346cfd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:781d29bb-23d2-48e3-b16d-c29e52cd5375+56:12383:x1874622863725312:12345-192.168.203.31@tcp:34:lfs.0 Request processed in 701us (2367us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780021.761081:0:12488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 179 00000100:00100000:0.0:1787780021.764135:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787780021.764221:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863725568 00000100:00100000:2.0:1787780021.764230:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863725568 00000100:00100000:2.0:1787780021.764289:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 46 00000100:00100000:2.0:1787780021.764300:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346cfed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+56:12383:x1874622863725568:12345-192.168.203.31@tcp:35:lfs.0 00000100:00100000:2.0:1787780021.764812:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346cfed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+57:12383:x1874622863725568:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 512us (685us total) trans 4294967454 rc 0/0 00000100:00100000:2.0:1787780021.764821:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 46 00000100:00100000:2.0:1787780021.823124:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787780021.823523:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863725824 00000100:00100000:1.0:1787780021.823533:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863725824 00000100:00100000:1.0:1787780021.823642:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 180 00000100:00100000:1.0:1787780021.823653:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347e5bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+57:12386:x1874622863725824:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:1.0:1787780021.823676:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787780021.823698:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4b800/0xc8fc0a517996128d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea203f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780021.823898:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4b400/0xc8fc0a5179961294 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780021.823913:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4b400/0xc8fc0a5179961294 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780021.823924:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4b400/0xc8fc0a5179961294 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780021.823936:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4b600/0xc8fc0a517996129b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780021.823943:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4b600/0xc8fc0a517996129b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780021.823950:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4b600/0xc8fc0a517996129b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780021.824067:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4ba00/0xc8fc0a51799612a2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780021.824077:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4ba00/0xc8fc0a51799612a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780021.824084:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4ba00/0xc8fc0a51799612a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787780021.824092:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:1.0:1787780021.824164:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4b400/0xc8fc0a5179961294 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780021.824172:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4b400/0xc8fc0a5179961294 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780021.824185:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4b400/0xc8fc0a5179961294 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780021.824192:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0347e4b400 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:1.0:1787780021.824196:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4b400/0xc8fc0a5179961294 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780021.824204:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4b400/0xc8fc0a5179961294 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780021.824216:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c04478d7d00) 00010000:00010000:1.0:1787780021.824219:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787780021.824223:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4b400/0xc8fc0a5179961294 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780021.824229:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4b400/0xc8fc0a5179961294 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780021.824243:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4b600/0xc8fc0a517996129b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780021.824249:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4b600/0xc8fc0a517996129b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780021.824255:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4b600/0xc8fc0a517996129b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780021.824260:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0347e4b600 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:1.0:1787780021.824263:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4b600/0xc8fc0a517996129b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780021.824278:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4b600/0xc8fc0a517996129b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780021.824287:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9c04478d7500) 00010000:00010000:1.0:1787780021.824290:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787780021.824293:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4b600/0xc8fc0a517996129b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780021.824298:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4b600/0xc8fc0a517996129b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780021.824336:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4b800/0xc8fc0a517996128d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea203f expref: 60 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780021.824350:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4ba00/0xc8fc0a51799612a2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea203f expref: 59 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780021.824356:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c04478d7400) 00010000:00010000:1.0:1787780021.824359:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787780021.824361:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0347e4ba00, rc 0) 00000100:00100000:1.0:1787780021.824564:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347e5bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+59:12386:x1874622863725824:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 912us (1449us total) trans 4294967455 rc 0/0 00000100:00100000:1.0:1787780021.824572:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 180 00000100:00100000:0.0:1787780021.828470:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787780021.828615:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863725952 00000100:00100000:3.0:1787780021.828625:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863725952 00000100:00100000:3.0:1787780021.828683:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 181 00000100:00100000:3.0:1787780021.828692:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c048134a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+59:12386:x1874622863725952:12345-192.168.203.31@tcp:54:lfs.0 00010000:00010000:3.0:1787780021.828945:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a51799612b0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780021.828962:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a51799612b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780021.828974:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a51799612b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780021.829020:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a51799612b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780021.829027:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a51799612b0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780021.829035:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a51799612b0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780021.829040:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c04766dc400 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:3.0:1787780021.829059:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a51799612b0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780021.829067:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a51799612b0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780021.829080:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c04478d7400) 00010000:00010000:3.0:1787780021.829083:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787780021.829088:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a51799612b0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780021.829095:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a51799612b0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787780021.829162:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c048134a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+59:12386:x1874622863725952:12345-192.168.203.31@tcp:54:lfs.0 Request processed in 470us (709us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780021.829171:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 181 00000100:00100000:0.0:1787780021.834192:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787780021.834510:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863726080 00000100:00100000:1.0:1787780021.834521:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863726080 00000100:00100000:1.0:1787780021.834602:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 14 00000100:00100000:1.0:1787780021.834612:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346de3840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+59:2410:x1874622863726080:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787780021.834647:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787780021.834673:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4ba00/0xc8fc0a51799612a2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea203f expref: 59 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780021.834879:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c04478d7400) 00010000:00010000:1.0:1787780021.834885:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787780021.834948:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346de3840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+58:2410:x1874622863726080:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 337us (765us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780021.834956:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 14 00000100:00100000:2.0:1787780021.841188:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787780021.841298:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863726336 00000100:00100000:1.0:1787780021.841308:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863726336 00000100:00100000:1.0:1787780021.841364:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 47 00000100:00100000:1.0:1787780021.841373:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347e592c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+58:12386:x1874622863726336:12345-192.168.203.31@tcp:35:lfs.0 00000100:00100000:1.0:1787780021.841611:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347e592c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+59:12386:x1874622863726336:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 237us (430us total) trans 4294967456 rc 0/0 00000100:00100000:1.0:1787780021.841619:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 47 00000100:00100000:0.0:1787780021.996381:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787780021.996510:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863726592 00000100:00100000:3.0:1787780021.996524:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863726592 00000100:00100000:3.0:1787780021.996616:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 182 00000100:00100000:3.0:1787780021.996640:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346de2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+59:12404:x1874622863726592:12345-192.168.203.31@tcp:101:cat.0 00010000:00010000:3.0:1787780021.996675:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787780021.996704:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a51799612b7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea2046 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780021.996896:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd200/0xc8fc0a51799612be lrc: 3/1,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780021.996914:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd200/0xc8fc0a51799612be lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780021.996953:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd200/0xc8fc0a51799612be lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787780021.996967:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:3.0:1787780021.997107:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a51799612b7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea2046 expref: 62 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780021.997131:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd200/0xc8fc0a51799612be lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea2046 expref: 61 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780021.997140:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c04478d7400) 00010000:00010000:3.0:1787780021.997143:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1787780021.997147:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c04766dd200, rc 0) 00000100:00100000:3.0:1787780021.997223:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346de2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+61:12404:x1874622863726592:12345-192.168.203.31@tcp:101:cat.0 Request processed in 597us (857us total) trans 4294967457 rc 0/0 00000100:00100000:3.0:1787780021.997230:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 182 00000100:00100000:2.0:1787780022.045700:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787780022.045733:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477843480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881627008:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787780022.045811:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787780022.046008:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881627008 00000100:00100000:0.0:1787780022.046016:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881627008 00000100:00100000:0.0:1787780022.046073:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1787780022.046092:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347ee2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1874622881627008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787780022.046118:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1787780022.046167:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347ee2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1874622881627008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780022.046174:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1787780022.046238:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477843480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881627008:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787780022.048284:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787780022.048313:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348a08b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881627136:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787780022.048399:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787780022.048473:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881627136 00000100:00100000:2.0:1787780022.048485:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881627136 00000100:00100000:2.0:1787780022.048551:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1787780022.048562:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477af2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881627136:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787780022.048592:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:2.0:1787780022.048674:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477af2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881627136:12345-0@lo:13:osp-pre-0-1.0 Request processed in 114us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780022.048681:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1787780022.048784:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348a08b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881627136:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787780022.052634:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787780022.052740:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863726720 00000100:00100000:1.0:1787780022.052749:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863726720 00000100:00100000:1.0:1787780022.052834:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 183 00000100:00100000:1.0:1787780022.052873:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477843480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+61:12405:x1874622863726720:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:1.0:1787780022.052896:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787780022.052929:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4ba00/0xc8fc0a51799612cc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea204d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780022.052992:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4b800/0xc8fc0a51799612d3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780022.053005:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4b800/0xc8fc0a51799612d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780022.053017:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4b800/0xc8fc0a51799612d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787780022.053058:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1787780022.053062:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00080000:2.0:1787780022.053219:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00010000:1.0:1787780022.053245:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4b800/0xc8fc0a51799612d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780022.053341:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4ba00/0xc8fc0a51799612cc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea204d expref: 63 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780022.053359:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4b800/0xc8fc0a51799612d3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea204d expref: 62 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780022.053368:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c04478d7d00) 00010000:00010000:1.0:1787780022.053370:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787780022.053374:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0347e4b800, rc 0) 00000100:00100000:1.0:1787780022.053466:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477843480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+62:12405:x1874622863726720:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 596us (841us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780022.053474:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 183 00000100:00100000:2.0:1787780022.058211:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787780022.058336:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863727104 00000100:00100000:1.0:1787780022.058350:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863727104 00000100:00100000:1.0:1787780022.058406:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 48 00000100:00100000:1.0:1787780022.058415:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347ee0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+62:12405:x1874622863727104:12345-192.168.203.31@tcp:35:lfs.0 00000100:00100000:1.0:1787780022.058709:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347ee0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+63:12405:x1874622863727104:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 294us (506us total) trans 4294967458 rc 0/0 00000100:00100000:1.0:1787780022.058717:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 48 00000100:00100000:0.0:1787780022.064191:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787780022.064364:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863727232 00000100:00100000:2.0:1787780022.064373:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863727232 00000100:00100000:2.0:1787780022.064435:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 15 00000100:00100000:2.0:1787780022.064445:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477840000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+63:12405:x1874622863727232:12345-192.168.203.31@tcp:103:lfs.0 00010000:00010000:2.0:1787780022.064460:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787780022.064484:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a000/0xc8fc0a5179961263 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea2031 expref: 63 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780022.064507:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd200/0xc8fc0a51799612be lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea2046 expref: 62 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780022.064531:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19c00/0xc8fc0a5179961160 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1feb expref: 61 pid: 7821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780022.064553:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c04478d7400) 00010000:00010000:2.0:1787780022.064558:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787780022.064653:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477840000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+60:12405:x1874622863727232:12345-192.168.203.31@tcp:103:lfs.0 Request processed in 209us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780022.064661:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 15 00000100:00100000:0.0:1787780022.069424:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787780022.069511:0:12488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863727360 00000100:00100000:1.0:1787780022.069530:0:12488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863727360 00000100:00100000:1.0:1787780022.069603:0:12488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 184 00000100:00100000:1.0:1787780022.069613:0:12488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04619570c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:781d29bb-23d2-48e3-b16d-c29e52cd5375+60:12405:x1874622863727360:12345-192.168.203.31@tcp:58:lfs.0 00010000:00010000:1.0:1787780022.069730:0:12488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4ba00/0xc8fc0a51799612da lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780022.069748:0:12488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4ba00/0xc8fc0a51799612da lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780022.069759:0:12488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4ba00/0xc8fc0a51799612da lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787780022.069878:0:12488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:1.0:1787780022.069963:0:12488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04619570c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:781d29bb-23d2-48e3-b16d-c29e52cd5375+60:12405:x1874622863727360:12345-192.168.203.31@tcp:58:lfs.0 Request processed in 351us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780022.069972:0:12488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 184 00000100:00100000:0.0:1787780022.095043:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787780022.095145:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863727488 00000100:00100000:3.0:1787780022.095154:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863727488 00000100:00100000:3.0:1787780022.095216:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 185 00000100:00100000:3.0:1787780022.095226:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04779830c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+60:12407:x1874622863727488:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:3.0:1787780022.095245:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787780022.095264:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a51799612e1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea2054 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780022.095345:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc200/0xc8fc0a51799612e8 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780022.095392:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc200/0xc8fc0a51799612e8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780022.095414:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc200/0xc8fc0a51799612e8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780022.095434:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd600/0xc8fc0a51799612ef lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780022.095442:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd600/0xc8fc0a51799612ef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780022.095448:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd600/0xc8fc0a51799612ef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780022.095521:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc600/0xc8fc0a51799612f6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780022.095529:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc600/0xc8fc0a51799612f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780022.095544:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc600/0xc8fc0a51799612f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787780022.095579:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1787780022.095583:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787780022.095600:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc600/0xc8fc0a51799612f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780022.095611:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc600/0xc8fc0a51799612f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780022.095628:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc200/0xc8fc0a51799612e8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780022.095648:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc200/0xc8fc0a51799612e8 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780022.095661:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc200/0xc8fc0a51799612e8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780022.095667:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c04766dc200 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:3.0:1787780022.095671:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc200/0xc8fc0a51799612e8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780022.095678:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc200/0xc8fc0a51799612e8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780022.095699:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c04478d7d00) 00010000:00010000:3.0:1787780022.095702:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787780022.095706:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc200/0xc8fc0a51799612e8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780022.095711:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc200/0xc8fc0a51799612e8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780022.095725:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd600/0xc8fc0a51799612ef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780022.095731:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd600/0xc8fc0a51799612ef lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780022.095736:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd600/0xc8fc0a51799612ef lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780022.095746:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c04766dd600 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:3.0:1787780022.095749:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd600/0xc8fc0a51799612ef lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780022.095754:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd600/0xc8fc0a51799612ef lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780022.095761:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9c04478d7500) 00010000:00010000:3.0:1787780022.095763:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787780022.095765:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd600/0xc8fc0a51799612ef lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780022.095771:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd600/0xc8fc0a51799612ef lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780022.095795:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a51799612e1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea2054 expref: 62 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780022.095805:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc600/0xc8fc0a51799612f6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea2054 expref: 61 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780022.095812:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c04478d7400) 00010000:00010000:3.0:1787780022.095814:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787780022.095816:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c04766dc600, rc 0) 00000100:00100000:3.0:1787780022.095920:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04779830c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+61:12407:x1874622863727488:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 696us (887us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780022.095927:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 185 00010000:00010000:3.0:1787780022.429886:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787780022.556614:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347e54780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881627264:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787780022.556681:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1787780022.560376:0:8527:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 430564535237ns, next at 431564532619ns, rc = 0 00000100:00100000:3.0:1787780022.564320:0:8529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881627264 00000100:00100000:3.0:1787780022.564335:0:8529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881627264 00000100:00100000:3.0:1787780022.564583:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1787780022.564596:0:8529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347bccf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1874622881627264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787780022.564624:0:8529:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:3.0:1787780022.564719:0:8529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347bccf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1874622881627264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 126us (8038us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780022.564727:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1787780022.564811:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347e54780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881627264:0@lo:13:osp-pre-0-0.0 00000040:00080000:0.0:1787780022.862732:0:14704:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787780022.862741:0:14704:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787780022.863975:0:14704:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1787780022.863987:0:14704:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1787780023.005451:0:13794:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787780023.005459:0:13794:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787780023.005496:0:13794:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1787780023.005503:0:13794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787780023.005713:0:13794:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347e55680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13794:1874622881627392:192.168.203.31@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787780023.006229:0:13794:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0347d45240 going to sleep for 11 seconds 00000100:00100000:0.0:1787780023.028502:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787780023.028554:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863727616 00000100:00100000:0.0:1787780023.028561:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863727616 00000100:00100000:0.0:1787780023.028606:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 186 00000100:00100000:0.0:1787780023.028614:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347bcc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+62:12419:x1874622863727616:12345-192.168.203.31@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787780023.028643:0:6513:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787780023.028734:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347bcc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+62:12419:x1874622863727616:12345-192.168.203.31@tcp:53:lhsmtool_posix.0 Request processed in 121us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780023.028742:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 186 00000100:00100000:0.0:1787780023.034307:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787780023.034568:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863727744 00000100:00100000:3.0:1787780023.034577:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863727744 00000100:00100000:3.0:1787780023.034628:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 187 00000100:00100000:3.0:1787780023.034638:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477aebc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+62:12419:x1874622863727744:12345-192.168.203.31@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787780023.034704:0:7821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a51799612fd lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780023.034721:0:7821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a51799612fd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780023.034734:0:7821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a51799612fd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780023.034799:0:7821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd600/0xc8fc0a5179961304 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780023.034807:0:7821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd600/0xc8fc0a5179961304 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780023.034815:0:7821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd600/0xc8fc0a5179961304 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780023.034874:0:7821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc200/0xc8fc0a517996130b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780023.035076:0:7821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc200/0xc8fc0a517996130b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780023.035084:0:7821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc200/0xc8fc0a517996130b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787780023.035131:0:7821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1787780023.035136:0:7821:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787780023.035149:0:7821:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc200/0xc8fc0a517996130b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780023.035171:0:7821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a51799612fd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780023.035179:0:7821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a51799612fd lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780023.035187:0:7821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a51799612fd lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780023.035194:0:7821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c04766dc400 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:3.0:1787780023.035198:0:7821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a51799612fd lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780023.035206:0:7821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a51799612fd lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780023.035218:0:7821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c0347a50800) 00010000:00010000:3.0:1787780023.035221:0:7821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787780023.035434:0:7821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a51799612fd lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780023.035453:0:7821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a51799612fd lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780023.035469:0:7821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd600/0xc8fc0a5179961304 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780023.035476:0:7821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd600/0xc8fc0a5179961304 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780023.035482:0:7821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd600/0xc8fc0a5179961304 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780023.035488:0:7821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c04766dd600 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:3.0:1787780023.035492:0:7821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd600/0xc8fc0a5179961304 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780023.035498:0:7821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd600/0xc8fc0a5179961304 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780023.035506:0:7821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdc6beff1 (ffff9c0443d81d00) 00010000:00010000:3.0:1787780023.035509:0:7821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787780023.035512:0:7821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd600/0xc8fc0a5179961304 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780023.035518:0:7821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd600/0xc8fc0a5179961304 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780023.035603:0:7821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc200/0xc8fc0a517996130b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780023.035611:0:7821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc200/0xc8fc0a517996130b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780023.035625:0:7821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc200/0xc8fc0a517996130b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780023.035629:0:7821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c04766dc200 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:3.0:1787780023.035632:0:7821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc200/0xc8fc0a517996130b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780023.035638:0:7821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc200/0xc8fc0a517996130b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780023.035645:0:7821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c04478d7400) 00010000:00010000:3.0:1787780023.035648:0:7821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787780023.035650:0:7821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc200/0xc8fc0a517996130b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780023.035655:0:7821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc200/0xc8fc0a517996130b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787780023.035731:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477aebc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+62:12419:x1874622863727744:12345-192.168.203.31@tcp:34:lhsmtool_posix.0 Request processed in 1092us (1431us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780023.035739:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 187 00000100:00100000:0.0:1787780023.041490:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787780023.041928:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863728000 00000100:00100000:3.0:1787780023.041937:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863728000 00000100:00100000:3.0:1787780023.041990:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 188 00000100:00100000:3.0:1787780023.042000:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477aeb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+62:12419:x1874622863728000:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787780023.042018:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787780023.042039:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd200/0xc8fc0a5179961312 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea205b expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780023.042194:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766ddc00/0xc8fc0a5179961319 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780023.042209:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766ddc00/0xc8fc0a5179961319 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780023.042220:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766ddc00/0xc8fc0a5179961319 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787780023.042241:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:3.0:1787780023.042313:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766ddc00/0xc8fc0a5179961319 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780023.042321:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766ddc00/0xc8fc0a5179961319 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780023.042327:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766ddc00/0xc8fc0a5179961319 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780023.042671:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c04766ddc00 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:3.0:1787780023.042678:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766ddc00/0xc8fc0a5179961319 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780023.042687:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766ddc00/0xc8fc0a5179961319 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780023.042701:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c04478d7400) 00010000:00010000:3.0:1787780023.042703:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787780023.042708:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766ddc00/0xc8fc0a5179961319 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780023.042725:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766ddc00/0xc8fc0a5179961319 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780023.042773:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd200/0xc8fc0a5179961312 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea205b expref: 64 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780023.042784:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c0347a50800) 00010000:00010000:3.0:1787780023.042786:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787780023.042790:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd200/0xc8fc0a5179961312 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea205b expref: 64 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780023.042801:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c04766dd200, rc 0) 00000100:00100000:3.0:1787780023.042952:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477aeb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+63:12419:x1874622863728000:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 952us (1470us total) trans 4294967459 rc 301/301 00000100:00100000:3.0:1787780023.042961:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 188 00000100:00100000:0.0:1787780023.050277:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787780023.050762:0:12488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863728128 00000100:00100000:3.0:1787780023.050781:0:12488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863728128 00000100:00100000:3.0:1787780023.050876:0:12488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 189 00000100:00100000:3.0:1787780023.050896:0:12488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477aea1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:781d29bb-23d2-48e3-b16d-c29e52cd5375+63:12419:x1874622863728128:12345-192.168.203.31@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787780023.050934:0:12488:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787780023.051035:0:12488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477aea1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:781d29bb-23d2-48e3-b16d-c29e52cd5375+63:12419:x1874622863728128:12345-192.168.203.31@tcp:53:lhsmtool_posix.0 Request processed in 141us (766us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780023.051044:0:12488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 189 00000100:00100000:2.0:1787780023.054713:0:13794:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347e55680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13794:1874622881627392:192.168.203.31@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787780023.067300:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787780023.067890:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863728384 00000100:00100000:3.0:1787780023.067900:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863728384 00000100:00100000:3.0:1787780023.067954:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 190 00000100:00100000:3.0:1787780023.067987:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347e55680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+62:12419:x1874622863728384:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787780023.068007:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787780023.068011:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787780023.068038:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4b800/0xc8fc0a51799612d3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea204d expref: 62 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780023.068551:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c04478d7d00) 00010000:00010000:3.0:1787780023.068557:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787780023.068576:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd200/0xc8fc0a5179961327 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea2062 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787780023.069659:0:6514:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x5:0x0], index 1: 0 00010000:00010000:3.0:1787780023.069817:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766ddc00/0xc8fc0a517996132e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780023.071241:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766ddc00/0xc8fc0a517996132e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780023.071261:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766ddc00/0xc8fc0a517996132e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780023.071351:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd200/0xc8fc0a5179961327 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea2062 expref: 64 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780023.071369:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766ddc00/0xc8fc0a517996132e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea2062 expref: 63 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780023.071377:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9c0443d81d00) 00010000:00010000:3.0:1787780023.071380:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787780023.071390:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c04766ddc00, rc 0) 00000100:00100000:3.0:1787780023.071470:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347e55680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+63:12419:x1874622863728384:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 3485us (4178us total) trans 4294967460 rc 0/0 00000100:00100000:3.0:1787780023.071480:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 190 00000100:00100000:2.0:1787780023.077413:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787780023.077498:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863728640 00000100:00100000:1.0:1787780023.077508:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863728640 00000100:00100000:1.0:1787780023.077577:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 191 00000100:00100000:1.0:1787780023.077586:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347e54780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+63:12419:x1874622863728640:12345-192.168.203.31@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787780023.077640:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787780023.077677:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766ddc00/0xc8fc0a517996132e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea2062 expref: 63 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780023.077695:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9c0443d81d00) 00010000:00010000:1.0:1787780023.077705:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787780023.077727:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4b200/0xc8fc0a517996133c lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780023.077739:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4b200/0xc8fc0a517996133c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780023.077748:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4b200/0xc8fc0a517996133c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780023.077760:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4bc00/0xc8fc0a5179961343 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x5da4017f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780023.077765:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4bc00/0xc8fc0a5179961343 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x5da4017f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780023.077771:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4bc00/0xc8fc0a5179961343 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x5da4017f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780023.077812:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4b200/0xc8fc0a517996133c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780023.077832:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4b200/0xc8fc0a517996133c lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780023.077862:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4b200/0xc8fc0a517996133c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780023.077868:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0347e4b200 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:1.0:1787780023.077888:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4b200/0xc8fc0a517996133c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780023.077896:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4b200/0xc8fc0a517996133c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780023.077905:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c04478d7d00) 00010000:00010000:1.0:1787780023.077908:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787780023.077912:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4b200/0xc8fc0a517996133c lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780023.077918:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4b200/0xc8fc0a517996133c lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780023.077928:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4bc00/0xc8fc0a5179961343 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x5da4017f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780023.077934:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4bc00/0xc8fc0a5179961343 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x5da4017f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780023.077940:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4bc00/0xc8fc0a5179961343 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x5da4017f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780023.077945:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0347e4bc00 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:1.0:1787780023.077948:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4bc00/0xc8fc0a5179961343 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x5da4017f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780023.077953:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4bc00/0xc8fc0a5179961343 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x5da4017f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780023.077961:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x5da4017f (ffff9c0341cd1c00) 00010000:00010000:1.0:1787780023.077963:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787780023.077973:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4bc00/0xc8fc0a5179961343 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x5da4017f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780023.077979:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4bc00/0xc8fc0a5179961343 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x5da4017f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787780023.078166:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347e54780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+62:12419:x1874622863728640:12345-192.168.203.31@tcp:36:lhsmtool_posix.0 Request processed in 464us (644us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787780023.078175:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 191 00000100:00100000:2.0:1787780023.085226:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787780023.085311:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863728768 00000100:00100000:0.0:1787780023.085320:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863728768 00000100:00100000:0.0:1787780023.085383:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 192 00000100:00100000:0.0:1787780023.085393:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0348872d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+62:12419:x1874622863728768:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787780023.085413:0:7821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787780023.085435:0:7821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868400/0xc8fc0a517996134a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea2069 expref: -99 pid: 7821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780023.085471:0:7821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869600/0xc8fc0a5179961351 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780023.085484:0:7821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869600/0xc8fc0a5179961351 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780023.085493:0:7821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869600/0xc8fc0a5179961351 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780023.085606:0:7821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868400/0xc8fc0a517996134a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea2069 expref: 64 pid: 7821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780023.085621:0:7821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869600/0xc8fc0a5179961351 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea2069 expref: 63 pid: 7821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780023.085630:0:7821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9c0347bec100) 00010000:00010000:0.0:1787780023.085633:0:7821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787780023.085636:0:7821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0477869600, rc 0) 00000100:00100000:0.0:1787780023.085705:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0348872d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+63:12419:x1874622863728768:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 312us (892us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780023.085712:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 192 00000100:00100000:2.0:1787780023.092608:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787780023.092693:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863729024 00000100:00100000:0.0:1787780023.092703:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863729024 00000100:00100000:0.0:1787780023.092782:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 193 00000100:00100000:0.0:1787780023.092792:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c047785e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+63:12419:x1874622863729024:12345-192.168.203.31@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787780023.093195:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19400/0xc8fc0a5179961358 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780023.093213:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19400/0xc8fc0a5179961358 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780023.093225:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19400/0xc8fc0a5179961358 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787780023.093389:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:2.0:1787780023.093400:0:6514:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 431097560639ns, next at 432097557799ns, rc = 0 00000004:00010000:2.0:1787780023.093445:0:6514:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000864d41d8 reply state 0000000061a96e37 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19400/0xc8fc0a5179961358 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780023.093457:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19400/0xc8fc0a5179961358 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780023.093464:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9c0347bec100) 00010000:00010000:2.0:1787780023.093466:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1787780023.093470:0:6514:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787780023.093579:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c047785e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+65:12419:x1874622863729024:12345-192.168.203.31@tcp:36:lhsmtool_posix.0 Request processed in 787us (979us total) trans 4294967461 rc 0/0 00000100:00100000:2.0:1787780023.093587:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 193 00000100:00100000:1.0:1787780023.105672:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787780023.106335:0:12488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863729152 00000100:00100000:3.0:1787780023.106345:0:12488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863729152 00000100:00100000:3.0:1787780023.106408:0:12488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 194 00000100:00100000:3.0:1787780023.106419:0:12488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477af3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:781d29bb-23d2-48e3-b16d-c29e52cd5375+65:12419:x1874622863729152:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787780023.106442:0:12488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787780023.106464:0:12488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd200/0xc8fc0a517996135f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea2070 expref: -99 pid: 12488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780023.106523:0:12488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd200/0xc8fc0a517996135f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea2070 expref: 66 pid: 12488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780023.106547:0:12488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd200/0xc8fc0a517996135f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea2070 expref: 66 pid: 12488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780023.106567:0:12488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9c0347bec100) 00010000:00010000:3.0:1787780023.106571:0:12488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787780023.106575:0:12488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c04766dd200, rc 0) 00000100:00100000:3.0:1787780023.106636:0:12488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477af3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:781d29bb-23d2-48e3-b16d-c29e52cd5375+66:12419:x1874622863729152:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 219us (973us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780023.106644:0:12488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 194 00000100:00100000:2.0:1787780023.116224:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787780023.116348:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863729280 00000100:00100000:1.0:1787780023.116357:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863729280 00000100:00100000:1.0:1787780023.116431:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 58 00000100:00100000:1.0:1787780023.116442:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0461bed2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+6:2410:x1874622863729280:12345-192.168.203.31@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1787780023.116657:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0461bed2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+7:2410:x1874622863729280:12345-192.168.203.31@tcp:2:lhsmtool_posix.0 Request processed in 217us (442us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1787780023.116665:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 58 00000100:00080000:2.0:1787780023.116889:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787780023.125330:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787780023.125492:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863729536 00000100:00100000:3.0:1787780023.125502:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863729536 00000100:00100000:3.0:1787780023.125565:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 49 00000100:00100000:3.0:1787780023.125576:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477ae9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+66:12419:x1874622863729536:12345-192.168.203.31@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787780023.126063:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477ae9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+67:12419:x1874622863729536:12345-192.168.203.31@tcp:35:lhsmtool_posix.0 Request processed in 487us (737us total) trans 4294967462 rc 0/0 00000100:00100000:3.0:1787780023.126071:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 49 00000100:00100000:2.0:1787780023.129121:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787780023.129406:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863729792 00000100:00100000:3.0:1787780023.129416:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863729792 00000100:00100000:3.0:1787780023.129472:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 195 00000100:00100000:3.0:1787780023.129481:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0461bec780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+67:12419:x1874622863729792:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787780023.129598:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0461bec780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+67:12419:x1874622863729792:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 Request processed in 117us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780023.129606:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 195 00000100:00100000:2.0:1787780023.135711:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787780023.135792:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863729920 00000100:00100000:0.0:1787780023.135801:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863729920 00000100:00100000:0.0:1787780023.135936:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 196 00000100:00100000:0.0:1787780023.135946:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0461befc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+67:12419:x1874622863729920:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787780023.135965:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787780023.135984:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869400/0xc8fc0a5179961366 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea2077 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780023.136502:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868400/0xc8fc0a517996136d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780023.136518:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868400/0xc8fc0a517996136d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780023.136540:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868400/0xc8fc0a517996136d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787780023.136586:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787780023.136608:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868400/0xc8fc0a517996136d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780023.136633:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869400/0xc8fc0a5179961366 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea2077 expref: 69 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780023.136648:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868400/0xc8fc0a517996136d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea2077 expref: 68 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780023.136668:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9c0347bec100) 00010000:00010000:0.0:1787780023.136671:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787780023.136675:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0477868400, rc 0) 00000100:00100000:0.0:1787780023.136738:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0461befc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+68:12419:x1874622863729920:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 792us (1033us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780023.136745:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 196 00000100:00100000:0.0:1787780023.142806:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787780023.143060:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863730048 00000100:00100000:3.0:1787780023.143069:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863730048 00000100:00100000:3.0:1787780023.143139:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 59 00000100:00100000:3.0:1787780023.143149:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477aead00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+7:2410:x1874622863730048:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787780023.143176:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787780023.143196:0:8430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000445a1f73/0xc8fc0a5179961374 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea207e expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787780023.143219:0:8430:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8f5bb7, blocks: 0x0 00010000:00010000:3.0:1787780023.143362:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=431s v=(0 0) 00010000:00010000:3.0:1787780023.143367:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787780023.143377:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000445a1f73/0xc8fc0a5179961374 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea207e expref: 8 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780023.143395:0:8430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000445a1f73/0xc8fc0a5179961374 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea207e expref: 8 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780023.143414:0:8430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c04766dc200, rc 0) 00000100:00100000:3.0:1787780023.143469:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477aead00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+8:2410:x1874622863730048:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 322us (673us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780023.143476:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 59 00000100:00100000:0.0:1787780023.149522:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787780023.149692:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863730304 00000100:00100000:1.0:1787780023.149702:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863730304 00000100:00100000:1.0:1787780023.149766:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 197 00000100:00100000:1.0:1787780023.151149:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046efcf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+68:12419:x1874622863730304:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787780023.151523:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046efcf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+68:12419:x1874622863730304:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 Request processed in 383us (2006us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780023.155588:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787780023.157977:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863730432 00000100:00100000:2.0:1787780023.157992:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863730432 00000100:00100000:2.0:1787780023.158048:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 60 00000100:00100000:2.0:1787780023.158058:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346da52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+8:12419:x1874622863730432:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787780023.158074:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787780023.158092:0:8428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e521b2ec/0xc8fc0a517996137b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea2085 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780023.158122:0:8428:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000445a1f73/0xc8fc0a5179961374 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea207e expref: 9 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780023.158131:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787780023.158135:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787780023.158141:0:8428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e521b2ec/0xc8fc0a517996137b lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea2085 expref: 9 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780023.158174:0:8428:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000445a1f73/0xc8fc0a5179961374 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea207e expref: 9 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780023.158199:0:8428:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000445a1f73/0xc8fc0a5179961374 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea207e expref: 9 pid: 8430 timeout: 531 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787780023.158212:0:8428:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346da70c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1874622881627520:192.168.203.31@tcp:104: 00000100:00100000:2.0:1787780023.158301:0:8428:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0347d45600 going to sleep for 11 seconds 00000100:00100000:1.0:1787780023.163691:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 197 00000100:00100000:3.0:1787780023.184498:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787780023.184540:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863730560 00000100:00100000:3.0:1787780023.184548:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863730560 00010000:00010000:3.0:1787780023.184587:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000445a1f73/0xc8fc0a5179961374 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea207e expref: 10 pid: 8430 timeout: 531 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787780023.184622:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 87 00000100:00100000:3.0:1787780023.184632:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0348a08b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+10:2410:x1874622863730560:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787780023.184646:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787780023.184666:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000445a1f73/0xc8fc0a5179961374 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea207e expref: 10 pid: 8430 timeout: 531 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780023.184679:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000445a1f73/0xc8fc0a5179961374 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea207e expref: 10 pid: 8430 timeout: 531 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780023.184703:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787780023.184708:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787780023.184717:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e521b2ec/0xc8fc0a517996137b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea2085 expref: 10 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780023.184741:0:6498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e521b2ec/0xc8fc0a517996137b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea2085 expref: 10 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780023.184787:0:6498:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000e521b2ec/0xc8fc0a517996137b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea2085 expref: 10 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787780023.184800:0:6498:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c03489f70c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6498:1874622881627648:192.168.203.31@tcp:105: 00010000:00010000:1.0:1787780023.184800:0:8428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000445a1f73/0xc8fc0a5179961374 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea207e expref: 10 pid: 8430 timeout: 531 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787780023.184824:0:8428:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346da70c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1874622881627520:192.168.203.31@tcp:104: 00010000:00010000:1.0:1787780023.184866:0:8428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e521b2ec/0xc8fc0a517996137b lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0xf757128131ea2085 expref: 9 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780023.184877:0:8428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0444c19000, rc 0) 00000100:00100000:3.0:1787780023.185626:0:6498:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0477835900 going to sleep for 11 seconds 00000100:00100000:1.0:1787780023.193292:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346da52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+9:12419:x1874622863730432:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 35223us (37709us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780023.193305:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 60 00000100:00100000:0.0:1787780023.193669:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787780023.193706:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787780023.193735:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787780023.193759:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787780023.193781:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787780023.193803:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863730944 00000100:00100000:0.0:1787780023.193810:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863730944 00000100:00100000:1.0:1787780023.194158:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863730688 00000100:00100000:1.0:1787780023.194163:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863730688 00000100:00100000:1.0:1787780023.194271:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 399 00000100:00100000:1.0:1787780023.194281:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471774450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+13:2410:x1874622863730688:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1787780023.194341:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471774450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+13:2410:x1874622863730688:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 61us (674us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780023.194349:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 399 00000100:00100000:0.0:1787780023.194450:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 165 00000100:00100000:0.0:1787780023.194458:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046f1b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+7:2410:x1874622863730944:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1787780023.194489:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046f1b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+7:2410:x1874622863730944:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 33us (782us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780023.194496:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 165 00000100:00100000:3.0:1787780023.194578:0:12488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863730816 00000100:00100000:3.0:1787780023.194582:0:12488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863730816 00000100:00100000:3.0:1787780023.194617:0:12488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863731072 00000100:00100000:3.0:1787780023.194620:0:12488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863731072 00000100:00100000:3.0:1787780023.194637:0:12488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863731200 00000100:00100000:3.0:1787780023.194640:0:12488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863731200 00000100:00100000:3.0:1787780023.194653:0:12488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 380 00000100:00100000:3.0:1787780023.194660:0:12488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046efcde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:2410:x1874622863730816:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1787780023.194662:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 381 00000100:00100000:0.0:1787780023.194668:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03488352c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+5:2411:x1874622863731072:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1787780023.194689:0:12488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046efcde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:2410:x1874622863730816:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 30us (954us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780023.194696:0:12488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 380 00000100:00100000:3.0:1787780023.194710:0:12488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 382 00000100:00100000:3.0:1787780023.194716:0:12488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0348834b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+5:2411:x1874622863731200:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1787780023.196643:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03488352c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+5:2411:x1874622863731072:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 1965us (2874us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780023.196669:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 381 00000100:00100000:3.0:1787780023.196697:0:12488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0348834b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+5:2411:x1874622863731200:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 1979us (2914us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780023.196705:0:12488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 382 00000100:00080000:0.0:1787780023.196708:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787780023.196713:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787780023.196717:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787780023.202514:0:6498:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c03489f70c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6498:1874622881627648:192.168.203.31@tcp:105: 00010000:00010000:1.0:1787780023.202549:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787780023.202611:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0348a08b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+8:2410:x1874622863730560:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 17980us (18121us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780023.202622:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 87 00000100:00100000:0.0:1787780023.207331:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787780023.207404:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863731328 00000100:00100000:3.0:1787780023.207413:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863731328 00002000:00100000:3.0:1787780023.207459:0:8433:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff9c0348837840 x1874622863731328/t0(0) o4->781d29bb-23d2-48e3-b16d-c29e52cd5375@192.168.203.31@tcp:434/0 lens 504/0 e 0 to 0 dl 1787780034 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787780023.207469:0:8433:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c0348837840 with x1874622863731328 ext(0->8) 00002000:00010000:3.0:1787780023.207474:0:8433:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c0348837840 00000100:00100000:3.0:1787780023.207505:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 4 00000100:00100000:3.0:1787780023.207513:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0348837840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+8:2411:x1874622863731328:12345-192.168.203.31@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1787780023.208718:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0348837840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+10:2411:x1874622863731328:12345-192.168.203.31@tcp:4:lhsmtool_posix.0 Request processed in 1200us (1558us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1787780023.208729:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 4 00002000:00100000:3.0:1787780023.208738:0:8433:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff9c0348837840 x1874622863731328/t4294967315(0) o4->781d29bb-23d2-48e3-b16d-c29e52cd5375@192.168.203.31@tcp:434/0 lens 504/448 e 0 to 0 dl 1787780034 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787780023.208747:0:8433:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c0348837840 with x1874622863731328 ext(0->8) 00002000:00010000:3.0:1787780023.208750:0:8433:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c0348837840 00000100:00100000:0.0:1787780023.214652:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787780023.214713:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863731456 00000100:00100000:1.0:1787780023.214722:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863731456 00000100:00100000:1.0:1787780023.214781:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 198 00000100:00100000:1.0:1787780023.214790:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0348836580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+68:12419:x1874622863731456:12345-192.168.203.31@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1787780023.219039:0:6491:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967462 is committed 00000004:00080000:3.0:1787780023.219123:0:6491:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00010000:00010000:1.0:1787780023.219156:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18600/0xc8fc0a51799610e9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780023.219169:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18600/0xc8fc0a51799610e9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780023.219177:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18600/0xc8fc0a51799610e9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780023.219191:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0444c18600 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:1.0:1787780023.219196:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18600/0xc8fc0a51799610e9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780023.219205:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18600/0xc8fc0a51799610e9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780023.219223:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9c04478d7500) 00010000:00010000:1.0:1787780023.219226:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787780023.219231:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18600/0xc8fc0a51799610e9 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780023.219237:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18600/0xc8fc0a51799610e9 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780023.219262:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a200/0xc8fc0a51799611ec lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780023.219269:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a200/0xc8fc0a51799611ec lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780023.219275:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a200/0xc8fc0a51799611ec lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787780023.219289:0:6491:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00010000:00010000:1.0:1787780023.219294:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0347e4a200 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:1.0:1787780023.219297:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a200/0xc8fc0a51799611ec lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780023.219304:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a200/0xc8fc0a51799611ec lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780023.219314:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c04478d7400) 00010000:00010000:1.0:1787780023.219316:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787780023.219319:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a200/0xc8fc0a51799611ec lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787780023.219321:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:1.0:1787780023.219329:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a200/0xc8fc0a51799611ec lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787780023.219344:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346da7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881627776:0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1787780023.219348:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dca00/0xc8fc0a517996120f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780023.219356:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dca00/0xc8fc0a517996120f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787780023.219357:0:6491:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00010000:00010000:1.0:1787780023.219361:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dca00/0xc8fc0a517996120f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1787780023.219366:0:6491:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9c0477835b40 refcount 2 committed 0 result 0 batchid 5 00010000:00010000:1.0:1787780023.219366:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c04766dca00 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:1.0:1787780023.219369:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dca00/0xc8fc0a517996120f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1787780023.219370:0:6491:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c0346b56600 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9c0477835180 00000020:00080000:3.0:1787780023.219373:0:6491:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c0346b56700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9c03489c5200 00010000:00010000:1.0:1787780023.219375:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dca00/0xc8fc0a517996120f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780023.219393:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c04478d7400) 00010000:00010000:1.0:1787780023.219396:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787780023.219398:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dca00/0xc8fc0a517996120f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780023.219404:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dca00/0xc8fc0a517996120f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787780023.219416:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787780023.219431:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a600/0xc8fc0a5179961255 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780023.219438:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a600/0xc8fc0a5179961255 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780023.219444:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a600/0xc8fc0a5179961255 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780023.219449:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0347e4a600 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:1.0:1787780023.219452:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a600/0xc8fc0a5179961255 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780023.219458:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a600/0xc8fc0a5179961255 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1787780023.219463:0:6544:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00010000:00010000:1.0:1787780023.219466:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c04478d7400) 00010000:00010000:1.0:1787780023.219469:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787780023.219471:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a600/0xc8fc0a5179961255 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780023.219476:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a600/0xc8fc0a5179961255 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787780023.219494:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881627776 00010000:00010000:1.0:1787780023.219506:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19400/0xc8fc0a5179961358 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1787780023.219512:0:6544:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:1.0:1787780023.219513:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19400/0xc8fc0a5179961358 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780023.219519:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19400/0xc8fc0a5179961358 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787780023.219523:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c03489f70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881627904:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1787780023.219524:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0444c19400 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:1.0:1787780023.219539:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19400/0xc8fc0a5179961358 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780023.219546:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19400/0xc8fc0a5179961358 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780023.219554:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9c0347bec100) 00010000:00010000:1.0:1787780023.219556:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787780023.219560:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19400/0xc8fc0a5179961358 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780023.219565:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19400/0xc8fc0a5179961358 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787780023.219571:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787780023.219578:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881627776 00000100:00100000:1.0:1787780023.219601:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881627904 00000100:00100000:1.0:1787780023.219611:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881627904 00000100:00100000:2.0:1787780023.219641:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787780023.219655:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346da52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881627776:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1787780023.219658:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787780023.219670:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03489f5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3641:x1874622881627904:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1787780023.219687:0:8430:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:4 count 1 00000100:00100000:3.0:1787780023.219703:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0348836580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+19:12419:x1874622863731456:12345-192.168.203.31@tcp:44:lhsmtool_posix.0 Request processed in 4913us (5060us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780023.219711:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 198 00002000:00010000:1.0:1787780023.219713:0:8430:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a8f5bb4, atime: 0x6a8f5bb4, ctime: 0x6a8f5bb4, blocks: 0x8 00010000:00010000:1.0:1787780023.219725:0:8430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000390be292/0xc8fc0a5179961382 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780023.219739:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=431s v=(0 0) 00010000:00010000:1.0:1787780023.219749:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787780023.219756:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000390be292/0xc8fc0a5179961382 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787780023.219766:0:9899:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00010000:00010000:1.0:1787780023.219771:0:8430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000390be292/0xc8fc0a5179961382 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780023.219780:0:8430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000390be292/0xc8fc0a5179961382 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780023.219786:0:8430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000390be292/0xc8fc0a5179961382 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780023.219802:0:8430:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787780023.219929:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03489f5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3641:x1874622881627904:12345-0@lo:6:osp-syn-0-0.0 Request processed in 261us (357us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1787780023.219936:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000004:00080000:3.0:1787780023.220117:0:3641:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c03489f70c0/2, rc 0, transno 4294967308 00000100:00100000:3.0:1787780023.220124:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c03489f70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881627904:0@lo:6:osp-syn-0-0.0 00000100:00080000:0.0:1787780023.221044:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787780023.221051:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:2.0:1787780023.221205:0:9899:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1787780023 00002000:00010000:2.0:1787780023.221208:0:9899:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1787780023.221210:0:9899:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1787780023 -> 1787780023 00002000:00010000:2.0:1787780023.221212:0:9899:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:2.0:1787780023.221312:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346da52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3643:x1874622881627776:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1660us (1898us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1787780023.221322:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00010000:2.0:1787780023.221347:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787780023.221354:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000390be292/0xc8fc0a5179961382 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780023.221365:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0347e4a400 already unused, calling callback (ffffffffc0d97420) 00010000:00010000:2.0:1787780023.221369:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000390be292/0xc8fc0a5179961382 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780023.221378:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000390be292/0xc8fc0a5179961382 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780023.221395:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000390be292/0xc8fc0a5179961382 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780023.221414:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000390be292/0xc8fc0a5179961382 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780023.221434:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787780023.221436:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787780023.221438:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1787780023.221649:0:3643:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c0346da7840/2, rc 0, transno 4294967316 00000100:00100000:0.0:1787780023.221656:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346da7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881627776:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1787780023.223491:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787780023.223679:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863731584 00000100:00100000:1.0:1787780023.223688:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863731584 00000100:00100000:1.0:1787780023.223744:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 63 00000100:00100000:1.0:1787780023.223754:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346da70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+10:2408:x1874622863731584:12345-192.168.203.31@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1787780023.232331:0:9508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967316 is committed 00000001:00080000:0.0:1787780023.232347:0:9508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000100:00100000:1.0:1787780023.232766:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346da70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+7:2408:x1874622863731584:12345-192.168.203.31@tcp:16:lhsmtool_posix.0 Request processed in 9007us (9276us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780023.232884:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 63 00000100:00100000:3.0:1787780023.239040:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787780023.239177:0:12488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863731840 00000100:00100000:0.0:1787780023.239187:0:12488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863731840 00000100:00100000:0.0:1787780023.239254:0:12488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 199 00000100:00100000:0.0:1787780023.239265:0:12488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03489f4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:781d29bb-23d2-48e3-b16d-c29e52cd5375+19:12419:x1874622863731840:12345-192.168.203.31@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787780023.239319:0:12488:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787780023.239346:0:12488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868400/0xc8fc0a517996136d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea2077 expref: 19 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780023.239363:0:12488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9c0347bec100) 00010000:00010000:0.0:1787780023.239368:0:12488:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787780023.239397:0:12488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868e00/0xc8fc0a5179961389 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780023.239410:0:12488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868e00/0xc8fc0a5179961389 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780023.239438:0:12488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868e00/0xc8fc0a5179961389 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787780023.239574:0:12488:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cf06371b reply state 000000005c572192 transno 4294967463 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868e00/0xc8fc0a5179961389 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780023.239587:0:12488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868e00/0xc8fc0a5179961389 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780023.239595:0:12488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9c0347bec100) 00010000:00010000:0.0:1787780023.239598:0:12488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787780023.239601:0:12488:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787780023.239699:0:12488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03489f4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:781d29bb-23d2-48e3-b16d-c29e52cd5375+20:12419:x1874622863731840:12345-192.168.203.31@tcp:36:lhsmtool_posix.0 Request processed in 435us (777us total) trans 4294967463 rc 0/0 00000100:00100000:0.0:1787780023.239707:0:12488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 199 00000100:00100000:0.0:1787780023.245266:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787780023.245423:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863731968 00000100:00100000:1.0:1787780023.245433:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863731968 00000100:00100000:1.0:1787780023.245499:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 64 00000100:00100000:1.0:1787780023.245510:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046215de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+7:2411:x1874622863731968:12345-192.168.203.31@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1787780023.245667:0:8427:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1787780023.245671:0:8427:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 1787780023 -> 1787780022 00002000:00010000:1.0:1787780023.245674:0:8427:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 1787780020 00002000:00010000:1.0:1787780023.245676:0:8427:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1787780023 -> 1787780022 00002000:00010000:1.0:1787780023.245678:0:8427:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1787780023.245738:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046215de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+8:2411:x1874622863731968:12345-192.168.203.31@tcp:2:lhsmtool_posix.0 Request processed in 230us (481us total) trans 4294967317 rc 0/0 00000100:00100000:1.0:1787780023.245747:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 64 00000100:00100000:2.0:1787780023.250430:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787780023.250522:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863732224 00000100:00100000:3.0:1787780023.250540:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863732224 00000100:00100000:3.0:1787780023.250599:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 200 00000100:00100000:3.0:1787780023.250609:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347dac3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+20:12419:x1874622863732224:12345-192.168.203.31@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1787780023.250672:0:7821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd600/0xc8fc0a5179961390 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780023.250688:0:7821:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869600/0xc8fc0a5179961351 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea2069 expref: 20 pid: 7821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780023.250697:0:7821:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd600/0xc8fc0a5179961390 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780023.250729:0:7821:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869600/0xc8fc0a5179961351 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea2069 expref: 20 pid: 7821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780023.250743:0:7821:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869600/0xc8fc0a5179961351 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea2069 expref: 20 pid: 7821 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787780023.250758:0:7821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c03489f5a40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7821:1874622881628032:192.168.203.31@tcp:104: 00000100:00100000:3.0:1787780023.251208:0:7821:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c04778353c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787780023.254373:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787780023.254451:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863732352 00000100:00100000:0.0:1787780023.254460:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863732352 00010000:00010000:0.0:1787780023.254501:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869600/0xc8fc0a5179961351 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea2069 expref: 21 pid: 7821 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787780023.254554:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 88 00000100:00100000:0.0:1787780023.254564:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046099cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+21:2410:x1874622863732352:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787780023.254579:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787780023.254587:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869600/0xc8fc0a5179961351 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea2069 expref: 21 pid: 7821 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780023.254601:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869600/0xc8fc0a5179961351 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea2069 expref: 21 pid: 7821 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780023.254637:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9c0347bec100) 00010000:00010000:0.0:1787780023.254642:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd600/0xc8fc0a5179961390 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780023.254651:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd600/0xc8fc0a5179961390 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780023.254659:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd600/0xc8fc0a5179961390 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780023.254676:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787780023.254735:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046099cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+21:2410:x1874622863732352:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 171us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780023.254742:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 88 00010000:00010000:2.0:1787780023.256968:0:7821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869600/0xc8fc0a5179961351 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea2069 expref: 20 pid: 7821 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787780023.256991:0:7821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c03489f5a40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7821:1874622881628032:192.168.203.31@tcp:104: 00010000:00010000:2.0:1787780023.257011:0:7821:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd600/0xc8fc0a5179961390 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780023.257022:0:7821:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd600/0xc8fc0a5179961390 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780023.257028:0:7821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd600/0xc8fc0a5179961390 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780023.257064:0:7821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd600/0xc8fc0a5179961390 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780023.257071:0:7821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd600/0xc8fc0a5179961390 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780023.257078:0:7821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd600/0xc8fc0a5179961390 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780023.257164:0:7821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c04766dd600 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:2.0:1787780023.257170:0:7821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd600/0xc8fc0a5179961390 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780023.257177:0:7821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd600/0xc8fc0a5179961390 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780023.257191:0:7821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9c0347bec100) 00010000:00010000:2.0:1787780023.257194:0:7821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1787780023.257197:0:7821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd600/0xc8fc0a5179961390 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780023.257203:0:7821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd600/0xc8fc0a5179961390 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787780023.261279:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347dac3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+19:12419:x1874622863732224:12345-192.168.203.31@tcp:55:lhsmtool_posix.0 Request processed in 10659us (10845us total) trans 0 rc -22/-22 00000100:00100000:0.0:1787780023.261294:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 200 00000100:00100000:3.0:1787780023.269557:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787780023.269729:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863732480 00000100:00100000:2.0:1787780023.269739:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863732480 00000100:00100000:2.0:1787780023.269815:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 65 00000100:00100000:2.0:1787780023.269826:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03489f5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+8:2408:x1874622863732480:12345-192.168.203.31@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787780023.269911:0:8428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000009ef76f78/0xc8fc0a5179961397 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780023.269948:0:8428:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e521b2ec/0xc8fc0a517996137b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0xf757128131ea2085 expref: 8 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780023.269958:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787780023.269963:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787780023.269967:0:8428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009ef76f78/0xc8fc0a5179961397 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780023.270017:0:8428:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e521b2ec/0xc8fc0a517996137b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.31@tcp remote: 0xf757128131ea2085 expref: 8 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780023.270032:0:8428:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e521b2ec/0xc8fc0a517996137b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.31@tcp remote: 0xf757128131ea2085 expref: 8 pid: 8428 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787780023.270048:0:8428:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347dad2c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1874622881628160:192.168.203.31@tcp:104: 00000100:00100000:2.0:1787780023.270135:0:8428:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0347d45b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787780023.278212:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787780023.278326:0:8428:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347dad2c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1874622881628160:192.168.203.31@tcp:104: 00010000:00010000:1.0:1787780023.278354:0:8428:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009ef76f78/0xc8fc0a5179961397 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787780023.278435:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863732608 00000100:00100000:3.0:1787780023.278442:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863732608 00010000:00010000:3.0:1787780023.278479:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e521b2ec/0xc8fc0a517996137b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.31@tcp remote: 0xf757128131ea2085 expref: 9 pid: 8428 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787780023.278526:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 89 00000100:00100000:3.0:1787780023.278544:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346daed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+9:2411:x1874622863732608:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787780023.278559:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787780023.278580:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e521b2ec/0xc8fc0a517996137b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.31@tcp remote: 0xf757128131ea2085 expref: 9 pid: 8428 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780023.278593:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e521b2ec/0xc8fc0a517996137b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.31@tcp remote: 0xf757128131ea2085 expref: 9 pid: 8428 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780023.278616:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e521b2ec/0xc8fc0a517996137b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.31@tcp remote: 0xf757128131ea2085 expref: 9 pid: 8428 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780023.278630:0:6499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787780023.278635:0:6499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787780023.278639:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009ef76f78/0xc8fc0a5179961397 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780023.278648:0:6499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009ef76f78/0xc8fc0a5179961397 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780023.278693:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787780023.278746:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346daed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+8:2411:x1874622863732608:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 204us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780023.278755:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 89 00010000:00010000:2.0:1787780023.279195:0:8428:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009ef76f78/0xc8fc0a5179961397 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780023.279206:0:8428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009ef76f78/0xc8fc0a5179961397 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780023.279228:0:8428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000009ef76f78/0xc8fc0a5179961397 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780023.279236:0:8428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009ef76f78/0xc8fc0a5179961397 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780023.279245:0:8428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009ef76f78/0xc8fc0a5179961397 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780023.279252:0:8428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0444c19600 already unused, calling callback (ffffffffc0d97420) 00010000:00010000:2.0:1787780023.279265:0:8428:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009ef76f78/0xc8fc0a5179961397 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780023.279274:0:8428:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009ef76f78/0xc8fc0a5179961397 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780023.279287:0:8428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009ef76f78/0xc8fc0a5179961397 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780023.279294:0:8428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009ef76f78/0xc8fc0a5179961397 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787780023.279356:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03489f5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+7:2408:x1874622863732480:12345-192.168.203.31@tcp:1:lhsmtool_posix.0 Request processed in 9532us (9810us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780023.279364:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 65 00000100:00100000:2.0:1787780023.284524:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787780023.284657:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863732864 00000100:00100000:3.0:1787780023.284666:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863732864 00000100:00100000:3.0:1787780023.284721:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 201 00000100:00100000:3.0:1787780023.284731:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346dac780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+19:12419:x1874622863732864:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787780023.284822:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a517996139e lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780023.284870:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4b000/0xc8fc0a51799611e5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea200e expref: 19 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780023.284881:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a517996139e lrc: 4/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780023.284918:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4b000/0xc8fc0a51799611e5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea200e expref: 19 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780023.286080:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4b000/0xc8fc0a51799611e5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea200e expref: 19 pid: 6514 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787780023.286101:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477940000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1874622881628288:192.168.203.31@tcp:104: 00000100:00100000:3.0:1787780023.286198:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0477835cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787780023.292923:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787780023.292983:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863732992 00000100:00100000:0.0:1787780023.292990:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863732992 00010000:00010000:0.0:1787780023.293032:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4b000/0xc8fc0a51799611e5 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea200e expref: 20 pid: 6514 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787780023.293076:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 90 00000100:00100000:0.0:1787780023.293086:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347dad2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+20:2411:x1874622863732992:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787780023.293102:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787780023.293109:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4b000/0xc8fc0a51799611e5 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea200e expref: 20 pid: 6514 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780023.293141:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4b000/0xc8fc0a51799611e5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea200e expref: 20 pid: 6514 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780023.293164:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c04478d7400) 00010000:00010000:0.0:1787780023.293169:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a517996139e lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780023.293178:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a517996139e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780023.293198:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a517996139e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780023.293217:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787780023.293273:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347dad2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+20:2411:x1874622863732992:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 187us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780023.293283:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 90 00010000:00010000:3.0:1787780023.293286:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4b000/0xc8fc0a51799611e5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea200e expref: 20 pid: 6514 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787780023.293316:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477940000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1874622881628288:192.168.203.31@tcp:104: 00010000:00010000:3.0:1787780023.293334:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a517996139e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780023.293344:0:6513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a517996139e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780023.293350:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a517996139e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780023.293583:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd600/0xc8fc0a51799613a5 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780023.293595:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd200/0xc8fc0a517996135f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea2070 expref: 19 pid: 12488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780023.293603:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd600/0xc8fc0a51799613a5 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780023.293630:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd200/0xc8fc0a517996135f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea2070 expref: 19 pid: 12488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780023.293642:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd200/0xc8fc0a517996135f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea2070 expref: 19 pid: 12488 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787780023.293655:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477940000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1874622881628416:192.168.203.31@tcp:104: 00000100:00100000:3.0:1787780023.293701:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0477835840 going to sleep for 11 seconds 00000100:00100000:3.0:1787780023.305124:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477940000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1874622881628416:192.168.203.31@tcp:104: 00010000:00010000:3.0:1787780023.305153:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd600/0xc8fc0a51799613a5 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787780023.309561:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787780023.309656:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863733120 00000100:00100000:3.0:1787780023.309666:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863733120 00010000:00010000:3.0:1787780023.309706:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd200/0xc8fc0a517996135f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea2070 expref: 20 pid: 12488 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787780023.309747:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 91 00000100:00100000:3.0:1787780023.309757:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347ebe580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+20:2410:x1874622863733120:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787780023.309780:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787780023.309788:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd200/0xc8fc0a517996135f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea2070 expref: 20 pid: 12488 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780023.309810:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd200/0xc8fc0a517996135f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea2070 expref: 20 pid: 12488 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780023.309833:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd200/0xc8fc0a517996135f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea2070 expref: 20 pid: 12488 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780023.309890:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9c0347bec100) 00010000:00010000:3.0:1787780023.309896:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd600/0xc8fc0a51799613a5 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780023.309905:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd600/0xc8fc0a51799613a5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780023.309913:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd600/0xc8fc0a51799613a5 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780023.310048:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787780023.310117:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347ebe580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+19:2410:x1874622863733120:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 360us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780023.310126:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 91 00010000:00010000:3.0:1787780023.310649:0:6513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd600/0xc8fc0a51799613a5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780023.310659:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd600/0xc8fc0a51799613a5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787780023.310780:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000001:00080000:3.0:1787780023.311130:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000001:00080000:3.0:1787780023.311169:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000100:00100000:3.0:1787780023.311259:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477940000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6513:1874622881628544:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787780023.311312:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780023.311565:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0477835c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787780023.311637:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881628544 00000100:00100000:0.0:1787780023.311644:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881628544 00000100:00100000:0.0:1787780023.311698:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1787780023.311708:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04764403c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6513:x1874622881628544:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787780023.311799:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04764403c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6513:x1874622881628544:12345-0@lo:1000:mdt00_001.0 Request processed in 93us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780023.311807:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1787780023.313741:0:6513:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967316 gen 2 00000004:00080000:3.0:1787780023.313753:0:6513:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c0346da7840, transno 4294967316 00000100:00100000:3.0:1787780023.313773:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477940000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6513:1874622881628544:0@lo:1000:mdt00_001.0 00000001:00080000:3.0:1787780023.314123:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00000100:00100000:3.0:1787780023.314196:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04764430c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6513:1874622881628672:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787780023.314249:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780023.314284:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c04778356c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787780023.314714:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881628672 00000100:00100000:1.0:1787780023.314721:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881628672 00000100:00100000:1.0:1787780023.314777:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1787780023.314794:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477940000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6513:x1874622881628672:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787780023.315460:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477940000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6513:x1874622881628672:12345-0@lo:1000:mdt00_001.0 Request processed in 673us (1208us total) trans 4294967318 rc 0/0 00000100:00100000:3.0:1787780023.315635:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04764430c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6513:1874622881628672:0@lo:1000:mdt00_001.0 00010000:00010000:3.0:1787780023.315676:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd600/0xc8fc0a51799613a5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780023.315687:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd600/0xc8fc0a51799613a5 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780023.315694:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd600/0xc8fc0a51799613a5 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780023.315712:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c04766dd600 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:3.0:1787780023.315717:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd600/0xc8fc0a51799613a5 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780023.315725:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd600/0xc8fc0a51799613a5 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780023.315741:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9c0347bec100) 00010000:00010000:3.0:1787780023.315744:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787780023.315749:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd600/0xc8fc0a51799613a5 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780023.315754:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd600/0xc8fc0a51799613a5 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780023.315799:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4ba00/0xc8fc0a51799612da lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780023.315806:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4ba00/0xc8fc0a51799612da lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780023.315812:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4ba00/0xc8fc0a51799612da lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780023.315816:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0347e4ba00 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:3.0:1787780023.315819:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4ba00/0xc8fc0a51799612da lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780023.315824:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4ba00/0xc8fc0a51799612da lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780023.315866:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c04478d7400) 00010000:00010000:3.0:1787780023.315868:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787780023.315872:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4ba00/0xc8fc0a51799612da lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780023.316363:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4ba00/0xc8fc0a51799612da lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780023.316389:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dca00/0xc8fc0a51799613ac lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780023.316404:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc600/0xc8fc0a51799612f6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea2054 expref: 22 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780023.316414:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dca00/0xc8fc0a51799613ac lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780023.316520:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc600/0xc8fc0a51799612f6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea2054 expref: 22 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780023.316544:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc600/0xc8fc0a51799612f6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea2054 expref: 22 pid: 6514 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787780023.316557:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0345e75a40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1874622881628800:192.168.203.31@tcp:104: 00000100:00100000:3.0:1787780023.316634:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c04778356c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787780023.324464:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0345e75a40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1874622881628800:192.168.203.31@tcp:104: 00010000:00010000:0.0:1787780023.324494:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dca00/0xc8fc0a51799613ac lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787780023.325392:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787780023.326042:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1787780023.326300:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863733248 00000100:00100000:2.0:1787780023.326308:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863733248 00010000:00010000:2.0:1787780023.326354:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc600/0xc8fc0a51799612f6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea2054 expref: 23 pid: 6514 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787780023.326393:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 92 00000100:00100000:2.0:1787780023.326403:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04812a8f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+23:2411:x1874622863733248:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787780023.326431:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787780023.326439:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc600/0xc8fc0a51799612f6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea2054 expref: 23 pid: 6514 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780023.326453:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc600/0xc8fc0a51799612f6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea2054 expref: 23 pid: 6514 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780023.326474:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc600/0xc8fc0a51799612f6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea2054 expref: 23 pid: 6514 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780023.326488:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c04478d7400) 00010000:00010000:2.0:1787780023.326493:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dca00/0xc8fc0a51799613ac lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780023.326501:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dca00/0xc8fc0a51799613ac lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780023.326509:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dca00/0xc8fc0a51799613ac lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780023.326541:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787780023.326614:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04812a8f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+22:2411:x1874622863733248:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 212us (1226us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780023.326623:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 92 00010000:00010000:0.0:1787780023.326817:0:6513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dca00/0xc8fc0a51799613ac lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780023.326835:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dca00/0xc8fc0a51799613ac lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780023.326872:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dca00/0xc8fc0a51799613ac lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780023.326879:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dca00/0xc8fc0a51799613ac lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780023.326885:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dca00/0xc8fc0a51799613ac lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780023.326892:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c04766dca00 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:0.0:1787780023.326896:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dca00/0xc8fc0a51799613ac lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780023.326904:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dca00/0xc8fc0a51799613ac lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780023.326913:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c04478d7400) 00010000:00010000:0.0:1787780023.326915:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787780023.326918:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dca00/0xc8fc0a51799613ac lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780023.326924:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dca00/0xc8fc0a51799613ac lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780023.327068:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a517996139e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780023.327084:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a517996139e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780023.327091:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a517996139e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780023.327096:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c04766dc400 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:0.0:1787780023.327100:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a517996139e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780023.327106:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a517996139e lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780023.327114:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c04478d7400) 00010000:00010000:0.0:1787780023.327117:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787780023.327120:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a517996139e lrc: 2/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780023.327126:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a517996139e lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787780023.327655:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346dac780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+21:12419:x1874622863732864:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 Request processed in 42922us (43149us total) trans 4294967468 rc 0/0 00000100:00100000:0.0:1787780023.327665:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 201 00000020:00080000:0.0:1787780023.327670:0:6513:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1787780023.328390:0:13794:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787780023.328395:0:13794:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787780023.329715:0:13794:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:2.0:1787780023.329731:0:13794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787780023.334063:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787780023.334217:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863733504 00000100:00100000:2.0:1787780023.334241:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863733504 00000100:00100000:2.0:1787780023.334300:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 50 00000100:00100000:2.0:1787780023.334310:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0443619c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+21:12419:x1874622863733504:12345-192.168.203.31@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1787780023.334571:0:6515:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787780023.334602:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967469 00010000:00010000:2.0:1787780023.334637:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18000/0xc8fc0a51799613b3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780023.334654:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18000/0xc8fc0a51799613b3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780023.334664:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18000/0xc8fc0a51799613b3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780023.334673:0:6515:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18000/0xc8fc0a51799613b3 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780023.334679:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18000/0xc8fc0a51799613b3 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780023.334686:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18000/0xc8fc0a51799613b3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780023.334708:0:6515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787780023.334786:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0443619c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+23:12419:x1874622863733504:12345-192.168.203.31@tcp:35:lhsmtool_posix.0 Request processed in 476us (732us total) trans 4294967470 rc 0/0 00000100:00100000:2.0:1787780023.334794:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 50 00000020:00080000:2.0:1787780023.334799:0:6515:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787780023.336098:0:7453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787780023.336109:0:7453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18000/0xc8fc0a51799613b3 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780023.336134:0:7453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0444c18000 already unused, calling callback (ffffffffc0d97420) 00010000:00010000:3.0:1787780023.336139:0:7453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18000/0xc8fc0a51799613b3 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780023.336147:0:7453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18000/0xc8fc0a51799613b3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780023.336162:0:7453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9c0347bec100) 00010000:00010000:3.0:1787780023.336165:0:7453:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787780023.336171:0:7453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18000/0xc8fc0a51799613b3 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780023.336177:0:7453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18000/0xc8fc0a51799613b3 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780023.336192:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787780023.336194:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787780023.336196:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787780023.452019:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787780023.516827:0:13797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787780024.092820:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346da7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874622881628928:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787780024.092916:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780024.096579:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881628928 00000100:00100000:1.0:1787780024.096592:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881628928 00000100:00100000:1.0:1787780024.096648:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1787780024.096657:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0345e74f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1874622881628928:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787780024.096689:0:14310:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1787780024.096771:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0345e74f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1874622881628928:12345-0@lo:41:osp-pre-0-1.0 Request processed in 107us (3847us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780024.096778:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1787780024.099288:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346da7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874622881628928:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787780024.478216:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787780024.604133:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0345e761c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881629056:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787780024.604207:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780024.604286:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881629056 00000100:00100000:1.0:1787780024.604294:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881629056 00000100:00100000:1.0:1787780024.604406:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1787780024.604416:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346de3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881629056:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787780024.604452:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787780024.604497:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346de3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881629056:12345-0@lo:41:osp-pre-1-0.0 Request processed in 82us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780024.604504:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1787780024.604695:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0345e761c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881629056:0@lo:41:osp-pre-1-0.0 00000040:00080000:1.0:1787780024.922661:0:14755:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787780024.922669:0:14755:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787780024.922692:0:14755:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1787780024.922698:0:14755:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787780025.097312:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787780025.097576:0:12488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863733760 00000100:00100000:0.0:1787780025.097585:0:12488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863733760 00000100:00100000:0.0:1787780025.097663:0:12488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 202 00000100:00100000:0.0:1787780025.097675:0:12488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03488e12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:781d29bb-23d2-48e3-b16d-c29e52cd5375+23:12436:x1874622863733760:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:0.0:1787780025.097709:0:12488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787780025.097728:0:12488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868c00/0xc8fc0a51799613ba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea208c expref: -99 pid: 12488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780025.097867:0:12488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868a00/0xc8fc0a51799613c1 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780025.097882:0:12488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868a00/0xc8fc0a51799613c1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780025.097895:0:12488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868a00/0xc8fc0a51799613c1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787780025.097906:0:12488:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1787780025.098008:0:12488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868c00/0xc8fc0a51799613ba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea208c expref: 26 pid: 12488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780025.098027:0:12488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868a00/0xc8fc0a51799613c1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea208c expref: 25 pid: 12488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780025.098036:0:12488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c04478d7d00) 00010000:00010000:0.0:1787780025.098045:0:12488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787780025.098049:0:12488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0477868a00, rc 0) 00000100:00100000:0.0:1787780025.098108:0:12488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03488e12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:781d29bb-23d2-48e3-b16d-c29e52cd5375+25:12436:x1874622863733760:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 435us (806us total) trans 4294967471 rc 0/0 00000100:00100000:0.0:1787780025.098115:0:12488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 202 00000100:00080000:1.0:1787780025.098333:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787780025.104590:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787780025.104765:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863733888 00000100:00100000:1.0:1787780025.104775:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863733888 00000100:00100000:1.0:1787780025.105902:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 203 00000100:00100000:1.0:1787780025.105915:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0348a08b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+25:12436:x1874622863733888:12345-192.168.203.31@tcp:34:lfs.0 00010000:00010000:1.0:1787780025.106007:0:7821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4aa00/0xc8fc0a51799613cf lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780025.106022:0:7821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4aa00/0xc8fc0a51799613cf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780025.106034:0:7821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4aa00/0xc8fc0a51799613cf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780025.106050:0:7821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4ac00/0xc8fc0a51799613d6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780025.106057:0:7821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4ac00/0xc8fc0a51799613d6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780025.106063:0:7821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4ac00/0xc8fc0a51799613d6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780025.106146:0:7821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4ae00/0xc8fc0a51799613dd lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780025.106153:0:7821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4ae00/0xc8fc0a51799613dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780025.106161:0:7821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4ae00/0xc8fc0a51799613dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787780025.106206:0:7821:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4ae00/0xc8fc0a51799613dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780025.106219:0:7821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4aa00/0xc8fc0a51799613cf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780025.106235:0:7821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4aa00/0xc8fc0a51799613cf lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780025.106241:0:7821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4aa00/0xc8fc0a51799613cf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780025.106248:0:7821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0347e4aa00 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:1.0:1787780025.106252:0:7821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4aa00/0xc8fc0a51799613cf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780025.106260:0:7821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4aa00/0xc8fc0a51799613cf lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780025.106274:0:7821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c04478d7d00) 00010000:00010000:1.0:1787780025.106277:0:7821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787780025.106281:0:7821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4aa00/0xc8fc0a51799613cf lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780025.106287:0:7821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4aa00/0xc8fc0a51799613cf lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780025.106300:0:7821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4ac00/0xc8fc0a51799613d6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780025.106305:0:7821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4ac00/0xc8fc0a51799613d6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780025.106310:0:7821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4ac00/0xc8fc0a51799613d6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780025.106315:0:7821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0347e4ac00 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:1.0:1787780025.106323:0:7821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4ac00/0xc8fc0a51799613d6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780025.106330:0:7821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4ac00/0xc8fc0a51799613d6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780025.106337:0:7821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9c0341cd1a00) 00010000:00010000:1.0:1787780025.106340:0:7821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787780025.106343:0:7821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4ac00/0xc8fc0a51799613d6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780025.106348:0:7821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4ac00/0xc8fc0a51799613d6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780025.106363:0:7821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4ae00/0xc8fc0a51799613dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780025.106368:0:7821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4ae00/0xc8fc0a51799613dd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780025.106373:0:7821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4ae00/0xc8fc0a51799613dd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780025.106377:0:7821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0347e4ae00 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:1.0:1787780025.106380:0:7821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4ae00/0xc8fc0a51799613dd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780025.106385:0:7821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4ae00/0xc8fc0a51799613dd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780025.106392:0:7821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c0341cd1e00) 00010000:00010000:1.0:1787780025.106394:0:7821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787780025.106402:0:7821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4ae00/0xc8fc0a51799613dd lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780025.106407:0:7821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4ae00/0xc8fc0a51799613dd lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787780025.106591:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0348a08b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+25:12436:x1874622863733888:12345-192.168.203.31@tcp:34:lfs.0 Request processed in 678us (2010us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780025.106600:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 203 00000100:00100000:0.0:1787780025.168914:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787780025.169132:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863734144 00000100:00100000:3.0:1787780025.169145:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863734144 00000100:00100000:3.0:1787780025.169221:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 204 00000100:00100000:3.0:1787780025.169233:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477840000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+25:12439:x1874622863734144:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:3.0:1787780025.169261:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787780025.169289:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd600/0xc8fc0a51799613e4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea2093 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780025.169418:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc200/0xc8fc0a51799613eb lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780025.169438:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc200/0xc8fc0a51799613eb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780025.169452:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc200/0xc8fc0a51799613eb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780025.169470:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd200/0xc8fc0a51799613f2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780025.169477:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd200/0xc8fc0a51799613f2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780025.169484:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd200/0xc8fc0a51799613f2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780025.169638:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766ddc00/0xc8fc0a51799613f9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780025.169648:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766ddc00/0xc8fc0a51799613f9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780025.169656:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766ddc00/0xc8fc0a51799613f9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787780025.169667:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:3.0:1787780025.169764:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc200/0xc8fc0a51799613eb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780025.169773:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc200/0xc8fc0a51799613eb lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780025.169788:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc200/0xc8fc0a51799613eb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780025.169795:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c04766dc200 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:3.0:1787780025.169799:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc200/0xc8fc0a51799613eb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780025.169809:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc200/0xc8fc0a51799613eb lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780025.169825:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c04478d7d00) 00010000:00010000:3.0:1787780025.169828:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787780025.169833:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc200/0xc8fc0a51799613eb lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780025.169883:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc200/0xc8fc0a51799613eb lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780025.169901:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd200/0xc8fc0a51799613f2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780025.169908:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd200/0xc8fc0a51799613f2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780025.169913:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd200/0xc8fc0a51799613f2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780025.169919:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c04766dd200 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:3.0:1787780025.169922:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd200/0xc8fc0a51799613f2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780025.169949:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd200/0xc8fc0a51799613f2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780025.169960:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9c0443d81b00) 00010000:00010000:3.0:1787780025.169963:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787780025.169966:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd200/0xc8fc0a51799613f2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780025.169972:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd200/0xc8fc0a51799613f2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780025.170023:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd600/0xc8fc0a51799613e4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea2093 expref: 28 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780025.170038:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766ddc00/0xc8fc0a51799613f9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea2093 expref: 27 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780025.170045:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c0443d81600) 00010000:00010000:3.0:1787780025.170048:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787780025.170050:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c04766ddc00, rc 0) 00000100:00100000:3.0:1787780025.170126:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477840000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+27:12439:x1874622863734144:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 895us (1225us total) trans 4294967472 rc 0/0 00000100:00100000:3.0:1787780025.170136:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 204 00000100:00100000:2.0:1787780025.173308:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787780025.174700:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863734272 00000100:00100000:0.0:1787780025.174713:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863734272 00000100:00100000:0.0:1787780025.174794:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 205 00000100:00100000:0.0:1787780025.174808:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03488e1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+27:12439:x1874622863734272:12345-192.168.203.31@tcp:54:lfs.0 00010000:00010000:0.0:1787780025.174986:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868c00/0xc8fc0a5179961407 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780025.175004:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868c00/0xc8fc0a5179961407 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780025.175016:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868c00/0xc8fc0a5179961407 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780025.175111:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868c00/0xc8fc0a5179961407 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780025.175120:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868c00/0xc8fc0a5179961407 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780025.175127:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868c00/0xc8fc0a5179961407 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780025.175134:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0477868c00 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:0.0:1787780025.175139:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868c00/0xc8fc0a5179961407 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780025.175156:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868c00/0xc8fc0a5179961407 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780025.175171:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c0443d81600) 00010000:00010000:0.0:1787780025.175175:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787780025.175180:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868c00/0xc8fc0a5179961407 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780025.175187:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868c00/0xc8fc0a5179961407 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787780025.175729:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03488e1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+27:12439:x1874622863734272:12345-192.168.203.31@tcp:54:lfs.0 Request processed in 921us (2425us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780025.175739:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 205 00000100:00100000:2.0:1787780025.184914:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787780025.184983:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863734528 00000100:00100000:2.0:1787780025.184995:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863734528 00000100:00100000:2.0:1787780025.185057:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 51 00000100:00100000:2.0:1787780025.185070:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03488e2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+27:12439:x1874622863734528:12345-192.168.203.31@tcp:35:lfs.0 00000100:00100000:2.0:1787780025.185364:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03488e2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+28:12439:x1874622863734528:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 296us (468us total) trans 4294967473 rc 0/0 00000100:00100000:2.0:1787780025.185634:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 51 00000100:00100000:2.0:1787780025.226499:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787780025.226787:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863734784 00000100:00100000:1.0:1787780025.226800:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863734784 00000100:00100000:1.0:1787780025.226922:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 206 00000100:00100000:1.0:1787780025.226935:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03488e0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+28:11963:x1874622863734784:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:0.0:1787780025.227001:0:7821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787780025.227036:0:7821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868c00/0xc8fc0a517996140e lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea209a expref: -99 pid: 7821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780025.227150:0:7821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868200/0xc8fc0a5179961415 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780025.227166:0:7821:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766ddc00/0xc8fc0a51799613f9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea2093 expref: 29 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780025.227176:0:7821:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868200/0xc8fc0a5179961415 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780025.227212:0:7821:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766ddc00/0xc8fc0a51799613f9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea2093 expref: 29 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780025.227245:0:7821:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766ddc00/0xc8fc0a51799613f9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea2093 expref: 29 pid: 6513 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787780025.227259:0:7821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477842d00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7821:1874622881629184:192.168.203.31@tcp:104: 00000100:00100000:0.0:1787780025.229092:0:7821:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0347ec6c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787780025.234664:0:7821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477842d00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7821:1874622881629184:192.168.203.31@tcp:104: 00010000:00010000:0.0:1787780025.234693:0:7821:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868200/0xc8fc0a5179961415 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787780025.235064:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787780025.235341:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863734912 00000100:00100000:3.0:1787780025.235359:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863734912 00010000:00010000:3.0:1787780025.235417:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766ddc00/0xc8fc0a51799613f9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea2093 expref: 30 pid: 6513 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787780025.235498:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 93 00000100:00100000:3.0:1787780025.235509:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347e54b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+30:2411:x1874622863734912:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787780025.236012:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787780025.236025:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766ddc00/0xc8fc0a51799613f9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea2093 expref: 30 pid: 6513 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780025.236042:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766ddc00/0xc8fc0a51799613f9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea2093 expref: 30 pid: 6513 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780025.236073:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766ddc00/0xc8fc0a51799613f9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea2093 expref: 30 pid: 6513 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780025.236091:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c0443d81600) 00010000:00010000:3.0:1787780025.236096:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868200/0xc8fc0a5179961415 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780025.236107:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868200/0xc8fc0a5179961415 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780025.236116:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868200/0xc8fc0a5179961415 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780025.237623:0:7821:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868200/0xc8fc0a5179961415 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780025.237642:0:7821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868200/0xc8fc0a5179961415 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787780025.237672:0:7821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:3.0:1787780025.237908:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787780025.238094:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347e54b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+29:2411:x1874622863734912:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 2575us (3020us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780025.238120:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 93 00010000:00010000:0.0:1787780025.238549:0:7821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868c00/0xc8fc0a517996140e lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea209a expref: 30 pid: 7821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780025.238571:0:7821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868200/0xc8fc0a5179961415 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea209a expref: 29 pid: 7821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780025.238581:0:7821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c0443d81600) 00010000:00010000:0.0:1787780025.238584:0:7821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787780025.238587:0:7821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0477868200, rc 0) 00000100:00100000:0.0:1787780025.238665:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03488e0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+29:11963:x1874622863734784:12345-192.168.203.31@tcp:101:bash.0 Request processed in 11732us (12183us total) trans 4294967474 rc 0/0 00000100:00100000:0.0:1787780025.238672:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 206 00000100:00100000:2.0:1787780025.246485:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787780025.250979:0:12488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863735040 00000100:00100000:0.0:1787780025.251008:0:12488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863735040 00000100:00100000:0.0:1787780025.251100:0:12488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 207 00000100:00100000:0.0:1787780025.251110:0:12488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c044400f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:781d29bb-23d2-48e3-b16d-c29e52cd5375+29:11963:x1874622863735040:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:0.0:1787780025.251134:0:12488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787780025.251155:0:12488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868c00/0xc8fc0a5179961423 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea20a1 expref: -99 pid: 12488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780025.251191:0:12488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869600/0xc8fc0a517996142a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780025.251205:0:12488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869600/0xc8fc0a517996142a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780025.251217:0:12488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869600/0xc8fc0a517996142a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780025.251332:0:12488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868c00/0xc8fc0a5179961423 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea20a1 expref: 31 pid: 12488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780025.251349:0:12488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869600/0xc8fc0a517996142a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea20a1 expref: 30 pid: 12488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780025.251357:0:12488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c0443d81600) 00010000:00010000:0.0:1787780025.251360:0:12488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787780025.251364:0:12488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0477869600, rc 0) 00000100:00100000:0.0:1787780025.251430:0:12488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c044400f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:781d29bb-23d2-48e3-b16d-c29e52cd5375+30:11963:x1874622863735040:12345-192.168.203.31@tcp:101:bash.0 Request processed in 321us (4953us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780025.251437:0:12488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 207 00000100:00100000:2.0:1787780025.256103:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787780025.256226:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863735296 00000100:00100000:0.0:1787780025.256246:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863735296 00000100:00100000:0.0:1787780025.256311:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 208 00000100:00100000:0.0:1787780025.256322:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347e55e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+30:11963:x1874622863735296:12345-192.168.203.31@tcp:36:bash.0 00010000:00010000:0.0:1787780025.256552:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868400/0xc8fc0a5179961431 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780025.256569:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868400/0xc8fc0a5179961431 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780025.256582:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868400/0xc8fc0a5179961431 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787780025.256626:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967475 00000004:00010000:0.0:1787780025.256648:0:6514:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000040e39f18 reply state 00000000c711b461 transno 4294967476 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868400/0xc8fc0a5179961431 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780025.256661:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868400/0xc8fc0a5179961431 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780025.256668:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c0443d81600) 00010000:00010000:0.0:1787780025.256670:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787780025.256674:0:6514:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1787780025.256723:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967476 00000100:00100000:0.0:1787780025.256871:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347e55e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+34:11963:x1874622863735296:12345-192.168.203.31@tcp:36:bash.0 Request processed in 548us (774us total) trans 4294967477 rc 0/0 00000100:00100000:0.0:1787780025.256880:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 208 00000020:00080000:0.0:1787780025.256885:0:6514:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1787780025.265773:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787780025.266365:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863735424 00000100:00100000:1.0:1787780025.266375:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863735424 00000100:00100000:1.0:1787780025.266468:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 209 00000100:00100000:1.0:1787780025.266479:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477842940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+34:11963:x1874622863735424:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:1.0:1787780025.266501:0:7821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787780025.266534:0:7821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4aa00/0xc8fc0a5179961438 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea20a8 expref: -99 pid: 7821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780025.266590:0:7821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4aa00/0xc8fc0a5179961438 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea20a8 expref: 35 pid: 7821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780025.266625:0:7821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4aa00/0xc8fc0a5179961438 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea20a8 expref: 35 pid: 7821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780025.266644:0:7821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c0443d81600) 00010000:00010000:1.0:1787780025.266648:0:7821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787780025.266651:0:7821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0347e4aa00, rc 0) 00000100:00100000:1.0:1787780025.266720:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477842940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+35:11963:x1874622863735424:12345-192.168.203.31@tcp:101:bash.0 Request processed in 243us (956us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780025.266727:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 209 00000100:00100000:2.0:1787780025.271991:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787780025.272084:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863735552 00000100:00100000:1.0:1787780025.272095:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863735552 00000100:00100000:1.0:1787780025.272163:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 66 00000100:00100000:1.0:1787780025.272174:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347e552c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+7:11963:x1874622863735552:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:1.0:1787780025.272191:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787780025.272213:0:8427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000094079826/0xc8fc0a517996143f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea20af expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787780025.272236:0:8427:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a8f5bb6, atime: 0x6a8f5bb4, ctime: 0x6a8f5bb6, blocks: 0x8 00010000:00010000:1.0:1787780025.272256:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=433s v=(0 0) 00010000:00010000:1.0:1787780025.272261:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787780025.272269:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000094079826/0xc8fc0a517996143f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea20af expref: 8 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780025.272287:0:8427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000094079826/0xc8fc0a517996143f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea20af expref: 8 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780025.272321:0:8427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0347e4ac00, rc 0) 00000100:00100000:1.0:1787780025.272379:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347e552c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+8:11963:x1874622863735552:12345-192.168.203.31@tcp:101:bash.0 Request processed in 207us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780025.272387:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 66 00000100:00080000:0.0:1787780025.272462:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787780025.275967:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787780025.276061:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863735680 00000100:00100000:1.0:1787780025.276072:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863735680 00002000:00010000:1.0:1787780025.276115:0:8434:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/5 (0->18446744073709551615) 00002000:00100000:1.0:1787780025.276120:0:8434:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c0347e54000 with x1874622863735680 ext(0->18446744073709551615) 00002000:00010000:1.0:1787780025.276131:0:8434:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c0347e54000. 00000100:00100000:1.0:1787780025.276165:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 5 00000100:00100000:1.0:1787780025.276174:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347e54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+8:2411:x1874622863735680:12345-192.168.203.31@tcp:10:bash.0 00002000:00010000:1.0:1787780025.276434:0:8434:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1787780025.276438:0:8434:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 1787780022 -> 1787780026 00002000:00010000:1.0:1787780025.276440:0:8434:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 1787780020 -> 1787780020 00002000:00010000:1.0:1787780025.276443:0:8434:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1787780022 -> 1787780026 00002000:00010000:1.0:1787780025.276445:0:8434:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:1.0:1787780025.276508:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347e54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+9:2411:x1874622863735680:12345-192.168.203.31@tcp:10:bash.0 Request processed in 334us (548us total) trans 4294967319 rc 0/0 00000100:00100000:1.0:1787780025.276532:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 5 00002000:00010000:1.0:1787780025.276535:0:8434:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/5 (0->18446744073709551615) 00002000:00100000:1.0:1787780025.276538:0:8434:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c0347e54000 with x1874622863735680 ext(0->18446744073709551615) 00002000:00010000:1.0:1787780025.276543:0:8434:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c0347e54000. 00000100:00100000:0.0:1787780025.354644:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787780025.357194:0:12488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863735808 00000100:00100000:3.0:1787780025.357209:0:12488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863735808 00000100:00100000:2.0:1787780025.358383:0:12488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 210 00000100:00100000:2.0:1787780025.358398:0:12488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477843840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:781d29bb-23d2-48e3-b16d-c29e52cd5375+35:12453:x1874622863735808:12345-192.168.203.31@tcp:34:lfs.0 00010000:00010000:2.0:1787780025.358473:0:12488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18e00/0xc8fc0a5179961446 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780025.358489:0:12488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18e00/0xc8fc0a5179961446 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780025.358500:0:12488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18e00/0xc8fc0a5179961446 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780025.358522:0:12488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18c00/0xc8fc0a517996144d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780025.358529:0:12488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18c00/0xc8fc0a517996144d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780025.358548:0:12488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18c00/0xc8fc0a517996144d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780025.358624:0:12488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18400/0xc8fc0a5179961454 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780025.358633:0:12488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18400/0xc8fc0a5179961454 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780025.358639:0:12488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18400/0xc8fc0a5179961454 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787780025.358683:0:12488:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18400/0xc8fc0a5179961454 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780025.358693:0:12488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18e00/0xc8fc0a5179961446 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780025.358700:0:12488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18e00/0xc8fc0a5179961446 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780025.358707:0:12488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18e00/0xc8fc0a5179961446 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780025.358712:0:12488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0444c18e00 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:2.0:1787780025.358716:0:12488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18e00/0xc8fc0a5179961446 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780025.358723:0:12488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18e00/0xc8fc0a5179961446 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780025.358735:0:12488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c04478d7d00) 00010000:00010000:2.0:1787780025.358744:0:12488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787780025.358749:0:12488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18e00/0xc8fc0a5179961446 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780025.359833:0:12488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18e00/0xc8fc0a5179961446 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780025.360495:0:12488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18c00/0xc8fc0a517996144d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780025.360502:0:12488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18c00/0xc8fc0a517996144d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780025.360508:0:12488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18c00/0xc8fc0a517996144d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780025.360523:0:12488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0444c18c00 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:2.0:1787780025.360527:0:12488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18c00/0xc8fc0a517996144d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780025.360534:0:12488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18c00/0xc8fc0a517996144d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780025.360548:0:12488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9c0347a4e100) 00010000:00010000:2.0:1787780025.360552:0:12488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787780025.360556:0:12488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18c00/0xc8fc0a517996144d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780025.360562:0:12488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18c00/0xc8fc0a517996144d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780025.360580:0:12488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18400/0xc8fc0a5179961454 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780025.360602:0:12488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18400/0xc8fc0a5179961454 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780025.360608:0:12488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18400/0xc8fc0a5179961454 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780025.360613:0:12488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0444c18400 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:2.0:1787780025.360616:0:12488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18400/0xc8fc0a5179961454 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780025.360622:0:12488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18400/0xc8fc0a5179961454 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780025.360631:0:12488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c0443d81600) 00010000:00010000:2.0:1787780025.360633:0:12488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787780025.360637:0:12488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18400/0xc8fc0a5179961454 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780025.360643:0:12488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18400/0xc8fc0a5179961454 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787780025.360814:0:12488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477843840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:781d29bb-23d2-48e3-b16d-c29e52cd5375+35:12453:x1874622863735808:12345-192.168.203.31@tcp:34:lfs.0 Request processed in 2416us (6177us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780025.360824:0:12488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 210 00000100:00100000:2.0:1787780025.444487:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787780025.444864:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863736064 00000100:00100000:0.0:1787780025.444887:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863736064 00000100:00100000:0.0:1787780025.444949:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 211 00000100:00100000:0.0:1787780025.444959:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347e56d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+35:12456:x1874622863736064:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:0.0:1787780025.444980:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787780025.444999:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869200/0xc8fc0a517996145b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea20b6 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780025.445075:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869000/0xc8fc0a5179961462 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780025.445090:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869000/0xc8fc0a5179961462 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780025.445102:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869000/0xc8fc0a5179961462 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780025.445115:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869400/0xc8fc0a5179961469 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780025.445122:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869400/0xc8fc0a5179961469 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780025.445129:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869400/0xc8fc0a5179961469 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780025.445807:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868c00/0xc8fc0a5179961470 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780025.445820:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868c00/0xc8fc0a5179961470 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780025.445829:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868c00/0xc8fc0a5179961470 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787780025.445871:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:0.0:1787780025.445951:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869000/0xc8fc0a5179961462 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780025.445958:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869000/0xc8fc0a5179961462 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780025.445964:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869000/0xc8fc0a5179961462 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780025.445969:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0477869000 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:0.0:1787780025.445972:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869000/0xc8fc0a5179961462 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780025.445980:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869000/0xc8fc0a5179961462 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780025.445992:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c04478d7d00) 00010000:00010000:0.0:1787780025.445994:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787780025.445999:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869000/0xc8fc0a5179961462 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780025.446005:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869000/0xc8fc0a5179961462 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780025.446017:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869400/0xc8fc0a5179961469 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780025.446022:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869400/0xc8fc0a5179961469 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780025.446038:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869400/0xc8fc0a5179961469 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780025.446043:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0477869400 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:0.0:1787780025.446046:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869400/0xc8fc0a5179961469 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780025.446053:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869400/0xc8fc0a5179961469 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780025.446060:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9c0347bece00) 00010000:00010000:0.0:1787780025.446062:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787780025.446065:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869400/0xc8fc0a5179961469 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780025.446071:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869400/0xc8fc0a5179961469 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780025.446111:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869200/0xc8fc0a517996145b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea20b6 expref: 38 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780025.446124:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868c00/0xc8fc0a5179961470 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea20b6 expref: 37 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780025.446131:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c0443d81600) 00010000:00010000:0.0:1787780025.446133:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787780025.446135:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0477868c00, rc 0) 00000100:00100000:0.0:1787780025.446929:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347e56d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+37:12456:x1874622863736064:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 1968us (2448us total) trans 4294967478 rc 0/0 00000100:00100000:0.0:1787780025.446952:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 211 00000100:00100000:0.0:1787780025.456733:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787780025.456831:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863736192 00000100:00100000:1.0:1787780025.456858:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863736192 00000100:00100000:1.0:1787780025.456928:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 212 00000100:00100000:1.0:1787780025.456938:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477841680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+37:12456:x1874622863736192:12345-192.168.203.31@tcp:54:lfs.0 00010000:00010000:1.0:1787780025.457005:0:7821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4ae00/0xc8fc0a517996147e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780025.457021:0:7821:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868200/0xc8fc0a5179961415 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea209a expref: 37 pid: 7821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780025.457030:0:7821:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4ae00/0xc8fc0a517996147e lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780025.457064:0:7821:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868200/0xc8fc0a5179961415 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea209a expref: 37 pid: 7821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780025.457079:0:7821:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868200/0xc8fc0a5179961415 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea209a expref: 37 pid: 7821 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787780025.457092:0:7821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346da6580 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7821:1874622881629312:192.168.203.31@tcp:104: 00000100:00100000:1.0:1787780025.457189:0:7821:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c04766603c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787780025.461245:0:7821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346da6580 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7821:1874622881629312:192.168.203.31@tcp:104: 00010000:00010000:1.0:1787780025.461282:0:7821:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4ae00/0xc8fc0a517996147e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787780025.464289:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787780025.464651:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863736448 00000100:00100000:2.0:1787780025.464661:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863736448 00000100:00100000:2.0:1787780025.464726:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 52 00000100:00100000:2.0:1787780025.464738:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477842580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+38:6176:x1874622863736448:12345-192.168.203.31@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787780025.465074:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477842580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+39:6176:x1874622863736448:12345-192.168.203.31@tcp:35:ldlm_bl.0 Request processed in 338us (793us total) trans 4294967479 rc 0/0 00000100:00100000:2.0:1787780025.465083:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 52 00000100:00100000:3.0:1787780025.468688:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787780025.471529:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863736576 00000100:00100000:2.0:1787780025.471543:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863736576 00010000:00010000:2.0:1787780025.471604:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868200/0xc8fc0a5179961415 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea209a expref: 39 pid: 7821 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787780025.471652:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 94 00000100:00100000:2.0:1787780025.471661:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0345e74780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+39:2411:x1874622863736576:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787780025.471678:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787780025.471685:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868200/0xc8fc0a5179961415 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea209a expref: 39 pid: 7821 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780025.471699:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868200/0xc8fc0a5179961415 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea209a expref: 39 pid: 7821 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780025.471724:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868200/0xc8fc0a5179961415 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea209a expref: 39 pid: 7821 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780025.471750:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c0443d81600) 00010000:00010000:2.0:1787780025.471755:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4ae00/0xc8fc0a517996147e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780025.471764:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4ae00/0xc8fc0a517996147e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780025.471770:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4ae00/0xc8fc0a517996147e lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780025.471817:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787780025.471925:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0345e74780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+38:2411:x1874622863736576:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 264us (3245us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780025.471933:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 94 00010000:00010000:0.0:1787780025.472103:0:7821:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4ae00/0xc8fc0a517996147e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780025.472112:0:7821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4ae00/0xc8fc0a517996147e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780025.472149:0:7821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4ae00/0xc8fc0a517996147e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780025.472157:0:7821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4ae00/0xc8fc0a517996147e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780025.472163:0:7821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4ae00/0xc8fc0a517996147e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780025.472169:0:7821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0347e4ae00 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:0.0:1787780025.472174:0:7821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4ae00/0xc8fc0a517996147e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780025.472181:0:7821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4ae00/0xc8fc0a517996147e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780025.472191:0:7821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c0443d81600) 00010000:00010000:0.0:1787780025.472194:0:7821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787780025.472198:0:7821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4ae00/0xc8fc0a517996147e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780025.472204:0:7821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4ae00/0xc8fc0a517996147e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787780025.472288:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477841680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+37:12456:x1874622863736192:12345-192.168.203.31@tcp:54:lfs.0 Request processed in 15351us (15563us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780025.472296:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 212 00000100:00100000:3.0:1787780025.481924:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787780025.482687:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863736832 00000100:00100000:2.0:1787780025.482697:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863736832 00000100:00100000:2.0:1787780025.482762:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 53 00000100:00100000:2.0:1787780025.482773:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0345e743c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+37:12456:x1874622863736832:12345-192.168.203.31@tcp:35:lfs.0 00000100:00100000:2.0:1787780025.483027:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0345e743c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+38:12456:x1874622863736832:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 255us (1121us total) trans 4294967480 rc 0/0 00000100:00100000:2.0:1787780025.483034:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 53 00010000:00010000:3.0:1787780025.500048:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787780025.670891:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787780025.670981:0:12488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863737088 00000100:00100000:0.0:1787780025.670991:0:12488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863737088 00000100:00100000:0.0:1787780025.671048:0:12488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 213 00000100:00100000:0.0:1787780025.671057:0:12488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347e561c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:781d29bb-23d2-48e3-b16d-c29e52cd5375+38:12467:x1874622863737088:12345-192.168.203.31@tcp:101:cat.0 00010000:00010000:0.0:1787780025.671079:0:12488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787780025.671099:0:12488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869200/0xc8fc0a5179961485 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea20bd expref: -99 pid: 12488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780025.671164:0:12488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869400/0xc8fc0a517996148c lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780025.671179:0:12488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869400/0xc8fc0a517996148c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780025.671190:0:12488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869400/0xc8fc0a517996148c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780025.671203:0:12488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869000/0xc8fc0a5179961493 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780025.671210:0:12488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869000/0xc8fc0a5179961493 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780025.671216:0:12488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869000/0xc8fc0a5179961493 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780025.671337:0:12488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868000/0xc8fc0a517996149a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780025.671346:0:12488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868000/0xc8fc0a517996149a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780025.671353:0:12488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868000/0xc8fc0a517996149a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787780025.671362:0:12488:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 8 00010000:00010000:0.0:1787780025.671456:0:12488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869400/0xc8fc0a517996148c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780025.671463:0:12488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869400/0xc8fc0a517996148c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780025.671470:0:12488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869400/0xc8fc0a517996148c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780025.671476:0:12488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0477869400 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:0.0:1787780025.671481:0:12488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869400/0xc8fc0a517996148c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780025.671489:0:12488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869400/0xc8fc0a517996148c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780025.671501:0:12488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c04478d7d00) 00010000:00010000:0.0:1787780025.671504:0:12488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787780025.671509:0:12488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869400/0xc8fc0a517996148c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780025.671534:0:12488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869400/0xc8fc0a517996148c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780025.671546:0:12488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869000/0xc8fc0a5179961493 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780025.671552:0:12488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869000/0xc8fc0a5179961493 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780025.671558:0:12488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869000/0xc8fc0a5179961493 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780025.671806:0:12488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0477869000 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:0.0:1787780025.671809:0:12488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869000/0xc8fc0a5179961493 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780025.671816:0:12488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869000/0xc8fc0a5179961493 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780025.671825:0:12488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9c0347bece00) 00010000:00010000:0.0:1787780025.671828:0:12488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787780025.671831:0:12488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869000/0xc8fc0a5179961493 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780025.671862:0:12488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869000/0xc8fc0a5179961493 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780025.671906:0:12488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869200/0xc8fc0a5179961485 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea20bd expref: 41 pid: 12488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780025.671932:0:12488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868000/0xc8fc0a517996149a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea20bd expref: 40 pid: 12488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780025.671939:0:12488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c0443d81600) 00010000:00010000:0.0:1787780025.671942:0:12488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787780025.671944:0:12488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0477868000, rc 0) 00000100:00100000:0.0:1787780025.672070:0:12488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347e561c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:781d29bb-23d2-48e3-b16d-c29e52cd5375+40:12467:x1874622863737088:12345-192.168.203.31@tcp:101:cat.0 Request processed in 1013us (1186us total) trans 4294967481 rc 0/0 00000100:00100000:0.0:1787780025.672078:0:12488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 213 00000100:00100000:3.0:1787780025.689175:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787780025.689313:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863737344 00000100:00100000:2.0:1787780025.689331:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863737344 00000100:00100000:2.0:1787780025.689388:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 54 00000100:00100000:2.0:1787780025.689404:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0345e75680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+40:12467:x1874622863737344:12345-192.168.203.31@tcp:35:cat.0 00000100:00100000:2.0:1787780025.689939:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0345e75680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+41:12467:x1874622863737344:12345-192.168.203.31@tcp:35:cat.0 Request processed in 535us (771us total) trans 4294967482 rc 0/0 00000100:00100000:2.0:1787780025.689947:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 54 00000100:00100000:1.0:1787780025.736541:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787780025.736676:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863737600 00000100:00100000:0.0:1787780025.736687:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863737600 00000100:00100000:0.0:1787780025.736748:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 214 00000100:00100000:0.0:1787780025.736758:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346da6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+41:12468:x1874622863737600:12345-192.168.203.31@tcp:36:rm.0 00010000:00010000:0.0:1787780025.736818:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1787780025.737276:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4aa00/0xc8fc0a5179961438 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea20a8 expref: 41 pid: 7821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780025.737302:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868000/0xc8fc0a517996149a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea20bd expref: 40 pid: 12488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780025.737314:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868c00/0xc8fc0a5179961470 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea20b6 expref: 39 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780025.737323:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869600/0xc8fc0a517996142a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea20a1 expref: 38 pid: 12488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780025.737421:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c0443d81600) 00010000:00010000:0.0:1787780025.737426:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787780025.737447:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869200/0xc8fc0a51799614a8 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780025.737460:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869200/0xc8fc0a51799614a8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780025.737471:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869200/0xc8fc0a51799614a8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780025.737484:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869000/0xc8fc0a51799614af lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780025.737491:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869000/0xc8fc0a51799614af lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780025.737496:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869000/0xc8fc0a51799614af lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780025.737705:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869400/0xc8fc0a51799614b6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780025.737715:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869400/0xc8fc0a51799614b6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780025.737721:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869400/0xc8fc0a51799614b6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787780025.738476:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:0.0:1787780025.738488:0:6514:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 433742649079ns, next at 434742646113ns, rc = 0 00010000:00010000:0.0:1787780025.738558:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868800/0xc8fc0a51799614bd lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780025.738569:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868800/0xc8fc0a51799614bd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780025.738577:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868800/0xc8fc0a51799614bd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780025.738583:0:6514:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868800/0xc8fc0a51799614bd lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780025.738589:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868800/0xc8fc0a51799614bd lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780025.738596:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868800/0xc8fc0a51799614bd lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780025.738625:0:6514:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787780025.738647:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869400/0xc8fc0a51799614b6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780025.738654:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869400/0xc8fc0a51799614b6 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780025.738659:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869400/0xc8fc0a51799614b6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780025.738664:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0477869400 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:0.0:1787780025.738668:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869400/0xc8fc0a51799614b6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780025.738674:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869400/0xc8fc0a51799614b6 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780025.738690:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c0443d81600) 00010000:00010000:0.0:1787780025.738693:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787780025.738697:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869400/0xc8fc0a51799614b6 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780025.738703:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869400/0xc8fc0a51799614b6 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780025.738718:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869200/0xc8fc0a51799614a8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780025.738724:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869200/0xc8fc0a51799614a8 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780025.738729:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869200/0xc8fc0a51799614a8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780025.738734:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0477869200 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:0.0:1787780025.738737:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869200/0xc8fc0a51799614a8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780025.738742:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869200/0xc8fc0a51799614a8 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780025.738762:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c04478d7d00) 00010000:00010000:0.0:1787780025.738765:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787780025.738768:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869200/0xc8fc0a51799614a8 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780025.738774:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869200/0xc8fc0a51799614a8 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787780025.738793:0:6514:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d947b279 reply state 000000002be6251a transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869000/0xc8fc0a51799614af lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780025.738803:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869000/0xc8fc0a51799614af lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780025.738809:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9c0347bece00) 00010000:00010000:0.0:1787780025.738811:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787780025.738814:0:6514:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787780025.738940:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346da6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+39:12468:x1874622863737600:12345-192.168.203.31@tcp:36:rm.0 Request processed in 2181us (2408us total) trans 4294967483 rc 0/0 00000100:00100000:0.0:1787780025.738949:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 214 00010000:00010000:2.0:1787780025.739451:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787780025.739458:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868800/0xc8fc0a51799614bd lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780025.739465:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0477868800 already unused, calling callback (ffffffffc0d97420) 00010000:00010000:2.0:1787780025.739468:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868800/0xc8fc0a51799614bd lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780025.739483:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868800/0xc8fc0a51799614bd lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780025.739495:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c0443d81600) 00010000:00010000:2.0:1787780025.739497:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787780025.739500:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868800/0xc8fc0a51799614bd lrc: 1/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780025.739506:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868800/0xc8fc0a51799614bd lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780025.739527:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787780025.739529:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787780025.739531:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787780025.808616:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787780025.808721:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863737856 00000100:00100000:0.0:1787780025.808731:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863737856 00000100:00100000:0.0:1787780025.808806:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 215 00000100:00100000:0.0:1787780025.808816:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0345e74b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+39:12474:x1874622863737856:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:0.0:1787780025.808895:0:7821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787780025.808918:0:7821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869200/0xc8fc0a51799614c4 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea20c4 expref: -99 pid: 7821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780025.809021:0:7821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869400/0xc8fc0a51799614cb lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780025.809036:0:7821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869400/0xc8fc0a51799614cb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780025.809047:0:7821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869400/0xc8fc0a51799614cb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780025.809076:0:7821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869600/0xc8fc0a51799614d2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780025.809085:0:7821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869600/0xc8fc0a51799614d2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780025.809092:0:7821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869600/0xc8fc0a51799614d2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787780025.809402:0:7821:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x5:0x0], index 0: 0 00010000:00010000:0.0:1787780025.809543:0:7821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868c00/0xc8fc0a51799614d9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780025.809553:0:7821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868c00/0xc8fc0a51799614d9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780025.809561:0:7821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868c00/0xc8fc0a51799614d9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780025.809591:0:7821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869400/0xc8fc0a51799614cb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780025.809599:0:7821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869400/0xc8fc0a51799614cb lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780025.809605:0:7821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869400/0xc8fc0a51799614cb lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780025.809611:0:7821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0477869400 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:0.0:1787780025.809615:0:7821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869400/0xc8fc0a51799614cb lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780025.809636:0:7821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869400/0xc8fc0a51799614cb lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780025.809648:0:7821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c04478d7d00) 00010000:00010000:0.0:1787780025.809651:0:7821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787780025.809655:0:7821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869400/0xc8fc0a51799614cb lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780025.809662:0:7821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869400/0xc8fc0a51799614cb lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787780025.809675:0:7821:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008c2075ba reply state 00000000f2f3c87f transno 4294967484 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869600/0xc8fc0a51799614d2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780025.809685:0:7821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869600/0xc8fc0a51799614d2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780025.809691:0:7821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9c0347bece00) 00010000:00010000:0.0:1787780025.809693:0:7821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787780025.809696:0:7821:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787780025.809722:0:7821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869200/0xc8fc0a51799614c4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea20c4 expref: 42 pid: 7821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780025.809736:0:7821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868c00/0xc8fc0a51799614d9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea20c4 expref: 41 pid: 7821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780025.809743:0:7821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c0347becc00) 00010000:00010000:0.0:1787780025.809745:0:7821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787780025.809748:0:7821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0477868c00, rc 0) 00000100:00100000:0.0:1787780025.809815:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0345e74b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+42:12474:x1874622863737856:12345-192.168.203.31@tcp:101:bash.0 Request processed in 1001us (1208us total) trans 4294967484 rc 0/0 00000100:00100000:0.0:1787780025.809830:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 215 00000100:00100000:1.0:1787780025.814924:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787780025.815066:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863737984 00000100:00100000:2.0:1787780025.815074:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863737984 00000100:00100000:2.0:1787780025.815130:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 67 00000100:00100000:2.0:1787780025.815138:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346da5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+7:2411:x1874622863737984:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:2.0:1787780025.815153:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787780025.815167:0:8430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f4c09eaf/0xc8fc0a51799614e7 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea20cb expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787780025.815185:0:8430:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787780025.815199:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=433s v=(0 0) 00010000:00010000:2.0:1787780025.815202:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787780025.815209:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4c09eaf/0xc8fc0a51799614e7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea20cb expref: 8 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780025.815237:0:8430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f4c09eaf/0xc8fc0a51799614e7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea20cb expref: 8 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780025.815248:0:8430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0444c18e00, rc 0) 00000100:00100000:2.0:1787780025.815311:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346da5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+8:2411:x1874622863737984:12345-192.168.203.31@tcp:101:bash.0 Request processed in 172us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780025.815318:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 67 00000100:00080000:0.0:1787780025.815962:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787780025.822672:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787780025.823046:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863738112 00000100:00100000:0.0:1787780025.823054:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863738112 00000100:00100000:0.0:1787780025.823110:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 68 00000100:00100000:0.0:1787780025.823119:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346da7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+8:12474:x1874622863738112:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:0.0:1787780025.823135:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787780025.823155:0:8427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a424796/0xc8fc0a51799614ee lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea20d2 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780025.823184:0:8427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f4c09eaf/0xc8fc0a51799614e7 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea20cb expref: 9 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780025.823193:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787780025.823197:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787780025.823202:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a424796/0xc8fc0a51799614ee lrc: 4/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea20d2 expref: 9 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780025.823231:0:8427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f4c09eaf/0xc8fc0a51799614e7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea20cb expref: 9 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780025.823245:0:8427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f4c09eaf/0xc8fc0a51799614e7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea20cb expref: 9 pid: 8430 timeout: 533 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787780025.823258:0:8427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477841a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1874622881629440:192.168.203.31@tcp:104: 00000100:00100000:0.0:1787780025.823366:0:8427:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0347ec6180 going to sleep for 11 seconds 00000100:00100000:0.0:1787780025.830122:0:8427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477841a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1874622881629440:192.168.203.31@tcp:104: 00010000:00010000:0.0:1787780025.830159:0:8427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007a424796/0xc8fc0a51799614ee lrc: 3/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0xf757128131ea20d2 expref: 9 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780025.830179:0:8427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0477869200, rc 0) 00000100:00100000:0.0:1787780025.830233:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346da7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+9:12474:x1874622863738112:12345-192.168.203.31@tcp:101:bash.0 Request processed in 7115us (7570us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780025.830242:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 68 00000100:00100000:1.0:1787780025.848147:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787780025.848707:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863738240 00000100:00100000:2.0:1787780025.848717:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863738240 00010000:00010000:2.0:1787780025.848777:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f4c09eaf/0xc8fc0a51799614e7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea20cb expref: 9 pid: 8430 timeout: 533 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787780025.848831:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 95 00000100:00100000:2.0:1787780025.848883:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046099dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+9:2410:x1874622863738240:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787780025.848898:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787780025.848920:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f4c09eaf/0xc8fc0a51799614e7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea20cb expref: 9 pid: 8430 timeout: 533 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780025.848935:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f4c09eaf/0xc8fc0a51799614e7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea20cb expref: 9 pid: 8430 timeout: 533 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780025.848958:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f4c09eaf/0xc8fc0a51799614e7 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea20cb expref: 9 pid: 8430 timeout: 533 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780025.849006:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787780025.849010:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787780025.849018:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007a424796/0xc8fc0a51799614ee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.31@tcp remote: 0xf757128131ea20d2 expref: 8 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780025.849027:0:6498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a424796/0xc8fc0a51799614ee lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.31@tcp remote: 0xf757128131ea20d2 expref: 8 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780025.849065:0:6498:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000007a424796/0xc8fc0a51799614ee lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0xf757128131ea20d2 expref: 8 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787780025.849079:0:6498:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347e570c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6498:1874622881629568:192.168.203.31@tcp:105: 00000100:00100000:2.0:1787780025.849161:0:6498:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0346b50480 going to sleep for 11 seconds 00000100:00100000:2.0:1787780025.855827:0:6498:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347e570c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6498:1874622881629568:192.168.203.31@tcp:105: 00010000:00010000:2.0:1787780025.855887:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787780025.855979:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046099dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+8:2410:x1874622863738240:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 7138us (7840us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780025.855991:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 95 00000100:00100000:1.0:1787780025.858631:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787780025.858899:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863738496 00000100:00100000:0.0:1787780025.858908:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863738496 00000100:00100000:0.0:1787780025.858965:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 55 00000100:00100000:0.0:1787780025.858975:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346da4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+42:12474:x1874622863738496:12345-192.168.203.31@tcp:35:bash.0 00000100:00100000:0.0:1787780025.859242:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346da4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+43:12474:x1874622863738496:12345-192.168.203.31@tcp:35:bash.0 Request processed in 268us (617us total) trans 4294967485 rc 0/0 00000100:00100000:0.0:1787780025.859250:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 55 00000100:00100000:3.0:1787780026.029614:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787780026.029721:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863738624 00000100:00100000:0.0:1787780026.029731:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863738624 00000100:00100000:0.0:1787780026.029795:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 216 00000100:00100000:0.0:1787780026.029804:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0345e752c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+43:12490:x1874622863738624:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:0.0:1787780026.029828:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787780026.029881:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869400/0xc8fc0a51799614f5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea20d9 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780026.029941:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868000/0xc8fc0a51799614fc lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780026.029968:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868000/0xc8fc0a51799614fc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780026.029982:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868000/0xc8fc0a51799614fc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787780026.030033:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1787780026.030038:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787780026.030055:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868000/0xc8fc0a51799614fc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780026.030078:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869400/0xc8fc0a51799614f5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea20d9 expref: 45 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780026.030096:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868000/0xc8fc0a51799614fc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea20d9 expref: 44 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780026.030104:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c04478d7d00) 00010000:00010000:0.0:1787780026.030107:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787780026.030110:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0477868000, rc 0) 00000100:00100000:0.0:1787780026.030169:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0345e752c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+44:12490:x1874622863738624:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 366us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780026.030177:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 216 00000100:00100000:1.0:1787780026.034309:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787780026.034439:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863738880 00000100:00100000:0.0:1787780026.034448:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863738880 00000100:00100000:0.0:1787780026.034507:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 217 00000100:00100000:0.0:1787780026.034525:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346da5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+44:12490:x1874622863738880:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:0.0:1787780026.034544:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787780026.034578:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869c00/0xc8fc0a5179961503 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea20e0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780026.034683:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868800/0xc8fc0a517996150a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780026.034696:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868800/0xc8fc0a517996150a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780026.034708:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868800/0xc8fc0a517996150a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787780026.034719:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:0.0:1787780026.034829:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869c00/0xc8fc0a5179961503 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea20e0 expref: 47 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780026.035201:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868800/0xc8fc0a517996150a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea20e0 expref: 46 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780026.035211:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c0347becc00) 00010000:00010000:0.0:1787780026.035214:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787780026.035217:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0477868800, rc 0) 00000100:00100000:0.0:1787780026.035275:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346da5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+46:12490:x1874622863738880:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 752us (975us total) trans 4294967486 rc 0/0 00000100:00100000:0.0:1787780026.035283:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 217 00000100:00100000:1.0:1787780026.038298:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787780026.038339:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787780026.038416:0:12488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863739136 00000100:00100000:2.0:1787780026.038425:0:12488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863739136 00000100:00100000:2.0:1787780026.038480:0:12488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 218 00000100:00100000:2.0:1787780026.038490:0:12488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346da61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:781d29bb-23d2-48e3-b16d-c29e52cd5375+46:12490:x1874622863739136:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:2.0:1787780026.038522:0:12488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787780026.038547:0:12488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18e00/0xc8fc0a5179961518 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea20e7 expref: -99 pid: 12488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780026.038664:0:12488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18800/0xc8fc0a517996151f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780026.038686:0:12488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18800/0xc8fc0a517996151f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780026.038702:0:12488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18800/0xc8fc0a517996151f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787780026.038716:0:12488:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1787780026.038834:0:12488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18e00/0xc8fc0a5179961518 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea20e7 expref: 49 pid: 12488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780026.038899:0:12488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18800/0xc8fc0a517996151f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea20e7 expref: 48 pid: 12488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780026.038908:0:12488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c0347becc00) 00010000:00010000:2.0:1787780026.038911:0:12488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787780026.038914:0:12488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0444c18800, rc 0) 00000100:00100000:2.0:1787780026.039207:0:12488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346da61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:781d29bb-23d2-48e3-b16d-c29e52cd5375+48:12490:x1874622863739136:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 718us (917us total) trans 4294967487 rc 0/0 00000100:00100000:2.0:1787780026.039215:0:12488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 218 00000100:00100000:0.0:1787780026.039993:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863739264 00000100:00100000:0.0:1787780026.040000:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863739264 00000100:00100000:0.0:1787780026.040048:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 16 00000100:00100000:0.0:1787780026.040057:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346da6940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+48:2410:x1874622863739264:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787780026.040080:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787780026.040098:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868800/0xc8fc0a517996150a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea20e0 expref: 48 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780026.040111:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c0347becc00) 00010000:00010000:0.0:1787780026.040115:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787780026.040192:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346da6940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+47:2410:x1874622863739264:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 136us (1852us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780026.040200:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 16 00000100:00100000:1.0:1787780026.053650:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787780026.053732:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863739392 00000100:00100000:2.0:1787780026.053741:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863739392 00000100:00100000:2.0:1787780026.053806:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 69 00000100:00100000:2.0:1787780026.053815:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346da7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+8:2408:x1874622863739392:12345-192.168.203.31@tcp:1:lfs.0 00010000:00010000:2.0:1787780026.053898:0:8430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000698a48c3/0xc8fc0a517996152d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780026.053933:0:8430:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007a424796/0xc8fc0a51799614ee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0xf757128131ea20d2 expref: 8 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780026.053942:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1787780026.053947:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787780026.053953:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000698a48c3/0xc8fc0a517996152d lrc: 4/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780026.053987:0:8430:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007a424796/0xc8fc0a51799614ee lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.31@tcp remote: 0xf757128131ea20d2 expref: 8 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780026.054002:0:8430:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007a424796/0xc8fc0a51799614ee lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.31@tcp remote: 0xf757128131ea20d2 expref: 8 pid: 8427 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787780026.054017:0:8430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347e54b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8430:1874622881629696:192.168.203.31@tcp:104: 00000100:00100000:2.0:1787780026.054101:0:8430:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0346b50300 going to sleep for 11 seconds 00000100:00100000:2.0:1787780026.058242:0:8430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347e54b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8430:1874622881629696:192.168.203.31@tcp:104: 00010000:00010000:2.0:1787780026.058276:0:8430:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000698a48c3/0xc8fc0a517996152d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787780026.067117:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787780026.067256:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863739520 00000100:00100000:0.0:1787780026.067266:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863739520 00002000:00100000:0.0:1787780026.067315:0:8435:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff9c0346da5e00 x1874622863739520/t0(0) o4->781d29bb-23d2-48e3-b16d-c29e52cd5375@192.168.203.31@tcp:437/0 lens 504/0 e 0 to 0 dl 1787780037 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787780026.067326:0:8435:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c0346da5e00 with x1874622863739520 ext(0->8) 00010000:00010000:0.0:1787780026.067334:0:8435:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000007a424796/0xc8fc0a51799614ee lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.31@tcp remote: 0xf757128131ea20d2 expref: 9 pid: 8427 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780026.067351:0:8435:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000007a424796/0xc8fc0a51799614ee lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.31@tcp remote: 0xf757128131ea20d2 expref: 9 pid: 8427 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787780026.067359:0:8435:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9c0346da5e00 00000100:00100000:0.0:1787780026.067391:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 3 00000100:00100000:0.0:1787780026.067401:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346da5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+9:2411:x1874622863739520:12345-192.168.203.31@tcp:4:lfs.0 00000100:00100000:0.0:1787780026.069807:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346da5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+11:2411:x1874622863739520:12345-192.168.203.31@tcp:4:lfs.0 Request processed in 2398us (2690us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1787780026.069831:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 3 00002000:00100000:0.0:1787780026.069870:0:8435:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff9c0346da5e00 x1874622863739520/t4294967309(0) o4->781d29bb-23d2-48e3-b16d-c29e52cd5375@192.168.203.31@tcp:437/0 lens 504/448 e 0 to 0 dl 1787780037 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787780026.069880:0:8435:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c0346da5e00 with x1874622863739520 ext(0->8) 00010000:00010000:0.0:1787780026.069890:0:8435:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000007a424796/0xc8fc0a51799614ee lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.31@tcp remote: 0xf757128131ea20d2 expref: 11 pid: 8427 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780026.069907:0:8435:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000007a424796/0xc8fc0a51799614ee lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.31@tcp remote: 0xf757128131ea20d2 expref: 11 pid: 8427 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787780026.069916:0:8435:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9c0346da5e00 00000001:00080000:3.0:1787780026.071127:0:8423:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:3.0:1787780026.071143:0:8423:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000100:00100000:3.0:1787780026.073622:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787780026.073722:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863739648 00000100:00100000:0.0:1787780026.073731:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863739648 00010000:00010000:0.0:1787780026.073826:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007a424796/0xc8fc0a51799614ee lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.31@tcp remote: 0xf757128131ea20d2 expref: 7 pid: 8427 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787780026.073910:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 96 00000100:00100000:0.0:1787780026.073920:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0345e76940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+7:2411:x1874622863739648:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787780026.073935:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1787780026.073953:0:6499:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1787780026.073956:0:6499:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1787780026 00002000:00010000:0.0:1787780026.073958:0:6499:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 1787780026 00002000:00010000:0.0:1787780026.073961:0:6499:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 0 -> 1787780026 00002000:00010000:0.0:1787780026.073963:0:6499:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1787780026.073969:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007a424796/0xc8fc0a51799614ee lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.31@tcp remote: 0xf757128131ea20d2 expref: 7 pid: 8427 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780026.073992:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007a424796/0xc8fc0a51799614ee lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.31@tcp remote: 0xf757128131ea20d2 expref: 7 pid: 8427 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780026.074016:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a424796/0xc8fc0a51799614ee lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.31@tcp remote: 0xf757128131ea20d2 expref: 7 pid: 8427 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780026.074033:0:6499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787780026.074037:0:6499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787780026.074043:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000698a48c3/0xc8fc0a517996152d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780026.074053:0:6499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000698a48c3/0xc8fc0a517996152d lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780026.074077:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787780026.074129:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0345e76940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+6:2411:x1874622863739648:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 210us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780026.074138:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 96 00010000:00010000:1.0:1787780026.074870:0:8430:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000698a48c3/0xc8fc0a517996152d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780026.074883:0:8430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000698a48c3/0xc8fc0a517996152d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780026.074905:0:8430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000698a48c3/0xc8fc0a517996152d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780026.074913:0:8430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000698a48c3/0xc8fc0a517996152d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780026.074921:0:8430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000698a48c3/0xc8fc0a517996152d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780026.074928:0:8430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0444c18a00 already unused, calling callback (ffffffffc0d97420) 00010000:00010000:1.0:1787780026.074932:0:8430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000698a48c3/0xc8fc0a517996152d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780026.074941:0:8430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000698a48c3/0xc8fc0a517996152d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780026.074968:0:8430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000698a48c3/0xc8fc0a517996152d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780026.074976:0:8430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000698a48c3/0xc8fc0a517996152d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787780026.075075:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346da7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:2408:x1874622863739392:12345-192.168.203.31@tcp:1:lfs.0 Request processed in 21259us (21433us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780026.075083:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 69 00000100:00100000:2.0:1787780026.078565:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787780026.078647:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863739904 00000100:00100000:0.0:1787780026.078657:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863739904 00000100:00100000:0.0:1787780026.078732:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 56 00000100:00100000:0.0:1787780026.078742:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0443618050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+47:12490:x1874622863739904:12345-192.168.203.31@tcp:35:lfs.0 00000004:00010000:0.0:1787780026.078806:0:6515:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18800/0xc8fc0a517996151f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea20e7 expref: 47 pid: 12488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787780026.079224:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:0.0:1787780026.079248:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:0.0:1787780026.079482:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00010000:00010000:0.0:1787780026.079529:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868800/0xc8fc0a5179961534 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780026.079545:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868c00/0xc8fc0a51799614d9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea20c4 expref: 51 pid: 7821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780026.079552:0:6515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868800/0xc8fc0a5179961534 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780026.079584:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868c00/0xc8fc0a51799614d9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea20c4 expref: 51 pid: 7821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780026.079598:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868c00/0xc8fc0a51799614d9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea20c4 expref: 51 pid: 7821 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787780026.079612:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477841a40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6515:1874622881629824:192.168.203.31@tcp:104: 00000100:00100000:0.0:1787780026.079736:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0347ec6000 going to sleep for 11 seconds 00000100:00100000:1.0:1787780026.082943:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787780026.083099:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863740032 00000100:00100000:3.0:1787780026.083108:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863740032 00010000:00010000:3.0:1787780026.083149:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868c00/0xc8fc0a51799614d9 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea20c4 expref: 52 pid: 7821 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787780026.083189:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 97 00000100:00100000:3.0:1787780026.083199:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346da4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+52:2411:x1874622863740032:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787780026.083214:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787780026.083220:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868c00/0xc8fc0a51799614d9 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea20c4 expref: 52 pid: 7821 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780026.083233:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868c00/0xc8fc0a51799614d9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea20c4 expref: 52 pid: 7821 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780026.083256:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c0347becc00) 00010000:00010000:3.0:1787780026.083261:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868800/0xc8fc0a5179961534 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780026.083270:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868800/0xc8fc0a5179961534 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780026.083277:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868800/0xc8fc0a5179961534 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780026.083310:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787780026.083357:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346da4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+52:2411:x1874622863740032:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 159us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780026.083364:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 97 00010000:00010000:0.0:1787780026.083468:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868c00/0xc8fc0a51799614d9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea20c4 expref: 51 pid: 7821 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787780026.083482:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477841a40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6515:1874622881629824:192.168.203.31@tcp:104: 00010000:00010000:0.0:1787780026.083502:0:6515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868800/0xc8fc0a5179961534 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780026.083531:0:6515:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868800/0xc8fc0a5179961534 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780026.083536:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868800/0xc8fc0a5179961534 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787780026.083639:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000001:00080000:0.0:1787780026.083745:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:0.0:1787780026.084019:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477841a40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6515:1874622881629952:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787780026.084068:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787780026.084093:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0347ec6c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787780026.084544:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881629952 00000100:00100000:3.0:1787780026.084550:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881629952 00000100:00100000:3.0:1787780026.084607:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1787780026.084616:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477840780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6515:x1874622881629952:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787780026.084690:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477840780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6515:x1874622881629952:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 76us (622us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780026.084698:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00080000:0.0:1787780026.085044:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787780026.085069:0:6515:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967308 gen 2 00000004:00080000:0.0:1787780026.085074:0:6515:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967307 committed transno 4294967308 00000004:00080000:0.0:1787780026.085114:0:6515:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c03489f70c0, transno 4294967308 00000100:00100000:0.0:1787780026.085130:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477841a40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6515:1874622881629952:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1787780026.085248:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00000100:00100000:0.0:1787780026.085304:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477841a40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6515:1874622881630080:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787780026.085335:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787780026.085520:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0347ec6240 going to sleep for 11 seconds 00000100:00100000:1.0:1787780026.086558:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881630080 00000100:00100000:1.0:1787780026.086566:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881630080 00000100:00100000:1.0:1787780026.086652:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1787780026.086660:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477841e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6515:x1874622881630080:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787780026.086820:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477841e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6515:x1874622881630080:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 160us (1484us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1787780026.086826:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1787780026.086913:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477841a40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6515:1874622881630080:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1787780026.086962:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:0.0:1787780026.086995:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868800/0xc8fc0a5179961534 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780026.087003:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868800/0xc8fc0a5179961534 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780026.087024:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868800/0xc8fc0a5179961534 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780026.087029:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0477868800 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:0.0:1787780026.087033:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868800/0xc8fc0a5179961534 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780026.087039:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868800/0xc8fc0a5179961534 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780026.087053:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c0347becc00) 00010000:00010000:0.0:1787780026.087055:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1787780026.087059:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868800/0xc8fc0a5179961534 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780026.087065:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868800/0xc8fc0a5179961534 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787780026.087149:0:6515:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1787780026.087202:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:0.0:1787780026.087213:0:6515:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 434091373338ns, next at 435091370918ns, rc = 0 00000001:00080000:0.0:1787780026.087218:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967495 00010000:00010000:0.0:1787780026.087239:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c0347becc00) 00010000:00010000:0.0:1787780026.087242:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787780026.087248:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18800/0xc8fc0a517996151f lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea20e7 expref: 55 pid: 12488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787780026.087573:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0443618050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+54:12490:x1874622863739904:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 8831us (9017us total) trans 4294967496 rc 0/0 00000100:00100000:0.0:1787780026.087593:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 56 00000020:00080000:0.0:1787780026.087597:0:6515:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1787780026.094634:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787780026.094718:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863740160 00000100:00100000:3.0:1787780026.094727:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863740160 00000100:00100000:3.0:1787780026.094875:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 219 00000100:00100000:3.0:1787780026.094886:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346da43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+54:12490:x1874622863740160:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:3.0:1787780026.094909:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787780026.094930:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766ddc00/0xc8fc0a517996153b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea20ee expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780026.094985:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766ddc00/0xc8fc0a517996153b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea20ee expref: 55 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780026.094999:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766ddc00/0xc8fc0a517996153b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea20ee expref: 55 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780026.095016:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c0443d81800) 00010000:00010000:3.0:1787780026.095033:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787780026.095037:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c04766ddc00, rc 0) 00000100:00100000:3.0:1787780026.095099:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346da43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+55:12490:x1874622863740160:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 214us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780026.095107:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 219 00000100:00100000:2.0:1787780026.098484:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787780026.098585:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863740416 00000100:00100000:3.0:1787780026.098595:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863740416 00000100:00100000:3.0:1787780026.098650:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 57 00000100:00100000:3.0:1787780026.098661:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347e54b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+55:12490:x1874622863740416:12345-192.168.203.31@tcp:35:lfs.0 00000100:00100000:3.0:1787780026.098924:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347e54b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+56:12490:x1874622863740416:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 264us (448us total) trans 4294967497 rc 0/0 00000100:00100000:3.0:1787780026.098933:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 57 00000100:00100000:2.0:1787780026.175219:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787780026.175437:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863740544 00000100:00100000:0.0:1787780026.175448:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863740544 00000100:00100000:0.0:1787780026.175563:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 220 00000100:00100000:0.0:1787780026.175573:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347e570c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+56:12500:x1874622863740544:12345-192.168.203.31@tcp:34:lfs.0 00010000:00010000:0.0:1787780026.175649:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868800/0xc8fc0a5179961542 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780026.175666:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868800/0xc8fc0a5179961542 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780026.175677:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868800/0xc8fc0a5179961542 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780026.175689:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868c00/0xc8fc0a5179961549 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780026.175697:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868c00/0xc8fc0a5179961549 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780026.175709:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868c00/0xc8fc0a5179961549 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780026.176206:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869200/0xc8fc0a5179961550 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780026.176251:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869200/0xc8fc0a5179961550 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780026.176257:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869200/0xc8fc0a5179961550 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787780026.176310:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869200/0xc8fc0a5179961550 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780026.176319:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868800/0xc8fc0a5179961542 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780026.176324:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868800/0xc8fc0a5179961542 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780026.176328:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868800/0xc8fc0a5179961542 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780026.176332:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0477868800 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:0.0:1787780026.176335:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868800/0xc8fc0a5179961542 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780026.176342:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868800/0xc8fc0a5179961542 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780026.176354:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c04478d7d00) 00010000:00010000:0.0:1787780026.176356:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787780026.176361:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868800/0xc8fc0a5179961542 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780026.176367:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868800/0xc8fc0a5179961542 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780026.176379:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868c00/0xc8fc0a5179961549 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780026.176386:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868c00/0xc8fc0a5179961549 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780026.176400:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868c00/0xc8fc0a5179961549 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780026.176406:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0477868c00 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:0.0:1787780026.176409:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868c00/0xc8fc0a5179961549 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780026.176414:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868c00/0xc8fc0a5179961549 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780026.176422:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9c0347bece00) 00010000:00010000:0.0:1787780026.176424:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787780026.176427:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868c00/0xc8fc0a5179961549 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780026.176432:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868c00/0xc8fc0a5179961549 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780026.176442:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869200/0xc8fc0a5179961550 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780026.176447:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869200/0xc8fc0a5179961550 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780026.176452:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869200/0xc8fc0a5179961550 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780026.176457:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0477869200 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:0.0:1787780026.176460:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869200/0xc8fc0a5179961550 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780026.176476:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869200/0xc8fc0a5179961550 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780026.176484:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c0443d81800) 00010000:00010000:0.0:1787780026.176487:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787780026.176490:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869200/0xc8fc0a5179961550 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780026.176495:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869200/0xc8fc0a5179961550 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787780026.176621:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347e570c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+56:12500:x1874622863740544:12345-192.168.203.31@tcp:34:lfs.0 Request processed in 1048us (1421us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780026.176630:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 220 00000100:00100000:1.0:1787780026.225482:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787780026.225713:0:12488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863740800 00000100:00100000:2.0:1787780026.225738:0:12488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863740800 00000100:00100000:2.0:1787780026.225833:0:12488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 221 00000100:00100000:2.0:1787780026.225905:0:12488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346da4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:781d29bb-23d2-48e3-b16d-c29e52cd5375+56:12503:x1874622863740800:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:2.0:1787780026.225932:0:12488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787780026.225954:0:12488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19000/0xc8fc0a5179961557 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea20f5 expref: -99 pid: 12488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780026.226028:0:12488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19600/0xc8fc0a517996155e lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780026.226042:0:12488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19600/0xc8fc0a517996155e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780026.226052:0:12488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19600/0xc8fc0a517996155e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780026.226062:0:12488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18800/0xc8fc0a5179961565 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780026.226069:0:12488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18800/0xc8fc0a5179961565 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780026.226075:0:12488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18800/0xc8fc0a5179961565 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780026.226170:0:12488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18000/0xc8fc0a517996156c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780026.226180:0:12488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18000/0xc8fc0a517996156c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780026.226188:0:12488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18000/0xc8fc0a517996156c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787780026.226203:0:12488:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1787780026.226277:0:12488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19600/0xc8fc0a517996155e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780026.226286:0:12488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19600/0xc8fc0a517996155e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780026.226293:0:12488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19600/0xc8fc0a517996155e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780026.226299:0:12488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0444c19600 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:2.0:1787780026.226304:0:12488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19600/0xc8fc0a517996155e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780026.226312:0:12488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19600/0xc8fc0a517996155e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780026.226324:0:12488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c04478d7d00) 00010000:00010000:2.0:1787780026.226327:0:12488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787780026.226343:0:12488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19600/0xc8fc0a517996155e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780026.226350:0:12488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19600/0xc8fc0a517996155e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780026.226364:0:12488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18800/0xc8fc0a5179961565 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780026.226370:0:12488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18800/0xc8fc0a5179961565 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780026.226386:0:12488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18800/0xc8fc0a5179961565 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780026.226392:0:12488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0444c18800 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:2.0:1787780026.226395:0:12488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18800/0xc8fc0a5179961565 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780026.226402:0:12488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18800/0xc8fc0a5179961565 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780026.226410:0:12488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9c0347bece00) 00010000:00010000:2.0:1787780026.226413:0:12488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787780026.226416:0:12488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18800/0xc8fc0a5179961565 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780026.226422:0:12488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18800/0xc8fc0a5179961565 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780026.226455:0:12488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19000/0xc8fc0a5179961557 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea20f5 expref: 59 pid: 12488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780026.226467:0:12488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18000/0xc8fc0a517996156c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea20f5 expref: 58 pid: 12488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780026.226474:0:12488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c0443d81800) 00010000:00010000:2.0:1787780026.226477:0:12488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787780026.226479:0:12488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0444c18000, rc 0) 00000100:00100000:2.0:1787780026.227295:0:12488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346da4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:781d29bb-23d2-48e3-b16d-c29e52cd5375+58:12503:x1874622863740800:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 1398us (1819us total) trans 4294967498 rc 0/0 00000100:00100000:2.0:1787780026.227314:0:12488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 221 00000100:00100000:2.0:1787780026.231477:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787780026.234947:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863740928 00000100:00100000:1.0:1787780026.234962:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863740928 00000100:00100000:1.0:1787780026.235146:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 222 00000100:00100000:1.0:1787780026.235157:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347e543c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+58:12503:x1874622863740928:12345-192.168.203.31@tcp:54:lfs.0 00010000:00010000:1.0:1787780026.235230:0:7821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4b800/0xc8fc0a517996157a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780026.235263:0:7821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4b800/0xc8fc0a517996157a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780026.235274:0:7821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4b800/0xc8fc0a517996157a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780026.235308:0:7821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4b800/0xc8fc0a517996157a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780026.235315:0:7821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4b800/0xc8fc0a517996157a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780026.235322:0:7821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4b800/0xc8fc0a517996157a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780026.235329:0:7821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0347e4b800 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:1.0:1787780026.235333:0:7821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4b800/0xc8fc0a517996157a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780026.235340:0:7821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4b800/0xc8fc0a517996157a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780026.235352:0:7821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c0443d81800) 00010000:00010000:1.0:1787780026.235354:0:7821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787780026.235358:0:7821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4b800/0xc8fc0a517996157a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780026.235364:0:7821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4b800/0xc8fc0a517996157a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787780026.235443:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347e543c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+58:12503:x1874622863740928:12345-192.168.203.31@tcp:54:lfs.0 Request processed in 288us (3975us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780026.235457:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 222 00000100:00100000:0.0:1787780026.246958:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787780026.247497:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863741184 00000100:00100000:3.0:1787780026.247515:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863741184 00000100:00100000:3.0:1787780026.247573:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 58 00000100:00100000:3.0:1787780026.247591:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477842580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+58:12503:x1874622863741184:12345-192.168.203.31@tcp:35:lfs.0 00000100:00100000:3.0:1787780026.248020:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477842580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+59:12503:x1874622863741184:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 429us (1071us total) trans 4294967499 rc 0/0 00000100:00100000:3.0:1787780026.248027:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 58 00000100:00100000:2.0:1787780026.399261:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787780026.399363:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863741440 00000100:00100000:0.0:1787780026.399372:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863741440 00000100:00100000:0.0:1787780026.399430:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 223 00000100:00100000:0.0:1787780026.399440:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347e55a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+59:12513:x1874622863741440:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:0.0:1787780026.399463:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787780026.399467:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787780026.399493:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868000/0xc8fc0a51799614fc lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea20d9 expref: 59 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780026.399525:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c04478d7d00) 00010000:00010000:0.0:1787780026.399531:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787780026.399544:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868c00/0xc8fc0a5179961581 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea20fc expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780026.399666:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868800/0xc8fc0a5179961588 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780026.399679:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868800/0xc8fc0a5179961588 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780026.399690:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868800/0xc8fc0a5179961588 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787780026.399701:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:0.0:1787780026.399803:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868c00/0xc8fc0a5179961581 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea20fc expref: 61 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780026.399816:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868800/0xc8fc0a5179961588 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea20fc expref: 60 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780026.399823:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c0443d81800) 00010000:00010000:0.0:1787780026.399826:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787780026.399829:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0477868800, rc 0) 00000100:00100000:0.0:1787780026.400194:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347e55a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+60:12513:x1874622863741440:12345-192.168.203.31@tcp:101:bash.0 Request processed in 754us (940us total) trans 4294967500 rc 0/0 00000100:00100000:0.0:1787780026.400203:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 223 00000100:00100000:2.0:1787780026.409733:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787780026.410066:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787780026.410158:0:12488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863741568 00000100:00100000:0.0:1787780026.410167:0:12488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863741568 00000100:00100000:0.0:1787780026.410226:0:12488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 224 00000100:00100000:0.0:1787780026.410235:0:12488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347e56940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:781d29bb-23d2-48e3-b16d-c29e52cd5375+60:12513:x1874622863741568:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:0.0:1787780026.410259:0:12488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787780026.410292:0:12488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868c00/0xc8fc0a5179961596 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea2103 expref: -99 pid: 12488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780026.410326:0:12488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868000/0xc8fc0a517996159d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780026.410351:0:12488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868000/0xc8fc0a517996159d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780026.410363:0:12488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868000/0xc8fc0a517996159d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780026.410470:0:12488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868c00/0xc8fc0a5179961596 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea2103 expref: 62 pid: 12488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780026.410489:0:12488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868000/0xc8fc0a517996159d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea2103 expref: 61 pid: 12488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780026.410497:0:12488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c0443d81800) 00010000:00010000:0.0:1787780026.410501:0:12488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787780026.411141:0:12488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0477868000, rc 0) 00000100:00100000:0.0:1787780026.411247:0:12488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347e56940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:781d29bb-23d2-48e3-b16d-c29e52cd5375+61:12513:x1874622863741568:12345-192.168.203.31@tcp:101:bash.0 Request processed in 1011us (1522us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780026.411255:0:12488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 224 00000100:00100000:2.0:1787780026.416814:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787780026.417208:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863741952 00000100:00100000:0.0:1787780026.417218:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863741952 00000100:00100000:0.0:1787780026.417266:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 225 00000100:00100000:0.0:1787780026.417275:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347e56580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+61:12513:x1874622863741952:12345-192.168.203.31@tcp:36:bash.0 00010000:00010000:0.0:1787780026.417326:0:7821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787780026.417375:0:7821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18000/0xc8fc0a517996156c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea20f5 expref: 61 pid: 12488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780026.417394:0:7821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c0443d81800) 00010000:00010000:0.0:1787780026.417399:0:7821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787780026.417715:0:7821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869c00/0xc8fc0a51799615a4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780026.417729:0:7821:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868800/0xc8fc0a5179961588 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea20fc expref: 61 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780026.417738:0:7821:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869c00/0xc8fc0a51799615a4 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780026.417769:0:7821:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868800/0xc8fc0a5179961588 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea20fc expref: 61 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780026.417784:0:7821:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868800/0xc8fc0a5179961588 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea20fc expref: 61 pid: 6514 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787780026.417797:0:7821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04778430c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7821:1874622881630208:192.168.203.31@tcp:104: 00000100:00100000:0.0:1787780026.418775:0:7821:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0347d456c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787780026.419801:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863741696 00000100:00100000:1.0:1787780026.419811:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863741696 00010000:00010000:1.0:1787780026.419878:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868800/0xc8fc0a5179961588 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea20fc expref: 62 pid: 6514 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787780026.419922:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 98 00000100:00100000:1.0:1787780026.419931:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347e57840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+62:2410:x1874622863741696:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787780026.419944:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787780026.419950:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868800/0xc8fc0a5179961588 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea20fc expref: 62 pid: 6514 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780026.419964:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868800/0xc8fc0a5179961588 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea20fc expref: 62 pid: 6514 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780026.419983:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c0443d81800) 00010000:00010000:1.0:1787780026.419988:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869c00/0xc8fc0a51799615a4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780026.419998:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869c00/0xc8fc0a51799615a4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780026.420006:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869c00/0xc8fc0a51799615a4 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780026.420022:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787780026.420059:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347e57840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+62:2410:x1874622863741696:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 130us (10221us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780026.420083:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 98 00010000:00010000:0.0:1787780026.427806:0:7821:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.31@tcp) returned -22 from blocking AST (req@00000000b8029e53 x1874622881630208) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868800/0xc8fc0a5179961588 lrc: 1/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea20fc expref: 61 pid: 6514 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780026.427831:0:7821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868800/0xc8fc0a5179961588 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea20fc expref: 61 pid: 6514 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787780026.428065:0:7821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04778430c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7821:1874622881630208:192.168.203.31@tcp:104: 00010000:00010000:0.0:1787780026.428088:0:7821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c0443d81800) 00010000:00010000:0.0:1787780026.428096:0:7821:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869c00/0xc8fc0a51799615a4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780026.428106:0:7821:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869c00/0xc8fc0a51799615a4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780026.428112:0:7821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869c00/0xc8fc0a51799615a4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787780026.428200:0:7821:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967501 00000004:00010000:0.0:1787780026.428244:0:7821:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f8665215 reply state 00000000bd5f1722 transno 4294967502 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869c00/0xc8fc0a51799615a4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780026.428259:0:7821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869c00/0xc8fc0a51799615a4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780026.428267:0:7821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c0443d81800) 00010000:00010000:0.0:1787780026.428270:0:7821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787780026.428273:0:7821:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787780026.428437:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347e56580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+62:12513:x1874622863741952:12345-192.168.203.31@tcp:36:bash.0 Request processed in 11161us (11643us total) trans 4294967502 rc 0/0 00000100:00100000:0.0:1787780026.428446:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 225 00000020:00080000:0.0:1787780026.428452:0:7821:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787780026.431701:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787780026.432142:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863742080 00000100:00100000:3.0:1787780026.432152:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863742080 00000100:00100000:3.0:1787780026.432238:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 226 00000100:00100000:3.0:1787780026.432249:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347e54f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+62:12513:x1874622863742080:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:3.0:1787780026.432270:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787780026.432289:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd600/0xc8fc0a51799615ab lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea210a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780026.432400:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd200/0xc8fc0a51799615b2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780026.432414:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd200/0xc8fc0a51799615b2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780026.432424:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd200/0xc8fc0a51799615b2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787780026.432450:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:3.0:1787780026.432455:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787780026.432472:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd200/0xc8fc0a51799615b2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780026.432498:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd600/0xc8fc0a51799615ab lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea210a expref: 64 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780026.432591:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd200/0xc8fc0a51799615b2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea210a expref: 63 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780026.432600:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c0443d81800) 00010000:00010000:3.0:1787780026.432603:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787780026.432606:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c04766dd200, rc 0) 00000100:00100000:3.0:1787780026.432709:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347e54f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+63:12513:x1874622863742080:12345-192.168.203.31@tcp:101:bash.0 Request processed in 462us (1018us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780026.432717:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 226 00000100:00100000:2.0:1787780026.437129:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787780026.437210:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863742336 00000100:00100000:3.0:1787780026.437219:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863742336 00000100:00100000:3.0:1787780026.437292:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 59 00000100:00100000:3.0:1787780026.437302:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347e57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+63:12513:x1874622863742336:12345-192.168.203.31@tcp:35:bash.0 00000100:00100000:3.0:1787780026.437559:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347e57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+64:12513:x1874622863742336:12345-192.168.203.31@tcp:35:bash.0 Request processed in 258us (441us total) trans 4294967503 rc 0/0 00000100:00100000:3.0:1787780026.437568:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 59 00010000:00010000:1.0:1787780026.536658:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787780026.542696:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787780026.542750:0:12488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863742464 00000100:00100000:0.0:1787780026.542759:0:12488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863742464 00000100:00100000:0.0:1787780026.542889:0:12488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 227 00000100:00100000:0.0:1787780026.542900:0:12488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347e57c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:781d29bb-23d2-48e3-b16d-c29e52cd5375+64:12519:x1874622863742464:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:0.0:1787780026.542936:0:12488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787780026.542958:0:12488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868800/0xc8fc0a51799615b9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea2111 expref: -99 pid: 12488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780026.543022:0:12488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868c00/0xc8fc0a51799615c0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780026.543048:0:12488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868c00/0xc8fc0a51799615c0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780026.543059:0:12488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868c00/0xc8fc0a51799615c0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787780026.543102:0:12488:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1787780026.543106:0:12488:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787780026.543124:0:12488:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868c00/0xc8fc0a51799615c0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780026.543148:0:12488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868800/0xc8fc0a51799615b9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea2111 expref: 66 pid: 12488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780026.543165:0:12488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868c00/0xc8fc0a51799615c0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea2111 expref: 65 pid: 12488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780026.543174:0:12488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c04478d7d00) 00010000:00010000:0.0:1787780026.543177:0:12488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787780026.543181:0:12488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0477868c00, rc 0) 00000100:00100000:0.0:1787780026.543307:0:12488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347e57c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:781d29bb-23d2-48e3-b16d-c29e52cd5375+65:12519:x1874622863742464:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 409us (619us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780026.543316:0:12488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 227 00000100:00100000:2.0:1787780026.550158:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787780026.550803:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863742592 00000100:00100000:0.0:1787780026.550813:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863742592 00000100:00100000:0.0:1787780026.550889:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 228 00000100:00100000:0.0:1787780026.550899:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347e55680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+65:12519:x1874622863742592:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:0.0:1787780026.550919:0:7821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787780026.550939:0:7821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868800/0xc8fc0a51799615c7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea2118 expref: -99 pid: 7821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780026.551000:0:7821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869400/0xc8fc0a51799615ce lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780026.551015:0:7821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869400/0xc8fc0a51799615ce lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780026.551026:0:7821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869400/0xc8fc0a51799615ce lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780026.551136:0:7821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868200/0xc8fc0a51799615d5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780026.551145:0:7821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868200/0xc8fc0a51799615d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780026.551153:0:7821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868200/0xc8fc0a51799615d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780026.551393:0:7821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869200/0xc8fc0a51799615dc lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780026.551403:0:7821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869200/0xc8fc0a51799615dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780026.551526:0:7821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869200/0xc8fc0a51799615dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787780026.551564:0:7821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:0.0:1787780026.551568:0:7821:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787780026.551583:0:7821:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869200/0xc8fc0a51799615dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780026.551594:0:7821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869200/0xc8fc0a51799615dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780026.551602:0:7821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869400/0xc8fc0a51799615ce lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780026.551608:0:7821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869400/0xc8fc0a51799615ce lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780026.551614:0:7821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869400/0xc8fc0a51799615ce lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780026.551619:0:7821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0477869400 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:0.0:1787780026.551622:0:7821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869400/0xc8fc0a51799615ce lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780026.551629:0:7821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869400/0xc8fc0a51799615ce lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780026.551639:0:7821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c04478d7d00) 00010000:00010000:0.0:1787780026.551642:0:7821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787780026.551645:0:7821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869400/0xc8fc0a51799615ce lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780026.551661:0:7821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869400/0xc8fc0a51799615ce lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780026.551674:0:7821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868200/0xc8fc0a51799615d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780026.551679:0:7821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868200/0xc8fc0a51799615d5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780026.551684:0:7821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868200/0xc8fc0a51799615d5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780026.551689:0:7821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0477868200 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:0.0:1787780026.551691:0:7821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868200/0xc8fc0a51799615d5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780026.551697:0:7821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868200/0xc8fc0a51799615d5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780026.551704:0:7821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9c0347bece00) 00010000:00010000:0.0:1787780026.551707:0:7821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787780026.551709:0:7821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868200/0xc8fc0a51799615d5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780026.551714:0:7821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868200/0xc8fc0a51799615d5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780026.551740:0:7821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868800/0xc8fc0a51799615c7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea2118 expref: 67 pid: 7821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780026.551765:0:7821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869200/0xc8fc0a51799615dc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea2118 expref: 66 pid: 7821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780026.551881:0:7821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c0443d81800) 00010000:00010000:0.0:1787780026.551884:0:7821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787780026.551886:0:7821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0477869200, rc 0) 00000100:00100000:0.0:1787780026.551949:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347e55680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+66:12519:x1874622863742592:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 1051us (1800us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780026.551957:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 228 00000100:00100000:2.0:1787780026.560401:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787780026.560566:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863742848 00000100:00100000:3.0:1787780026.560576:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863742848 00000100:00100000:3.0:1787780026.560638:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 229 00000100:00100000:3.0:1787780026.560648:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347e54780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+66:12519:x1874622863742848:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:3.0:1787780026.560669:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787780026.560690:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd600/0xc8fc0a51799615e3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea211f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780026.560943:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc200/0xc8fc0a51799615ea lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780026.560959:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd200/0xc8fc0a51799615b2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea210a expref: 67 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780026.560968:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869200/0xc8fc0a51799615dc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea2118 expref: 67 pid: 7821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780026.560976:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc200/0xc8fc0a51799615ea lrc: 5/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780026.561009:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869200/0xc8fc0a51799615dc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea2118 expref: 67 pid: 7821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780026.561043:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869200/0xc8fc0a51799615dc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea2118 expref: 67 pid: 7821 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787780026.561058:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0345e76580 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1874622881630336:192.168.203.31@tcp:104: 00010000:00010000:3.0:1787780026.561208:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd200/0xc8fc0a51799615b2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea210a expref: 67 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780026.561229:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd200/0xc8fc0a51799615b2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea210a expref: 67 pid: 6513 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787780026.561239:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0345e77c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1874622881630464:192.168.203.31@tcp:104: 00000100:00100000:3.0:1787780026.561264:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0477835840 going to sleep for 11 seconds 00000100:00100000:2.0:1787780026.562748:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787780026.563118:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863742976 00000100:00100000:3.0:1787780026.563126:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863742976 00010000:00010000:3.0:1787780026.563165:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869200/0xc8fc0a51799615dc lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea2118 expref: 68 pid: 7821 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787780026.563327:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 99 00000100:00100000:3.0:1787780026.563339:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c047785c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+68:2408:x1874622863742976:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787780026.563353:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787780026.563360:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869200/0xc8fc0a51799615dc lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea2118 expref: 68 pid: 7821 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780026.563374:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869200/0xc8fc0a51799615dc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea2118 expref: 68 pid: 7821 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780026.563416:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c0443d81800) 00010000:00010000:3.0:1787780026.563422:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc200/0xc8fc0a51799615ea lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780026.563430:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc200/0xc8fc0a51799615ea lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780026.563436:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787780026.563487:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c047785c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+68:2408:x1874622863742976:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 151us (744us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780026.563496:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 99 00000100:00100000:2.0:1787780026.569125:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00010000:00010000:3.0:1787780026.569475:0:6513:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.31@tcp) returned -22 from blocking AST (req@000000003f67e376 x1874622881630336) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869200/0xc8fc0a51799615dc lrc: 1/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea2118 expref: 67 pid: 7821 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780026.569497:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869200/0xc8fc0a51799615dc lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea2118 expref: 67 pid: 7821 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787780026.569529:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0345e76580 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1874622881630336:192.168.203.31@tcp:104: 00000100:00100000:3.0:1787780026.569543:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0345e77c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1874622881630464:192.168.203.31@tcp:104: 00010000:00010000:3.0:1787780026.569564:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c0443d81800) 00010000:00010000:3.0:1787780026.569569:0:6513:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc200/0xc8fc0a51799615ea lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780026.569578:0:6513:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc200/0xc8fc0a51799615ea lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780026.569604:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc200/0xc8fc0a51799615ea lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787780026.569699:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863743104 00000100:00100000:1.0:1787780026.569705:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863743104 00010000:00010000:1.0:1787780026.569733:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd200/0xc8fc0a51799615b2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea210a expref: 67 pid: 6513 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787780026.569894:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 100 00000100:00100000:3.0:1787780026.569906:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c047785f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+67:2411:x1874622863743104:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787780026.569923:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787780026.569929:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd200/0xc8fc0a51799615b2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea210a expref: 67 pid: 6513 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780026.569941:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd200/0xc8fc0a51799615b2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea210a expref: 67 pid: 6513 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780026.569961:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd200/0xc8fc0a51799615b2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea210a expref: 67 pid: 6513 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780026.569970:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c0443d81800) 00010000:00010000:3.0:1787780026.569973:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc200/0xc8fc0a51799615ea lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780026.569979:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc200/0xc8fc0a51799615ea lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780026.569984:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc200/0xc8fc0a51799615ea lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780026.570003:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787780026.570028:0:6513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc200/0xc8fc0a51799615ea lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780026.570036:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc200/0xc8fc0a51799615ea lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787780026.570054:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000100:00100000:3.0:1787780026.570130:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c047785f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+66:2411:x1874622863743104:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 225us (1014us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780026.570148:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 100 00010000:00010000:0.0:1787780026.570631:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd600/0xc8fc0a51799615e3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea211f expref: 67 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780026.570646:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc200/0xc8fc0a51799615ea lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea211f expref: 66 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780026.570654:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c0443d81800) 00010000:00010000:0.0:1787780026.570656:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787780026.570658:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c04766dc200, rc 0) 00000100:00100000:0.0:1787780026.570703:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347e54780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+66:12519:x1874622863742848:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 10057us (10312us total) trans 4294967504 rc 0/0 00000100:00100000:0.0:1787780026.570711:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 229 00000100:00100000:2.0:1787780026.577295:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787780026.577358:0:7921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863743360 00000100:00100000:1.0:1787780026.577368:0:7921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863743360 00000100:00100000:1.0:1787780026.577443:0:7921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 17 00000100:00100000:1.0:1787780026.577452:0:7921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046099c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+66:12519:x1874622863743360:12345-192.168.203.31@tcp:103:lfs.0 00010000:00010000:1.0:1787780026.577468:0:7921:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787780026.577492:0:7921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766ddc00/0xc8fc0a517996153b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea20ee expref: 66 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780026.577523:0:7921:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c0443d81800) 00010000:00010000:1.0:1787780026.577529:0:7921:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787780026.577584:0:7921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046099c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+65:12519:x1874622863743360:12345-192.168.203.31@tcp:103:lfs.0 Request processed in 133us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780026.577593:0:7921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 17 00000100:00100000:2.0:1787780026.582260:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787780026.582431:0:12488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863743488 00000100:00100000:0.0:1787780026.582454:0:12488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863743488 00000100:00100000:0.0:1787780026.582568:0:12488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 230 00000100:00100000:0.0:1787780026.582579:0:12488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c047785d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:781d29bb-23d2-48e3-b16d-c29e52cd5375+65:12519:x1874622863743488:12345-192.168.203.31@tcp:58:lfs.0 00010000:00010000:0.0:1787780026.582692:0:12488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868800/0xc8fc0a51799615f8 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780026.582709:0:12488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868800/0xc8fc0a51799615f8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780026.582720:0:12488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868800/0xc8fc0a51799615f8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787780026.582827:0:12488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:0.0:1787780026.582926:0:12488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c047785d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:781d29bb-23d2-48e3-b16d-c29e52cd5375+65:12519:x1874622863743488:12345-192.168.203.31@tcp:58:lfs.0 Request processed in 349us (676us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780026.582935:0:12488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 230 00000100:00100000:2.0:1787780026.586366:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787780026.586453:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863743616 00000100:00100000:0.0:1787780026.586462:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863743616 00000100:00100000:0.0:1787780026.586625:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 231 00000100:00100000:0.0:1787780026.586635:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c047785cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+65:12519:x1874622863743616:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:0.0:1787780026.586655:0:7821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787780026.586676:0:7821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868200/0xc8fc0a51799615ff lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea2126 expref: -99 pid: 7821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780026.586723:0:7821:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868800/0xc8fc0a51799615f8 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780026.586734:0:7821:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868200/0xc8fc0a51799615ff lrc: 4/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea2126 expref: 66 pid: 7821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780026.586768:0:7821:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868800/0xc8fc0a51799615f8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780026.586792:0:7821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868200/0xc8fc0a51799615ff lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea2126 expref: 66 pid: 7821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780026.586806:0:7821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c0443d81800) 00010000:00010000:0.0:1787780026.586809:0:7821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787780026.586813:0:7821:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868200/0xc8fc0a51799615ff lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea2126 expref: 66 pid: 7821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780026.586820:0:7821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0477868200, rc 0) 00000100:00100000:0.0:1787780026.586912:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c047785cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+66:12519:x1874622863743616:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 279us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780026.586919:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 231 00000100:00100000:1.0:1787780026.652346:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04778430c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1f575176-36bc-4786-83ee-2fea064a12a9:3644:1874622881630592:0@lo:400:kworker.0 00000100:00100000:1.0:1787780026.652419:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780026.652472:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04778403c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881631104:0@lo:400:kworker.0 00000100:00100000:1.0:1787780026.652518:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780026.652535:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477842d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1874622881631616:0@lo:400:kworker.0 00000100:00100000:1.0:1787780026.652575:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780026.652596:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1787780026.652601:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04778412c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874622881630976:0@lo:400:kworker.0 00000100:00100000:1.0:1787780026.652619:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780026.652648:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477840000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881631488:0@lo:400:kworker.0 00000100:00100000:1.0:1787780026.652669:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780026.652683:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346eff840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881632000:0@lo:400:kworker.0 00000100:00100000:1.0:1787780026.652700:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780026.652737:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881631616 00000100:00100000:1.0:1787780026.652744:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881631616 00000100:00100000:1.0:1787780026.653016:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881630976 00000100:00100000:1.0:1787780026.653021:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881630976 00000100:00100000:1.0:1787780026.653041:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 383 00000100:00100000:1.0:1787780026.653050:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346da4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1874622881631616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787780026.653101:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346da4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1874622881631616:12345-0@lo:400:kworker.0 Request processed in 52us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780026.653108:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 383 00000100:00100000:1.0:1787780026.653123:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:1.0:1787780026.653129:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346da6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1874622881630976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787780026.653151:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346da6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1874622881630976:12345-0@lo:400:kworker.0 Request processed in 23us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780026.653156:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00000100:00080000:1.0:1787780026.653171:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787780026.653197:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04778412c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874622881630976:0@lo:400:kworker.0 00000100:00100000:1.0:1787780026.653207:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477842d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1874622881631616:0@lo:400:kworker.0 00000100:00100000:3.0:1787780026.653487:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477840f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874622881630720:0@lo:400:kworker.0 00000100:00100000:3.0:1787780026.653532:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780026.653552:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04778421c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1874622881631232:0@lo:400:kworker.0 00000100:00100000:3.0:1787780026.653572:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780026.653588:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477843c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1874622881631744:0@lo:400:kworker.0 00000100:00100000:3.0:1787780026.653604:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780026.653626:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1787780026.653633:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477840b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881630848:0@lo:400:kworker.0 00000100:00100000:3.0:1787780026.653661:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780026.653679:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477843480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1874622881631360:0@lo:400:kworker.0 00000100:00100000:3.0:1787780026.653697:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780026.653719:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0458b89680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881631872:0@lo:400:kworker.0 00000100:00100000:0.0:1787780026.653737:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881630592 00000100:00100000:0.0:1787780026.653743:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881630592 00000100:00100000:3.0:1787780026.653751:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780026.653817:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881631104 00000100:00100000:3.0:1787780026.653822:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881631104 00000100:00100000:3.0:1787780026.653864:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881630848 00000100:00100000:3.0:1787780026.653867:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881630848 00000100:00100000:3.0:1787780026.653880:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1787780026.653887:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346da6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881631104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787780026.653908:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 400 00000100:00100000:0.0:1787780026.653920:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471775450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+24:3644:x1874622881630592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787780026.653927:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346da6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881631104:12345-0@lo:400:kworker.0 Request processed in 39us (1407us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780026.653934:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1787780026.653950:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1787780026.653958:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0345e74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881630848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787780026.653966:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471775450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+24:3644:x1874622881630592:12345-0@lo:400:kworker.0 Request processed in 49us (1546us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780026.653976:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 400 00000100:00100000:0.0:1787780026.654010:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881631488 00000100:00100000:3.0:1787780026.654012:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0345e74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881630848:12345-0@lo:400:kworker.0 Request processed in 54us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780026.654015:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881631488 00000100:00100000:3.0:1787780026.654023:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1787780026.654318:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787780026.654328:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0345e75e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881632128:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787780026.654359:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787780026.654389:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881632128 00000100:00100000:2.0:1787780026.654393:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881632128 00000100:00100000:2.0:1787780026.654423:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1787780026.654429:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c047785c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881632128:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787780026.654450:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33914560 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1787780026.654494:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c047785c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881632128:12345-0@lo:13:osp-pre-1-1.0 Request processed in 54us (122us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780026.654519:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1787780026.654552:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881632000 00000100:00100000:0.0:1787780026.654556:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881632000 00000100:00100000:3.0:1787780026.654611:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881631872 00000100:00100000:3.0:1787780026.654624:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881631872 00000100:00100000:3.0:1787780026.654644:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1787780026.654660:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346da4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881631488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787780026.654693:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346da4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881631488:12345-0@lo:400:kworker.0 Request processed in 43us (2023us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780026.654699:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1787780026.654721:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1787780026.654729:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346da7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3644:x1874622881632000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787780026.654765:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346da7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3644:x1874622881632000:12345-0@lo:400:kworker.0 Request processed in 37us (2063us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780026.654771:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1787780026.654782:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1787780026.654787:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0345e76d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881631872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787780026.654813:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0345e76d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881631872:12345-0@lo:400:kworker.0 Request processed in 26us (1071us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780026.654818:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1787780026.654874:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477840b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881630848:0@lo:400:kworker.0 00000100:00100000:3.0:1787780026.654885:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0458b89680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881631872:0@lo:400:kworker.0 00000100:00100000:3.0:1787780026.654914:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477840000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881631488:0@lo:400:kworker.0 00000100:00100000:3.0:1787780026.654924:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346eff840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881632000:0@lo:400:kworker.0 00000100:00100000:3.0:1787780026.654941:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04778430c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1f575176-36bc-4786-83ee-2fea064a12a9:3644:1874622881630592:0@lo:400:kworker.0 00000100:00100000:3.0:1787780026.654950:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04778403c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881631104:0@lo:400:kworker.0 00000100:00100000:3.0:1787780026.654973:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881630720 00000100:00100000:3.0:1787780026.654977:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881630720 00000100:00100000:3.0:1787780026.654992:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881631232 00000100:00100000:3.0:1787780026.654995:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881631232 00000100:00100000:3.0:1787780026.655007:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881631744 00000100:00100000:3.0:1787780026.655010:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881631744 00000100:00100000:3.0:1787780026.655019:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881631360 00000100:00100000:3.0:1787780026.655021:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881631360 00000100:00100000:3.0:1787780026.655033:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 385 00000100:00100000:3.0:1787780026.655037:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0345e77c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874622881630720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787780026.655639:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0345e77c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874622881630720:12345-0@lo:400:kworker.0 Request processed in 599us (2106us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780026.655648:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 385 00000100:00100000:3.0:1787780026.655672:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:3.0:1787780026.655681:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0345e76580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874622881631232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787780026.656104:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0345e76580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874622881631232:12345-0@lo:400:kworker.0 Request processed in 424us (2530us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780026.656111:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00000100:00100000:3.0:1787780026.656125:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 387 00000100:00100000:3.0:1787780026.656132:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0345e77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1874622881631744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787780026.656158:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0345e77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1874622881631744:12345-0@lo:400:kworker.0 Request processed in 28us (2553us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780026.656164:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 387 00000100:00100000:3.0:1787780026.656174:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00000100:00100000:3.0:1787780026.656190:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0345e770c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1874622881631360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787780026.656216:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0345e770c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1874622881631360:12345-0@lo:400:kworker.0 Request processed in 27us (2518us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780026.656221:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00010000:00080000:3.0:1787780026.656253:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0477843480 x1874622881631360/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787780042 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787780026.656264:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477843480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1874622881631360:0@lo:400:kworker.0 00000100:00100000:3.0:1787780026.656275:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477840f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874622881630720:0@lo:400:kworker.0 00000100:00100000:3.0:1787780026.656284:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04778421c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1874622881631232:0@lo:400:kworker.0 00010000:00080000:3.0:1787780026.656293:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0477843c00 x1874622881631744/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787780042 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787780026.656300:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477843c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1874622881631744:0@lo:400:kworker.0 00000100:00100000:3.0:1787780026.656379:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0345e75e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881632128:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1787780026.656900:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787780026.656905:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787780026.656909:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787780026.656912:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1787780027.164036:0:9898:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 435168193604ns, next at 436168190824ns, rc = 0 00000100:00100000:3.0:1787780027.164182:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346efd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881632256:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787780027.164252:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780027.164493:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0345e761c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874622881632384:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787780027.164537:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780027.164644:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881632256 00000100:00100000:3.0:1787780027.164652:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881632256 00000100:00100000:3.0:1787780027.164697:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881632384 00000100:00100000:3.0:1787780027.164708:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881632384 00000100:00100000:3.0:1787780027.164727:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1787780027.164735:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0345e75e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3641:x1874622881632256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787780027.164770:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33914560 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1787780027.165021:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0345e75e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3641:x1874622881632256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 285us (767us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780027.165029:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1787780027.165049:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1787780027.165066:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346da4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1874622881632384:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787780027.165078:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3691950080 00000100:00100000:3.0:1787780027.165108:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346da4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1874622881632384:12345-0@lo:13:osp-pre-0-1.0 Request processed in 54us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780027.165115:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1787780027.165243:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346efd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881632256:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787780027.165322:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0345e761c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874622881632384:0@lo:13:osp-pre-0-1.0 00000040:00080000:2.0:1787780027.420115:0:13794:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787780027.420125:0:13794:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787780027.420149:0:13794:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:2.0:1787780027.420158:0:13794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787780027.420295:0:13794:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047785da40 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13794:1874622881632512:192.168.203.31@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787780027.420396:0:13794:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0346b50240 going to sleep for 11 seconds 00000100:00100000:2.0:1787780027.428019:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787780027.428101:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863743744 00000100:00100000:3.0:1787780027.428109:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863743744 00000100:00100000:3.0:1787780027.428187:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 232 00000100:00100000:3.0:1787780027.428198:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c047785f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+67:12520:x1874622863743744:12345-192.168.203.31@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787780027.428241:0:6512:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787780027.428347:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c047785f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+67:12520:x1874622863743744:12345-192.168.203.31@tcp:53:lhsmtool_posix.0 Request processed in 150us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780027.428354:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 232 00000100:00080000:0.0:1787780027.428751:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787780027.429218:0:13794:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047785da40 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13794:1874622881632512:192.168.203.31@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787780027.444121:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787780027.445877:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863743872 00000100:00100000:3.0:1787780027.445889:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863743872 00000100:00100000:3.0:1787780027.445962:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 233 00000100:00100000:3.0:1787780027.445971:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477843c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+66:12520:x1874622863743872:12345-192.168.203.31@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787780027.446034:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd200/0xc8fc0a5179961606 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780027.446050:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd200/0xc8fc0a5179961606 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780027.446076:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd200/0xc8fc0a5179961606 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780027.446093:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc600/0xc8fc0a517996160d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780027.446100:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc600/0xc8fc0a517996160d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780027.446106:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc600/0xc8fc0a517996160d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780027.446127:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a5179961614 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780027.446136:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a5179961614 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780027.446143:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a5179961614 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787780027.446186:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:3.0:1787780027.446190:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787780027.446203:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a5179961614 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780027.446213:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd200/0xc8fc0a5179961606 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780027.446218:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd200/0xc8fc0a5179961606 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780027.446233:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd200/0xc8fc0a5179961606 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780027.446239:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c04766dd200 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:3.0:1787780027.446243:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd200/0xc8fc0a5179961606 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780027.446249:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd200/0xc8fc0a5179961606 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780027.446261:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c0347a50800) 00010000:00010000:3.0:1787780027.446263:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787780027.446267:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd200/0xc8fc0a5179961606 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780027.446273:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd200/0xc8fc0a5179961606 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780027.446284:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc600/0xc8fc0a517996160d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780027.446290:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc600/0xc8fc0a517996160d lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780027.446295:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc600/0xc8fc0a517996160d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780027.446299:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c04766dc600 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:3.0:1787780027.446302:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc600/0xc8fc0a517996160d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780027.446315:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc600/0xc8fc0a517996160d lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780027.446471:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x69d7fe76 (ffff9c0443d81500) 00010000:00010000:3.0:1787780027.446475:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787780027.446547:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc600/0xc8fc0a517996160d lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780027.446554:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc600/0xc8fc0a517996160d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780027.446569:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a5179961614 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780027.446574:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a5179961614 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780027.446579:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a5179961614 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780027.446584:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c04766dc400 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:3.0:1787780027.446587:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a5179961614 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780027.446593:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a5179961614 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780027.446600:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c0443d81800) 00010000:00010000:3.0:1787780027.446602:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787780027.446605:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a5179961614 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780027.446619:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a5179961614 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787780027.447451:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477843c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+66:12520:x1874622863743872:12345-192.168.203.31@tcp:34:lhsmtool_posix.0 Request processed in 1478us (3335us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780027.447462:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 233 00000100:00100000:0.0:1787780027.463608:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787780027.463731:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863744128 00000100:00100000:3.0:1787780027.463740:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863744128 00000100:00100000:3.0:1787780027.463884:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 234 00000100:00100000:3.0:1787780027.463908:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346efd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+66:12520:x1874622863744128:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787780027.463929:0:7821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787780027.463949:0:7821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a517996161b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea212d expref: -99 pid: 7821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780027.464047:0:7821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc600/0xc8fc0a5179961622 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780027.464063:0:7821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc600/0xc8fc0a5179961622 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780027.464074:0:7821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc600/0xc8fc0a5179961622 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787780027.464084:0:7821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:3.0:1787780027.464158:0:7821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc600/0xc8fc0a5179961622 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780027.464166:0:7821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc600/0xc8fc0a5179961622 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780027.464190:0:7821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc600/0xc8fc0a5179961622 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780027.464196:0:7821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c04766dc600 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:3.0:1787780027.464200:0:7821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc600/0xc8fc0a5179961622 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780027.464208:0:7821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc600/0xc8fc0a5179961622 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780027.464220:0:7821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c0443d81800) 00010000:00010000:3.0:1787780027.464223:0:7821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787780027.464238:0:7821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc600/0xc8fc0a5179961622 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780027.464245:0:7821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc600/0xc8fc0a5179961622 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780027.464287:0:7821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a517996161b lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea212d expref: 68 pid: 7821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780027.464297:0:7821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c0347a50800) 00010000:00010000:3.0:1787780027.464300:0:7821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787780027.464304:0:7821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a517996161b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea212d expref: 68 pid: 7821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780027.464314:0:7821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c04766dc400, rc 0) 00000100:00100000:3.0:1787780027.464378:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346efd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+67:12520:x1874622863744128:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 485us (778us total) trans 4294967505 rc 301/301 00000100:00100000:3.0:1787780027.464397:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 234 00000100:00100000:2.0:1787780027.474557:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787780027.474618:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863744256 00000100:00100000:3.0:1787780027.474628:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863744256 00000100:00100000:3.0:1787780027.474731:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 235 00000100:00100000:3.0:1787780027.474742:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c047785de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+67:12520:x1874622863744256:12345-192.168.203.31@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787780027.474778:0:6514:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787780027.474931:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c047785de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+67:12520:x1874622863744256:12345-192.168.203.31@tcp:53:lhsmtool_posix.0 Request processed in 190us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780027.474939:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 235 00000100:00100000:2.0:1787780027.487595:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787780027.488012:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863744512 00000100:00100000:3.0:1787780027.488021:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863744512 00000100:00100000:3.0:1787780027.488084:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 236 00000100:00100000:3.0:1787780027.488094:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c047785d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+67:12520:x1874622863744512:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787780027.488114:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787780027.488117:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787780027.488144:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868c00/0xc8fc0a51799615c0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea2111 expref: 67 pid: 12488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780027.488164:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c04478d7d00) 00010000:00010000:3.0:1787780027.488169:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787780027.488182:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a5179961630 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea2134 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787780027.498028:0:6513:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x6:0x0], index 1: 0 00010000:00010000:2.0:1787780027.498201:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18000/0xc8fc0a5179961637 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780027.498219:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18000/0xc8fc0a5179961637 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780027.499048:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18000/0xc8fc0a5179961637 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780027.499126:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a5179961630 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea2134 expref: 69 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780027.499147:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18000/0xc8fc0a5179961637 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea2134 expref: 68 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780027.499155:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9c0347a4eb00) 00010000:00010000:2.0:1787780027.499158:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787780027.499174:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0444c18000, rc 0) 00000100:00100000:2.0:1787780027.499250:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c047785d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+68:12520:x1874622863744512:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 11156us (11662us total) trans 4294967506 rc 0/0 00000100:00100000:2.0:1787780027.499259:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 236 00000100:00100000:1.0:1787780027.506144:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787780027.506196:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863744768 00000100:00100000:3.0:1787780027.506206:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863744768 00000100:00100000:3.0:1787780027.506357:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 237 00000100:00100000:3.0:1787780027.506383:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04778421c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+68:12520:x1874622863744768:12345-192.168.203.31@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787780027.506444:0:7821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787780027.506471:0:7821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18000/0xc8fc0a5179961637 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea2134 expref: 68 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780027.506491:0:7821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9c0347a4eb00) 00010000:00010000:3.0:1787780027.506516:0:7821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787780027.506538:0:7821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc600/0xc8fc0a5179961645 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780027.506552:0:7821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc600/0xc8fc0a5179961645 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780027.506563:0:7821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc600/0xc8fc0a5179961645 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780027.506576:0:7821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd200/0xc8fc0a517996164c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x21f39305 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780027.506583:0:7821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd200/0xc8fc0a517996164c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x21f39305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780027.506590:0:7821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd200/0xc8fc0a517996164c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x21f39305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780027.506631:0:7821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc600/0xc8fc0a5179961645 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780027.506638:0:7821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc600/0xc8fc0a5179961645 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780027.506676:0:7821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc600/0xc8fc0a5179961645 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780027.506683:0:7821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c04766dc600 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:3.0:1787780027.506688:0:7821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc600/0xc8fc0a5179961645 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780027.506695:0:7821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc600/0xc8fc0a5179961645 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780027.506704:0:7821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c04478d7d00) 00010000:00010000:3.0:1787780027.506707:0:7821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787780027.506710:0:7821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc600/0xc8fc0a5179961645 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780027.506716:0:7821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc600/0xc8fc0a5179961645 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780027.506727:0:7821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd200/0xc8fc0a517996164c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x21f39305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780027.506732:0:7821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd200/0xc8fc0a517996164c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x21f39305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780027.506737:0:7821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd200/0xc8fc0a517996164c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x21f39305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780027.506742:0:7821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c04766dd200 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:3.0:1787780027.506745:0:7821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd200/0xc8fc0a517996164c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x21f39305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780027.506760:0:7821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd200/0xc8fc0a517996164c lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x21f39305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780027.506768:0:7821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x21f39305 (ffff9c0443d81500) 00010000:00010000:3.0:1787780027.506770:0:7821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787780027.506773:0:7821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd200/0xc8fc0a517996164c lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x21f39305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780027.506779:0:7821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd200/0xc8fc0a517996164c lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x21f39305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787780027.506891:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04778421c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+67:12520:x1874622863744768:12345-192.168.203.31@tcp:36:lhsmtool_posix.0 Request processed in 510us (757us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787780027.506898:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 237 00000100:00100000:1.0:1787780027.513655:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787780027.513708:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863744896 00000100:00100000:3.0:1787780027.513716:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863744896 00000100:00100000:3.0:1787780027.513772:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 238 00000100:00100000:3.0:1787780027.513783:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477840f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+67:12520:x1874622863744896:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787780027.513804:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787780027.513831:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd200/0xc8fc0a5179961653 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea213b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780027.513900:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc600/0xc8fc0a517996165a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780027.513914:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc600/0xc8fc0a517996165a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780027.513927:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc600/0xc8fc0a517996165a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780027.514104:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd200/0xc8fc0a5179961653 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea213b expref: 69 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780027.514124:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc600/0xc8fc0a517996165a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea213b expref: 68 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780027.514133:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9c0443d81500) 00010000:00010000:2.0:1787780027.514135:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787780027.514138:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c04766dc600, rc 0) 00000100:00100000:2.0:1787780027.514199:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477840f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+68:12520:x1874622863744896:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 418us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780027.514207:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 238 00000100:00100000:2.0:1787780027.519301:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787780027.519516:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863745152 00000100:00100000:0.0:1787780027.519525:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863745152 00000100:00100000:0.0:1787780027.519584:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 239 00000100:00100000:0.0:1787780027.519594:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c047785e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+68:12520:x1874622863745152:12345-192.168.203.31@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787780027.519673:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869400/0xc8fc0a5179961661 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780027.519689:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869400/0xc8fc0a5179961661 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780027.519700:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869400/0xc8fc0a5179961661 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787780027.519880:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00010000:0.0:1787780027.520193:0:6513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000005fad68f reply state 0000000011bb1078 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869400/0xc8fc0a5179961661 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780027.520208:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869400/0xc8fc0a5179961661 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780027.520217:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9c0443d81500) 00010000:00010000:0.0:1787780027.520220:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1787780027.520223:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787780027.521068:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c047785e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+70:12520:x1874622863745152:12345-192.168.203.31@tcp:36:lhsmtool_posix.0 Request processed in 1471us (1772us total) trans 4294967507 rc 0/0 00000100:00100000:0.0:1787780027.521077:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 239 00000100:00100000:1.0:1787780027.536577:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787780027.540645:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863745280 00000100:00100000:3.0:1787780027.540660:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863745280 00000100:00100000:3.0:1787780027.540807:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 240 00000100:00100000:3.0:1787780027.540818:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477843480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+70:12520:x1874622863745280:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787780027.540854:0:7821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787780027.540877:0:7821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dca00/0xc8fc0a5179961668 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea2142 expref: -99 pid: 7821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780027.540950:0:7821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dca00/0xc8fc0a5179961668 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea2142 expref: 71 pid: 7821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780027.540963:0:7821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dca00/0xc8fc0a5179961668 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea2142 expref: 71 pid: 7821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780027.540981:0:7821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9c0443d81500) 00010000:00010000:3.0:1787780027.540985:0:7821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787780027.540989:0:7821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c04766dca00, rc 0) 00000100:00100000:3.0:1787780027.541062:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477843480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+71:12520:x1874622863745280:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 246us (4493us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780027.541070:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 240 00000100:00100000:1.0:1787780027.547526:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787780027.547818:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863745408 00000100:00100000:2.0:1787780027.547827:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863745408 00000100:00080000:0.0:1787780027.548013:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787780027.548033:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 70 00000100:00100000:2.0:1787780027.548043:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04778403c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+9:2410:x1874622863745408:12345-192.168.203.31@tcp:2:lhsmtool_posix.0 00010000:00010000:1.0:1787780027.548220:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787780027.548572:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04778403c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+10:2410:x1874622863745408:12345-192.168.203.31@tcp:2:lhsmtool_posix.0 Request processed in 530us (1055us total) trans 4294967320 rc 0/0 00000100:00100000:2.0:1787780027.548581:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 70 00000100:00100000:1.0:1787780027.552203:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787780027.552267:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863745664 00000100:00100000:0.0:1787780027.552275:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863745664 00000100:00100000:0.0:1787780027.552365:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 60 00000100:00100000:0.0:1787780027.552374:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04778430c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+71:12520:x1874622863745664:12345-192.168.203.31@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787780027.552569:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04778430c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+72:12520:x1874622863745664:12345-192.168.203.31@tcp:35:lhsmtool_posix.0 Request processed in 196us (430us total) trans 4294967508 rc 0/0 00000100:00100000:0.0:1787780027.552575:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 60 00000100:00100000:1.0:1787780027.555045:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787780027.555299:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863745920 00000100:00100000:3.0:1787780027.555308:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863745920 00000100:00100000:3.0:1787780027.555367:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 241 00000100:00100000:3.0:1787780027.555376:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477840000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+72:12520:x1874622863745920:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787780027.555494:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477840000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+72:12520:x1874622863745920:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 Request processed in 119us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780027.555536:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 241 00000100:00100000:1.0:1787780027.558288:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787780027.558434:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863746048 00000100:00100000:0.0:1787780027.558443:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863746048 00000100:00100000:0.0:1787780027.558559:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 242 00000100:00100000:0.0:1787780027.558569:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477840b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+72:12520:x1874622863746048:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787780027.558586:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787780027.558605:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868c00/0xc8fc0a517996166f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea2149 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780027.558668:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869200/0xc8fc0a5179961676 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780027.558682:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869200/0xc8fc0a5179961676 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780027.558692:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869200/0xc8fc0a5179961676 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787780027.558729:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787780027.558744:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869200/0xc8fc0a5179961676 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780027.558896:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868c00/0xc8fc0a517996166f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea2149 expref: 74 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780027.558984:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869200/0xc8fc0a5179961676 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea2149 expref: 73 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780027.558993:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9c0443d81500) 00010000:00010000:0.0:1787780027.558996:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787780027.559000:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0477869200, rc 0) 00000100:00100000:0.0:1787780027.559048:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477840b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+73:12520:x1874622863746048:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 481us (768us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780027.559056:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 242 00000100:00100000:1.0:1787780027.561950:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787780027.562042:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863746176 00000100:00100000:3.0:1787780027.562051:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863746176 00000100:00100000:3.0:1787780027.562108:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 71 00000100:00100000:3.0:1787780027.562118:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477842d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+10:2410:x1874622863746176:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787780027.562134:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787780027.562212:0:8428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000b11bb6b/0xc8fc0a517996167d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea2150 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787780027.562236:0:8428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8f5bbc, blocks: 0x0 00010000:00010000:3.0:1787780027.562254:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=435s v=(0 0) 00010000:00010000:3.0:1787780027.562258:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787780027.562267:0:8428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000b11bb6b/0xc8fc0a517996167d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea2150 expref: 11 pid: 8428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780027.562283:0:8428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000b11bb6b/0xc8fc0a517996167d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea2150 expref: 11 pid: 8428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780027.562294:0:8428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c04766dd200, rc 0) 00000100:00100000:3.0:1787780027.562415:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477842d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+11:2410:x1874622863746176:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 297us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780027.562423:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 71 00000100:00100000:1.0:1787780027.566236:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787780027.566377:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863746432 00000100:00100000:3.0:1787780027.566387:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863746432 00000100:00100000:3.0:1787780027.566474:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 243 00000100:00100000:3.0:1787780027.566492:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04778412c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+73:12520:x1874622863746432:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787780027.566617:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04778412c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+73:12520:x1874622863746432:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 Request processed in 127us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780027.566625:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 243 00000100:00100000:1.0:1787780027.572453:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787780027.572586:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863746560 00000100:00100000:3.0:1787780027.572596:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863746560 00000100:00100000:3.0:1787780027.572658:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 72 00000100:00100000:3.0:1787780027.572668:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347e57840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+11:12520:x1874622863746560:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787780027.572685:0:9899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787780027.572702:0:9899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006f2710ee/0xc8fc0a5179961684 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea2157 expref: -99 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780027.572732:0:9899:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000b11bb6b/0xc8fc0a517996167d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea2150 expref: 12 pid: 8428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780027.572749:0:9899:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787780027.572753:0:9899:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787780027.572758:0:9899:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006f2710ee/0xc8fc0a5179961684 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea2157 expref: 12 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780027.572789:0:9899:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000b11bb6b/0xc8fc0a517996167d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea2150 expref: 12 pid: 8428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780027.572803:0:9899:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000b11bb6b/0xc8fc0a517996167d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea2150 expref: 12 pid: 8428 timeout: 535 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787780027.572818:0:9899:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0345e75a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9899:1874622881632640:192.168.203.31@tcp:104: 00000100:00100000:3.0:1787780027.572952:0:9899:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0477835840 going to sleep for 11 seconds 00000100:00100000:3.0:1787780027.577202:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787780027.577331:0:9899:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0345e75a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9899:1874622881632640:192.168.203.31@tcp:104: 00010000:00010000:0.0:1787780027.577361:0:9899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006f2710ee/0xc8fc0a5179961684 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0xf757128131ea2157 expref: 12 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780027.577381:0:9899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c04766dc400, rc 0) 00000100:00100000:0.0:1787780027.577429:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347e57840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+12:12520:x1874622863746560:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 4762us (4985us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780027.577437:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 72 00000100:00100000:1.0:1787780027.578042:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863746688 00000100:00100000:1.0:1787780027.578050:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863746688 00010000:00010000:1.0:1787780027.578085:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000b11bb6b/0xc8fc0a517996167d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea2150 expref: 12 pid: 8428 timeout: 535 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787780027.578117:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 101 00000100:00100000:1.0:1787780027.578125:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0345e761c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+12:2411:x1874622863746688:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787780027.578138:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787780027.578168:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000b11bb6b/0xc8fc0a517996167d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea2150 expref: 12 pid: 8428 timeout: 535 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780027.578193:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000b11bb6b/0xc8fc0a517996167d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea2150 expref: 12 pid: 8428 timeout: 535 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780027.578214:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000b11bb6b/0xc8fc0a517996167d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea2150 expref: 12 pid: 8428 timeout: 535 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780027.578228:0:6499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787780027.578233:0:6499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787780027.578240:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006f2710ee/0xc8fc0a5179961684 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.31@tcp remote: 0xf757128131ea2157 expref: 11 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780027.578250:0:6499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006f2710ee/0xc8fc0a5179961684 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.31@tcp remote: 0xf757128131ea2157 expref: 11 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780027.578279:0:6499:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000006f2710ee/0xc8fc0a5179961684 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0xf757128131ea2157 expref: 11 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787780027.578292:0:6499:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347fa8b40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6499:1874622881632768:192.168.203.31@tcp:105: 00000100:00100000:1.0:1787780027.578352:0:6499:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0476660180 going to sleep for 11 seconds 00000100:00100000:1.0:1787780027.583055:0:6499:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347fa8b40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6499:1874622881632768:192.168.203.31@tcp:105: 00010000:00010000:1.0:1787780027.583088:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787780027.583132:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0345e761c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+11:2411:x1874622863746688:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 5007us (5993us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780027.583151:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 101 00000100:00100000:1.0:1787780027.590086:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787780027.590227:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863746816 00000100:00100000:3.0:1787780027.590237:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863746816 00002000:00100000:3.0:1787780027.590281:0:8433:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x6:0x0] (0->12) req@ffff9c0347fa8b40 x1874622863746816/t0(0) o4->781d29bb-23d2-48e3-b16d-c29e52cd5375@192.168.203.31@tcp:438/0 lens 504/0 e 0 to 0 dl 1787780038 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787780027.590292:0:8433:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c0347fa8b40 with x1874622863746816 ext(0->12) 00002000:00010000:3.0:1787780027.590297:0:8433:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c0347fa8b40 00000100:00100000:3.0:1787780027.590412:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 6 00000100:00100000:3.0:1787780027.590421:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347fa8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+11:2408:x1874622863746816:12345-192.168.203.31@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1787780027.592676:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347fa8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+13:2408:x1874622863746816:12345-192.168.203.31@tcp:4:lhsmtool_posix.0 Request processed in 905us (1249us total) trans 4294967321 rc 0/0 00000100:00100000:3.0:1787780027.592690:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 6 00002000:00100000:3.0:1787780027.592703:0:8433:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x6:0x0] (0->12) req@ffff9c0347fa8b40 x1874622863746816/t4294967321(0) o4->781d29bb-23d2-48e3-b16d-c29e52cd5375@192.168.203.31@tcp:438/0 lens 504/448 e 0 to 0 dl 1787780038 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787780027.592713:0:8433:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c0347fa8b40 with x1874622863746816 ext(0->12) 00002000:00010000:3.0:1787780027.592719:0:8433:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c0347fa8b40 00000100:00100000:1.0:1787780027.593967:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787780027.594636:0:12488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863746944 00000100:00100000:0.0:1787780027.594645:0:12488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863746944 00000100:00100000:0.0:1787780027.594705:0:12488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 244 00000100:00100000:0.0:1787780027.594714:0:12488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347fa9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:781d29bb-23d2-48e3-b16d-c29e52cd5375+73:12520:x1874622863746944:12345-192.168.203.31@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1787780027.612836:0:6491:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967508 is committed 00000004:00080000:0.0:1787780027.612894:0:6491:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000004:00080000:0.0:1787780027.612928:0:6491:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000020:00080000:0.0:1787780027.612948:0:6491:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9c0347ec6c00 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:0.0:1787780027.612954:0:6491:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c0346b90000 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9c0347ec6180 00000020:00080000:0.0:1787780027.612957:0:6491:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c0346b90600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9c0347cb5a00 00000004:00080000:0.0:1787780027.612982:0:6491:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000020:00080000:0.0:1787780027.613000:0:6491:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9c0477835c00 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:0.0:1787780027.613004:0:6491:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c0346b56500 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9c0477835cc0 00000020:00080000:0.0:1787780027.613007:0:6491:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c0346b56e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9c0346c78800 00000020:00080000:0.0:1787780027.613018:0:6491:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000020:00080000:3.0:1787780027.613116:0:6544:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000100:00100000:0.0:1787780027.613162:0:12488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347fa9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:781d29bb-23d2-48e3-b16d-c29e52cd5375+27:12520:x1874622863746944:12345-192.168.203.31@tcp:44:lhsmtool_posix.0 Request processed in 18444us (19194us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780027.613173:0:12488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 244 00000020:00080000:3.0:1787780027.613178:0:6544:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1787780027.613197:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0345e76940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881632896:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787780027.613251:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780027.613315:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787780027.613323:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347fa9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881633024:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1787780027.613391:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780027.613435:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881632896 00000100:00100000:3.0:1787780027.613443:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881632896 00000100:00100000:3.0:1787780027.613477:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881633024 00000100:00100000:3.0:1787780027.613480:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881633024 00000100:00100000:3.0:1787780027.613522:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787780027.613531:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0345e743c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3643:x1874622881632896:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1787780027.613553:0:8428:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:5 count 1 00000100:00100000:0.0:1787780027.614412:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787780027.614425:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0345e75680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3643:x1874622881633024:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1787780027.614442:0:8427:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:5 count 1 00010000:00010000:0.0:1787780027.614465:0:8427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd4d065d/0xc8fc0a517996168b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780027.614483:0:8427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000094079826/0xc8fc0a517996143f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea20af expref: 12 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780027.614491:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1787780027.614495:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787780027.614510:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cd4d065d/0xc8fc0a517996168b lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780027.614562:0:8427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000094079826/0xc8fc0a517996143f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.31@tcp remote: 0xf757128131ea20af expref: 12 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780027.614576:0:8427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000094079826/0xc8fc0a517996143f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.31@tcp remote: 0xf757128131ea20af expref: 12 pid: 8427 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787780027.614588:0:8427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346efc3c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8427:1874622881633152:192.168.203.31@tcp:104: 00000100:00100000:0.0:1787780027.614651:0:8427:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0347d45600 going to sleep for 11 seconds 00010000:00010000:2.0:1787780027.614914:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868e00/0xc8fc0a5179961389 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780027.614936:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868e00/0xc8fc0a5179961389 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780027.614943:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868e00/0xc8fc0a5179961389 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780027.614950:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0477868e00 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:2.0:1787780027.614956:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868e00/0xc8fc0a5179961389 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780027.614964:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868e00/0xc8fc0a5179961389 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780027.614981:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9c0347bec100) 00010000:00010000:2.0:1787780027.614984:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787780027.614988:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868e00/0xc8fc0a5179961389 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780027.614996:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868e00/0xc8fc0a5179961389 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780027.615023:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868400/0xc8fc0a5179961431 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780027.615030:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868400/0xc8fc0a5179961431 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780027.615036:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868400/0xc8fc0a5179961431 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780027.615041:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0477868400 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:2.0:1787780027.615064:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868400/0xc8fc0a5179961431 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780027.615072:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868400/0xc8fc0a5179961431 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780027.615080:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c0443d81600) 00010000:00010000:2.0:1787780027.615083:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787780027.615086:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868400/0xc8fc0a5179961431 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780027.615092:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868400/0xc8fc0a5179961431 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780027.615109:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869000/0xc8fc0a51799614af lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780027.615115:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869000/0xc8fc0a51799614af lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780027.615122:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869000/0xc8fc0a51799614af lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780027.615126:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0477869000 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:2.0:1787780027.615130:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869000/0xc8fc0a51799614af lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780027.615136:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869000/0xc8fc0a51799614af lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780027.615143:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9c0347bece00) 00010000:00010000:2.0:1787780027.615145:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787780027.615156:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869000/0xc8fc0a51799614af lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780027.615163:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869000/0xc8fc0a51799614af lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780027.615174:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869600/0xc8fc0a51799614d2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780027.615180:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869600/0xc8fc0a51799614d2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780027.615185:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869600/0xc8fc0a51799614d2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780027.615189:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0477869600 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:2.0:1787780027.615192:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869600/0xc8fc0a51799614d2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780027.615197:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869600/0xc8fc0a51799614d2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780027.615203:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9c0347bece00) 00010000:00010000:2.0:1787780027.615205:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787780027.615207:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869600/0xc8fc0a51799614d2 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780027.615212:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869600/0xc8fc0a51799614d2 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780027.615224:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869c00/0xc8fc0a51799615a4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780027.615236:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869c00/0xc8fc0a51799615a4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780027.615242:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869c00/0xc8fc0a51799615a4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780027.615246:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0477869c00 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:2.0:1787780027.615249:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869c00/0xc8fc0a51799615a4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780027.615254:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869c00/0xc8fc0a51799615a4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780027.615260:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c0443d81800) 00010000:00010000:2.0:1787780027.615262:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787780027.615265:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869c00/0xc8fc0a51799615a4 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780027.615270:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869c00/0xc8fc0a51799615a4 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780027.615278:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869400/0xc8fc0a5179961661 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780027.615283:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869400/0xc8fc0a5179961661 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780027.615287:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869400/0xc8fc0a5179961661 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780027.615292:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0477869400 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:2.0:1787780027.615298:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869400/0xc8fc0a5179961661 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780027.615304:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869400/0xc8fc0a5179961661 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780027.615311:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9c0443d81500) 00010000:00010000:2.0:1787780027.615313:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787780027.615316:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869400/0xc8fc0a5179961661 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780027.615321:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869400/0xc8fc0a5179961661 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787780027.617181:0:8428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a8f5bba, atime: 0x6a8f5bba, ctime: 0x6a8f5bba, blocks: 0x8 00010000:00010000:3.0:1787780027.617191:0:8428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d15bd552/0xc8fc0a5179961692 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780027.617207:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=435s v=(0 0) 00010000:00010000:3.0:1787780027.617212:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787780027.617218:0:8428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d15bd552/0xc8fc0a5179961692 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780027.617235:0:8428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d15bd552/0xc8fc0a5179961692 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780027.617245:0:8428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d15bd552/0xc8fc0a5179961692 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780027.617253:0:8428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d15bd552/0xc8fc0a5179961692 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780027.617278:0:8428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787780027.617423:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787780027.617431:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d15bd552/0xc8fc0a5179961692 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780027.617441:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c04766ddc00 already unused, calling callback (ffffffffc0d97420) 00010000:00010000:2.0:1787780027.617446:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d15bd552/0xc8fc0a5179961692 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780027.617455:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d15bd552/0xc8fc0a5179961692 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780027.617471:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d15bd552/0xc8fc0a5179961692 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780027.617479:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d15bd552/0xc8fc0a5179961692 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780027.617530:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787780027.617533:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787780027.617535:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787780027.617579:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0345e743c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3643:x1874622881632896:12345-0@lo:6:osp-syn-0-0.0 Request processed in 4047us (4325us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1787780027.617598:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787780027.617712:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787780027.617989:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863747072 00000100:00100000:2.0:1787780027.617997:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863747072 00000100:00100000:2.0:1787780027.618050:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 75 00000100:00100000:2.0:1787780027.618061:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347faa580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+13:2411:x1874622863747072:12345-192.168.203.31@tcp:16:lhsmtool_posix.0 00000004:00080000:0.0:1787780027.618066:0:3643:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c0345e76940/2, rc 0, transno 4294967311 00000100:00100000:0.0:1787780027.618075:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0345e76940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881632896:0@lo:6:osp-syn-0-0.0 00000001:00080000:0.0:1787780027.619828:0:9508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000001:00080000:0.0:1787780027.620105:0:9508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967318 is committed 00000100:00100000:1.0:1787780027.625151:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787780027.625182:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863747200 00000100:00100000:1.0:1787780027.625190:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863747200 00010000:00010000:1.0:1787780027.625229:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000094079826/0xc8fc0a517996143f lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.31@tcp remote: 0xf757128131ea20af expref: 9 pid: 8427 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787780027.625267:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 102 00000100:00100000:1.0:1787780027.625276:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347faa940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+9:2411:x1874622863747200:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787780027.625290:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787780027.625296:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000094079826/0xc8fc0a517996143f lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.31@tcp remote: 0xf757128131ea20af expref: 9 pid: 8427 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787780027.625311:0:8427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346efc3c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8427:1874622881633152:192.168.203.31@tcp:104: 00010000:00010000:1.0:1787780027.625315:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000094079826/0xc8fc0a517996143f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.31@tcp remote: 0xf757128131ea20af expref: 9 pid: 8427 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780027.625339:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000094079826/0xc8fc0a517996143f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.31@tcp remote: 0xf757128131ea20af expref: 9 pid: 8427 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780027.625343:0:8427:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000cd4d065d/0xc8fc0a517996168b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780027.625358:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787780027.625364:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787780027.625369:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cd4d065d/0xc8fc0a517996168b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780027.625379:0:6497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cd4d065d/0xc8fc0a517996168b lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787780027.630299:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347faa580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+8:2411:x1874622863747072:12345-192.168.203.31@tcp:16:lhsmtool_posix.0 Request processed in 12230us (12578us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780027.630313:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 75 00010000:00010000:1.0:1787780027.630688:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787780027.630719:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347faa940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+7:2411:x1874622863747200:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 5443us (5578us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780027.630728:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 102 00010000:00010000:3.0:1787780027.630774:0:8427:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000cd4d065d/0xc8fc0a517996168b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780027.630874:0:8427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cd4d065d/0xc8fc0a517996168b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780027.630888:0:8427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd4d065d/0xc8fc0a517996168b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780027.630899:0:8427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cd4d065d/0xc8fc0a517996168b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780027.631012:0:8427:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787780027.631373:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0345e75680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3643:x1874622881633024:12345-0@lo:6:osp-syn-1-0.0 Request processed in 16951us (18022us total) trans 4294967322 rc 0/0 00000100:00100000:2.0:1787780027.631381:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00010000:1.0:1787780027.631483:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787780027.631489:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cd4d065d/0xc8fc0a517996168b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780027.631512:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0477868c00 already unused, calling callback (ffffffffc0d97420) 00010000:00010000:1.0:1787780027.631516:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd4d065d/0xc8fc0a517996168b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780027.631525:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd4d065d/0xc8fc0a517996168b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780027.631543:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cd4d065d/0xc8fc0a517996168b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780027.631550:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cd4d065d/0xc8fc0a517996168b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780027.631568:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787780027.631570:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787780027.631571:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787780027.632018:0:3643:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967318 gen 2 00000004:00080000:0.0:1787780027.632025:0:3643:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967318 committed transno 4294967318 00000100:00100000:0.0:1787780027.632049:0:3643:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9c0347fa9680 x1874622881633024/t4294967322(4294967322) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787780043 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1787780027.632062:0:3643:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c0347fa9680/2, rc 0, transno 4294967322 00000100:00100000:0.0:1787780027.632073:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347fa9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881633024:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1787780027.636263:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787780027.636874:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863747456 00000100:00100000:0.0:1787780027.636890:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863747456 00000100:00100000:0.0:1787780027.636945:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 245 00000100:00100000:0.0:1787780027.636956:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347fa83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+21:12520:x1874622863747456:12345-192.168.203.31@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787780027.637005:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787780027.637038:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869200/0xc8fc0a5179961676 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea2149 expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780027.637056:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9c0443d81500) 00010000:00010000:0.0:1787780027.637061:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787780027.637088:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0481372e00/0xc8fc0a5179961699 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780027.637101:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0481372e00/0xc8fc0a5179961699 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780027.637110:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0481372e00/0xc8fc0a5179961699 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787780027.637221:0:6513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000086079dfa reply state 000000009c1fc89f transno 4294967509 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0481372e00/0xc8fc0a5179961699 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780027.637232:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0481372e00/0xc8fc0a5179961699 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780027.637239:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9c0443d81500) 00010000:00010000:0.0:1787780027.637241:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787780027.637244:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787780027.637339:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347fa83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+22:12520:x1874622863747456:12345-192.168.203.31@tcp:36:lhsmtool_posix.0 Request processed in 384us (1085us total) trans 4294967509 rc 0/0 00000100:00100000:0.0:1787780027.637347:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 245 00000100:00100000:1.0:1787780027.650232:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787780027.650668:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863747584 00000100:00100000:3.0:1787780027.650678:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863747584 00000100:00100000:3.0:1787780027.650732:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 76 00000100:00100000:3.0:1787780027.650752:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347faa1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+7:2408:x1874622863747584:12345-192.168.203.31@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1787780027.650937:0:8428:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1787780027.650941:0:8428:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb mtime from disk: 0 -> 1787780027 00002000:00010000:3.0:1787780027.650943:0:8428:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb atime from disk: 0 -> 1787780026 00002000:00010000:3.0:1787780027.650945:0:8428:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb ctime from disk: 1787780028 -> 1787780027 00002000:00010000:3.0:1787780027.650955:0:8428:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:3.0:1787780027.651011:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347faa1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+8:2408:x1874622863747584:12345-192.168.203.31@tcp:2:lhsmtool_posix.0 Request processed in 261us (789us total) trans 4294967323 rc 0/0 00000100:00100000:3.0:1787780027.651018:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 76 00000100:00100000:1.0:1787780027.656768:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787780027.656910:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863747840 00000100:00100000:3.0:1787780027.656919:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863747840 00000100:00100000:3.0:1787780027.656983:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 246 00000100:00100000:3.0:1787780027.656994:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347fab840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+22:12520:x1874622863747840:12345-192.168.203.31@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1787780027.657072:0:7821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd600/0xc8fc0a51799616a0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780027.657090:0:7821:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc600/0xc8fc0a517996165a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea213b expref: 22 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780027.657101:0:7821:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd600/0xc8fc0a51799616a0 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780027.657134:0:7821:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc600/0xc8fc0a517996165a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea213b expref: 22 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780027.657149:0:7821:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc600/0xc8fc0a517996165a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea213b expref: 22 pid: 6514 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787780027.657164:0:7821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0345e74780 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7821:1874622881633280:192.168.203.31@tcp:104: 00000100:00100000:3.0:1787780027.657261:0:7821:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0477835480 going to sleep for 11 seconds 00000100:00100000:0.0:1787780027.663324:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787780027.663476:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863747968 00000100:00100000:1.0:1787780027.663484:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863747968 00010000:00010000:1.0:1787780027.663535:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc600/0xc8fc0a517996165a lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea213b expref: 23 pid: 6514 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787780027.663579:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 103 00000100:00100000:1.0:1787780027.663589:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346efda40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+23:2411:x1874622863747968:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787780027.663601:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787780027.663608:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc600/0xc8fc0a517996165a lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea213b expref: 23 pid: 6514 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780027.663628:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc600/0xc8fc0a517996165a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea213b expref: 23 pid: 6514 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780027.663649:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9c0443d81500) 00010000:00010000:1.0:1787780027.663653:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd600/0xc8fc0a51799616a0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780027.663662:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd600/0xc8fc0a51799616a0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780027.663669:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd600/0xc8fc0a51799616a0 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780027.663686:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787780027.663732:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346efda40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+23:2411:x1874622863747968:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 145us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780027.663745:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 103 00010000:00010000:3.0:1787780027.665295:0:7821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc600/0xc8fc0a517996165a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea213b expref: 22 pid: 6514 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787780027.666130:0:7821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0345e74780 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7821:1874622881633280:192.168.203.31@tcp:104: 00010000:00010000:3.0:1787780027.666154:0:7821:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd600/0xc8fc0a51799616a0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780027.666225:0:7821:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd600/0xc8fc0a51799616a0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780027.666232:0:7821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd600/0xc8fc0a51799616a0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780027.666268:0:7821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd600/0xc8fc0a51799616a0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780027.666274:0:7821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd600/0xc8fc0a51799616a0 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780027.666280:0:7821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd600/0xc8fc0a51799616a0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780027.666294:0:7821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c04766dd600 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:2.0:1787780027.666298:0:7821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd600/0xc8fc0a51799616a0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780027.666305:0:7821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd600/0xc8fc0a51799616a0 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780027.666318:0:7821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9c0443d81500) 00010000:00010000:2.0:1787780027.666321:0:7821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1787780027.666325:0:7821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd600/0xc8fc0a51799616a0 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780027.666331:0:7821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd600/0xc8fc0a51799616a0 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787780027.666468:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347fab840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+21:12520:x1874622863747840:12345-192.168.203.31@tcp:55:lhsmtool_posix.0 Request processed in 9475us (9708us total) trans 0 rc -22/-22 00000100:00100000:2.0:1787780027.666477:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 246 00000100:00100000:0.0:1787780027.673404:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787780027.673756:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863748096 00000100:00100000:2.0:1787780027.673765:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863748096 00000100:00100000:2.0:1787780027.673826:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 77 00000100:00100000:2.0:1787780027.673862:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346eff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+8:2410:x1874622863748096:12345-192.168.203.31@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787780027.674482:0:9899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000d29a67b2/0xc8fc0a51799616a7 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780027.674518:0:9899:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006f2710ee/0xc8fc0a5179961684 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0xf757128131ea2157 expref: 8 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780027.674642:0:9899:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787780027.674647:0:9899:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787780027.674653:0:9899:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d29a67b2/0xc8fc0a51799616a7 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780027.674688:0:9899:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006f2710ee/0xc8fc0a5179961684 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.31@tcp remote: 0xf757128131ea2157 expref: 8 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780027.674704:0:9899:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006f2710ee/0xc8fc0a5179961684 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.31@tcp remote: 0xf757128131ea2157 expref: 8 pid: 9899 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787780027.674719:0:9899:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047785fc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9899:1874622881633408:192.168.203.31@tcp:104: 00000100:00100000:2.0:1787780027.675717:0:9899:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c045848bcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787780027.676572:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787780027.676591:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047785f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881633536:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787780027.676634:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780027.676993:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881633536 00000100:00100000:3.0:1787780027.677001:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881633536 00000100:00100000:3.0:1787780027.677050:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1787780027.677060:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347fa8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3642:x1874622881633536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787780027.677080:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3691950080 00000100:00100000:3.0:1787780027.677130:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347fa8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3642:x1874622881633536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780027.677139:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1787780027.677169:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047785f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881633536:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787780027.682459:0:9899:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047785fc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9899:1874622881633408:192.168.203.31@tcp:104: 00010000:00010000:2.0:1787780027.682492:0:9899:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d29a67b2/0xc8fc0a51799616a7 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787780027.683055:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787780027.683538:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863748224 00000100:00100000:3.0:1787780027.683614:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863748224 00010000:00010000:3.0:1787780027.683652:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006f2710ee/0xc8fc0a5179961684 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.31@tcp remote: 0xf757128131ea2157 expref: 9 pid: 9899 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787780027.683695:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 104 00000100:00100000:3.0:1787780027.684418:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347fa8f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+9:2411:x1874622863748224:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787780027.684435:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787780027.684456:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006f2710ee/0xc8fc0a5179961684 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.31@tcp remote: 0xf757128131ea2157 expref: 9 pid: 9899 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780027.684471:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006f2710ee/0xc8fc0a5179961684 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.31@tcp remote: 0xf757128131ea2157 expref: 9 pid: 9899 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780027.684521:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006f2710ee/0xc8fc0a5179961684 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.31@tcp remote: 0xf757128131ea2157 expref: 9 pid: 9899 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780027.684536:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787780027.684541:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787780027.684546:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d29a67b2/0xc8fc0a51799616a7 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780027.686054:0:6497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d29a67b2/0xc8fc0a51799616a7 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780027.686104:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787780027.686168:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347fa8f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+8:2411:x1874622863748224:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 2462us (3113us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780027.686180:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 104 00010000:00010000:2.0:1787780027.686218:0:9899:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d29a67b2/0xc8fc0a51799616a7 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780027.686230:0:9899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d29a67b2/0xc8fc0a51799616a7 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780027.686255:0:9899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000d29a67b2/0xc8fc0a51799616a7 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780027.686274:0:9899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d29a67b2/0xc8fc0a51799616a7 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780027.686282:0:9899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d29a67b2/0xc8fc0a51799616a7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780027.686289:0:9899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0444c18800 already unused, calling callback (ffffffffc0d97420) 00010000:00010000:2.0:1787780027.686294:0:9899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d29a67b2/0xc8fc0a51799616a7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780027.686302:0:9899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d29a67b2/0xc8fc0a51799616a7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780027.686315:0:9899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d29a67b2/0xc8fc0a51799616a7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780027.686322:0:9899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d29a67b2/0xc8fc0a51799616a7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787780027.687018:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346eff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+7:2410:x1874622863748096:12345-192.168.203.31@tcp:1:lhsmtool_posix.0 Request processed in 13179us (13974us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780027.687028:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 77 00000100:00100000:1.0:1787780027.691361:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787780027.692436:0:12488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863748480 00000100:00100000:0.0:1787780027.692446:0:12488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863748480 00000100:00100000:0.0:1787780027.692512:0:12488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 247 00000100:00100000:0.0:1787780027.692532:0:12488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347fab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:781d29bb-23d2-48e3-b16d-c29e52cd5375+21:12520:x1874622863748480:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787780027.692610:0:12488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0481373a00/0xc8fc0a51799616ae lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780027.692625:0:12488:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868000/0xc8fc0a517996159d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea2103 expref: 21 pid: 12488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780027.692635:0:12488:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0481373a00/0xc8fc0a51799616ae lrc: 4/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780027.692676:0:12488:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868000/0xc8fc0a517996159d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea2103 expref: 21 pid: 12488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780027.692690:0:12488:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868000/0xc8fc0a517996159d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea2103 expref: 21 pid: 12488 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787780027.692713:0:12488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346effc00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12488:1874622881633664:192.168.203.31@tcp:104: 00000100:00100000:0.0:1787780027.692978:0:12488:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0347d456c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787780027.695948:0:12488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346effc00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12488:1874622881633664:192.168.203.31@tcp:104: 00010000:00010000:0.0:1787780027.695975:0:12488:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c0481373a00/0xc8fc0a51799616ae lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787780027.714533:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787780027.714647:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863748608 00000100:00100000:0.0:1787780027.714657:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863748608 00010000:00010000:0.0:1787780027.714711:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868000/0xc8fc0a517996159d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea2103 expref: 22 pid: 12488 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787780027.714755:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 105 00000100:00100000:0.0:1787780027.714784:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347fab0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+22:2410:x1874622863748608:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787780027.714801:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787780027.714808:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868000/0xc8fc0a517996159d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea2103 expref: 22 pid: 12488 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780027.714822:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868000/0xc8fc0a517996159d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea2103 expref: 22 pid: 12488 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780027.714899:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868000/0xc8fc0a517996159d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea2103 expref: 22 pid: 12488 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780027.714916:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c0443d81800) 00010000:00010000:0.0:1787780027.714922:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868200/0xc8fc0a51799615ff lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea2126 expref: 21 pid: 7821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780027.714933:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0481373a00/0xc8fc0a51799616ae lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780027.714941:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0481373a00/0xc8fc0a51799616ae lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780027.714948:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0481373a00/0xc8fc0a51799616ae lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780027.714972:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787780027.715030:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347fab0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+21:2410:x1874622863748608:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 248us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780027.715038:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 105 00010000:00010000:2.0:1787780027.715094:0:12488:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c0481373a00/0xc8fc0a51799616ae lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780027.715114:0:12488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0481373a00/0xc8fc0a51799616ae lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780027.715276:0:12488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18800/0xc8fc0a51799616b5 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780027.715289:0:12488:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dca00/0xc8fc0a5179961668 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea2142 expref: 21 pid: 7821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780027.715316:0:12488:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18800/0xc8fc0a51799616b5 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780027.715466:0:12488:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dca00/0xc8fc0a5179961668 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea2142 expref: 21 pid: 7821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780027.715480:0:12488:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dca00/0xc8fc0a5179961668 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea2142 expref: 21 pid: 7821 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787780027.715493:0:12488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047785fc00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12488:1874622881633792:192.168.203.31@tcp:104: 00000100:00100000:2.0:1787780027.715569:0:12488:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c045848b480 going to sleep for 11 seconds 00000100:00100000:2.0:1787780027.722310:0:12488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047785fc00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12488:1874622881633792:192.168.203.31@tcp:104: 00010000:00010000:2.0:1787780027.722351:0:12488:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18800/0xc8fc0a51799616b5 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787780027.722953:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787780027.723033:0:7921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863748736 00000100:00100000:1.0:1787780027.723041:0:7921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863748736 00010000:00010000:1.0:1787780027.723076:0:7921:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dca00/0xc8fc0a5179961668 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea2142 expref: 22 pid: 7821 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787780027.723114:0:7921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 106 00000100:00100000:1.0:1787780027.723124:0:7921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0345e74780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+22:2411:x1874622863748736:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787780027.723138:0:7921:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787780027.723145:0:7921:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dca00/0xc8fc0a5179961668 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea2142 expref: 22 pid: 7821 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780027.723157:0:7921:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dca00/0xc8fc0a5179961668 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea2142 expref: 22 pid: 7821 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780027.723177:0:7921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dca00/0xc8fc0a5179961668 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea2142 expref: 22 pid: 7821 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780027.723194:0:7921:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9c0443d81500) 00010000:00010000:1.0:1787780027.723198:0:7921:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18800/0xc8fc0a51799616b5 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780027.723225:0:7921:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18800/0xc8fc0a51799616b5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780027.723233:0:7921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18800/0xc8fc0a51799616b5 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780027.723258:0:7921:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787780027.723303:0:7921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0345e74780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+21:2411:x1874622863748736:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 180us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780027.723310:0:7921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 106 00010000:00010000:2.0:1787780027.723664:0:12488:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18800/0xc8fc0a51799616b5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780027.723673:0:12488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18800/0xc8fc0a51799616b5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787780027.723770:0:12488:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000001:00080000:2.0:1787780027.723913:0:12488:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000001:00080000:2.0:1787780027.723944:0:12488:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:2.0:1787780027.724002:0:12488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047785fc00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12488:1874622881633920:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1787780027.724041:0:12488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787780027.724063:0:12488:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c04428f7540 going to sleep for 11 seconds 00000100:00100000:0.0:1787780027.726190:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881633920 00000100:00100000:0.0:1787780027.726215:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881633920 00000100:00100000:0.0:1787780027.726271:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1787780027.726281:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c047785cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:12488:x1874622881633920:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1787780027.726477:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c047785cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:12488:x1874622881633920:12345-0@lo:1000:mdt00_004.0 Request processed in 198us (2435us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780027.726485:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1787780027.726683:0:12488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047785fc00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12488:1874622881633920:0@lo:1000:mdt00_004.0 00000001:00080000:2.0:1787780027.726811:0:12488:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00000100:00100000:2.0:1787780027.726910:0:12488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047785fc00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12488:1874622881634048:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1787780027.726944:0:12488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787780027.726967:0:12488:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c045848be40 going to sleep for 11 seconds 00000100:00100000:3.0:1787780027.727147:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881634048 00000100:00100000:3.0:1787780027.727152:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881634048 00000100:00100000:3.0:1787780027.727185:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1787780027.727193:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c047785e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:12488:x1874622881634048:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1787780027.727293:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c047785e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:12488:x1874622881634048:12345-0@lo:1000:mdt00_004.0 Request processed in 101us (348us total) trans 4294967324 rc 0/0 00000100:00100000:3.0:1787780027.727300:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1787780027.727383:0:12488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047785fc00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12488:1874622881634048:0@lo:1000:mdt00_004.0 00010000:00010000:2.0:1787780027.727413:0:12488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18800/0xc8fc0a51799616b5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780027.727422:0:12488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18800/0xc8fc0a51799616b5 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780027.727430:0:12488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18800/0xc8fc0a51799616b5 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780027.727435:0:12488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0444c18800 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:2.0:1787780027.727440:0:12488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18800/0xc8fc0a51799616b5 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780027.727448:0:12488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18800/0xc8fc0a51799616b5 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780027.727474:0:12488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9c0443d81500) 00010000:00010000:2.0:1787780027.727477:0:12488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787780027.727482:0:12488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18800/0xc8fc0a51799616b5 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780027.727488:0:12488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18800/0xc8fc0a51799616b5 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780027.727520:0:12488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868800/0xc8fc0a51799615f8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780027.727527:0:12488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868800/0xc8fc0a51799615f8 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780027.727533:0:12488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868800/0xc8fc0a51799615f8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780027.727538:0:12488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0477868800 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:2.0:1787780027.727540:0:12488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868800/0xc8fc0a51799615f8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780027.727546:0:12488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868800/0xc8fc0a51799615f8 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780027.727611:0:12488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c0443d81800) 00010000:00010000:2.0:1787780027.727613:0:12488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787780027.727619:0:12488:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868200/0xc8fc0a51799615ff lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea2126 expref: 24 pid: 7821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780027.727630:0:12488:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868200/0xc8fc0a51799615ff lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea2126 expref: 24 pid: 7821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780027.727646:0:12488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868200/0xc8fc0a51799615ff lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea2126 expref: 24 pid: 7821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780027.727670:0:12488:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868200/0xc8fc0a51799615ff lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea2126 expref: 24 pid: 7821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787780027.727682:0:12488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047785e580 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12488:1874622881634176:192.168.203.31@tcp:105: 00000100:00100000:2.0:1787780027.727737:0:12488:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c04537e03c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787780027.730892:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787780027.731078:0:12488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047785e580 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12488:1874622881634176:192.168.203.31@tcp:105: 00010000:00010000:2.0:1787780027.731104:0:12488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868800/0xc8fc0a51799615f8 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780027.731114:0:12488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868800/0xc8fc0a51799615f8 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780027.731144:0:12488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19400/0xc8fc0a51799616bc lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780027.731157:0:12488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19400/0xc8fc0a51799616bc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780027.731169:0:12488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19400/0xc8fc0a51799616bc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780027.731181:0:12488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19400/0xc8fc0a51799616bc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780027.731187:0:12488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19400/0xc8fc0a51799616bc lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780027.731207:0:12488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19400/0xc8fc0a51799616bc lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780027.731214:0:12488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0444c19400 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:2.0:1787780027.731219:0:12488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19400/0xc8fc0a51799616bc lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780027.731227:0:12488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19400/0xc8fc0a51799616bc lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780027.731239:0:12488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c0443d81800) 00010000:00010000:2.0:1787780027.731242:0:12488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787780027.731246:0:12488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19400/0xc8fc0a51799616bc lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780027.731252:0:12488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19400/0xc8fc0a51799616bc lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780027.731261:0:12488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0481373a00/0xc8fc0a51799616ae lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780027.731268:0:12488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0481373a00/0xc8fc0a51799616ae lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780027.731274:0:12488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0481373a00/0xc8fc0a51799616ae lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780027.731279:0:12488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0481373a00 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:2.0:1787780027.731283:0:12488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0481373a00/0xc8fc0a51799616ae lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780027.731302:0:12488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0481373a00/0xc8fc0a51799616ae lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780027.731312:0:12488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c0443d81800) 00010000:00010000:2.0:1787780027.731315:0:12488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787780027.731318:0:12488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0481373a00/0xc8fc0a51799616ae lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780027.731324:0:12488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0481373a00/0xc8fc0a51799616ae lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787780027.731472:0:12488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347fab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:781d29bb-23d2-48e3-b16d-c29e52cd5375+24:12520:x1874622863748480:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 Request processed in 38938us (40118us total) trans 4294967514 rc 0/0 00000100:00100000:2.0:1787780027.731482:0:12488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 247 00000020:00080000:2.0:1787780027.731487:0:12488:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1787780027.731633:0:13794:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787780027.731638:0:13794:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787780027.732137:0:13794:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1787780027.732144:0:13794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787780027.732335:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863748864 00000100:00100000:0.0:1787780027.732343:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863748864 00000100:00100000:0.0:1787780027.732386:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 61 00000100:00100000:0.0:1787780027.732394:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0345e75a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+24:12519:x1874622863748864:12345-192.168.203.31@tcp:49:lfs.0 00000100:00100000:0.0:1787780027.732477:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0345e75a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+24:12519:x1874622863748864:12345-192.168.203.31@tcp:49:lfs.0 Request processed in 84us (1642us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780027.732484:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 61 00000100:00100000:1.0:1787780027.735617:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787780027.735742:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863749120 00000100:00100000:0.0:1787780027.735750:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863749120 00000100:00100000:0.0:1787780027.735795:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 62 00000100:00100000:0.0:1787780027.735805:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c044361a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+24:12520:x1874622863749120:12345-192.168.203.31@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1787780027.736085:0:6516:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1787780027.736115:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967515 00010000:00010000:0.0:1787780027.736146:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0481373600/0xc8fc0a51799616c3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780027.736162:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0481373600/0xc8fc0a51799616c3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780027.736174:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0481373600/0xc8fc0a51799616c3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780027.736200:0:6516:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0481373600/0xc8fc0a51799616c3 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780027.736206:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0481373600/0xc8fc0a51799616c3 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780027.736211:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0481373600/0xc8fc0a51799616c3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780027.736228:0:6516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787780027.736306:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c044361a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+26:12520:x1874622863749120:12345-192.168.203.31@tcp:35:lhsmtool_posix.0 Request processed in 502us (697us total) trans 4294967516 rc 0/0 00000100:00100000:0.0:1787780027.736314:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 62 00000020:00080000:0.0:1787780027.736319:0:6516:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787780027.736721:0:7453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787780027.736739:0:7453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0481373600/0xc8fc0a51799616c3 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780027.736746:0:7453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0481373600 already unused, calling callback (ffffffffc0d97420) 00010000:00010000:3.0:1787780027.736750:0:7453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0481373600/0xc8fc0a51799616c3 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780027.736758:0:7453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0481373600/0xc8fc0a51799616c3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780027.736773:0:7453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9c0443d81500) 00010000:00010000:3.0:1787780027.736776:0:7453:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787780027.736781:0:7453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0481373600/0xc8fc0a51799616c3 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780027.736787:0:7453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0481373600/0xc8fc0a51799616c3 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780027.736800:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787780027.736803:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787780027.736804:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787780027.748749:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787780027.749766:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863749376 00000100:00100000:0.0:1787780027.749776:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863749376 00000100:00100000:0.0:1787780027.749902:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 248 00000100:00100000:0.0:1787780027.749950:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0345e75a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+26:12519:x1874622863749376:12345-192.168.203.31@tcp:58:lfs.0 00000040:00080000:0.0:1787780027.750106:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:0.0:1787780027.750195:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0345e75a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+26:12519:x1874622863749376:12345-192.168.203.31@tcp:58:lfs.0 Request processed in 284us (1465us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780027.750203:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 248 00000100:00100000:2.0:1787780027.799766:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787780027.799884:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863749504 00000100:00100000:0.0:1787780027.799892:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863749504 00000100:00100000:0.0:1787780027.799959:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 249 00000100:00100000:0.0:1787780027.799970:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c047785e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+26:12522:x1874622863749504:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:0.0:1787780027.799992:0:7821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787780027.800023:0:7821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0481372000/0xc8fc0a51799616ca lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea215e expref: -99 pid: 7821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780027.800085:0:7821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0481373c00/0xc8fc0a51799616d1 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780027.800099:0:7821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0481373c00/0xc8fc0a51799616d1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780027.800111:0:7821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0481373c00/0xc8fc0a51799616d1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780027.800126:0:7821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0481372600/0xc8fc0a51799616d8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780027.800134:0:7821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0481372600/0xc8fc0a51799616d8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780027.800140:0:7821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0481372600/0xc8fc0a51799616d8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780027.800203:0:7821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0481373400/0xc8fc0a51799616df lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780027.800214:0:7821:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc200/0xc8fc0a51799615ea lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea211f expref: 27 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780027.800223:0:7821:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0481373400/0xc8fc0a51799616df lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780027.800254:0:7821:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc200/0xc8fc0a51799615ea lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea211f expref: 27 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780027.800281:0:7821:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc200/0xc8fc0a51799615ea lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea211f expref: 27 pid: 6513 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787780027.800296:0:7821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346effc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7821:1874622881634304:192.168.203.31@tcp:104: 00000100:00100000:0.0:1787780027.800386:0:7821:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0347d45600 going to sleep for 11 seconds 00000100:00100000:0.0:1787780027.811105:0:7821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346effc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7821:1874622881634304:192.168.203.31@tcp:104: 00010000:00010000:0.0:1787780027.811136:0:7821:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c0481373400/0xc8fc0a51799616df lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787780027.815088:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787780027.815336:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863749760 00000100:00100000:0.0:1787780027.815345:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863749760 00000100:00100000:0.0:1787780027.815458:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 63 00000100:00100000:0.0:1787780027.815469:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c047785ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+28:6177:x1874622863749760:12345-192.168.203.31@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1787780027.815693:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c047785ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+29:6177:x1874622863749760:12345-192.168.203.31@tcp:35:ldlm_bl.0 Request processed in 226us (614us total) trans 4294967517 rc 0/0 00000100:00100000:0.0:1787780027.815702:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 63 00000100:00100000:3.0:1787780027.818476:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787780027.819204:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863749888 00000100:00100000:0.0:1787780027.819213:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863749888 00010000:00010000:0.0:1787780027.819252:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc200/0xc8fc0a51799615ea lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea211f expref: 29 pid: 6513 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787780027.819297:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 107 00000100:00100000:0.0:1787780027.819307:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04583bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+29:2411:x1874622863749888:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787780027.819320:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787780027.819348:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc200/0xc8fc0a51799615ea lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea211f expref: 29 pid: 6513 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780027.819361:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc200/0xc8fc0a51799615ea lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea211f expref: 29 pid: 6513 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780027.819382:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc200/0xc8fc0a51799615ea lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea211f expref: 29 pid: 6513 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780027.819398:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c0443d81800) 00010000:00010000:0.0:1787780027.819403:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0481373400/0xc8fc0a51799616df lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780027.819413:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0481373400/0xc8fc0a51799616df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780027.819420:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0481373400/0xc8fc0a51799616df lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780027.819448:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787780027.819506:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04583bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+28:2411:x1874622863749888:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 192us (1030us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780027.819514:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 107 00010000:00010000:2.0:1787780027.819652:0:7821:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c0481373400/0xc8fc0a51799616df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780027.819661:0:7821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0481373400/0xc8fc0a51799616df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787780027.819709:0:7821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1787780027.819714:0:7821:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787780027.819732:0:7821:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c0481373400/0xc8fc0a51799616df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780027.819756:0:7821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0481373400/0xc8fc0a51799616df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780027.819777:0:7821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0481373c00/0xc8fc0a51799616d1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780027.819783:0:7821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0481373c00/0xc8fc0a51799616d1 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780027.819790:0:7821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0481373c00/0xc8fc0a51799616d1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780027.819796:0:7821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0481373c00 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:2.0:1787780027.819800:0:7821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0481373c00/0xc8fc0a51799616d1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780027.819807:0:7821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0481373c00/0xc8fc0a51799616d1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780027.819816:0:7821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c04478d7d00) 00010000:00010000:2.0:1787780027.819818:0:7821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787780027.819822:0:7821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0481373c00/0xc8fc0a51799616d1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780027.819828:0:7821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0481373c00/0xc8fc0a51799616d1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780027.819886:0:7821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0481372600/0xc8fc0a51799616d8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780027.819893:0:7821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0481372600/0xc8fc0a51799616d8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780027.819898:0:7821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0481372600/0xc8fc0a51799616d8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780027.819909:0:7821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0481372600 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:2.0:1787780027.819912:0:7821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0481372600/0xc8fc0a51799616d8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780027.819919:0:7821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0481372600/0xc8fc0a51799616d8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780027.819929:0:7821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9c0347beca00) 00010000:00010000:2.0:1787780027.819931:0:7821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787780027.819934:0:7821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0481372600/0xc8fc0a51799616d8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780027.819940:0:7821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0481372600/0xc8fc0a51799616d8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780027.819972:0:7821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0481372000/0xc8fc0a51799616ca lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea215e expref: 28 pid: 7821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780027.819986:0:7821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0481373400/0xc8fc0a51799616df lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea215e expref: 27 pid: 7821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780027.819993:0:7821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c0443d81800) 00010000:00010000:2.0:1787780027.819995:0:7821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787780027.819997:0:7821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0481373400, rc 0) 00000100:00100000:2.0:1787780027.820023:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c047785e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+27:12522:x1874622863749504:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 20056us (20267us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780027.820030:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 249 00000100:00100000:1.0:1787780028.328186:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787780028.328236:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787780028.328267:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787780028.328285:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787780028.328308:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787780028.328335:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863750144 00000100:00100000:1.0:1787780028.328343:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863750144 00000100:00100000:1.0:1787780028.328402:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863750400 00000100:00100000:1.0:1787780028.328405:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863750400 00000100:00100000:1.0:1787780028.328426:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863750528 00000100:00100000:1.0:1787780028.328428:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863750528 00000100:00100000:1.0:1787780028.328444:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 389 00000100:00100000:1.0:1787780028.328454:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347faad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:2411:x1874622863750144:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1787780028.328549:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347faad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:2411:x1874622863750144:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 96us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780028.328557:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 389 00000100:00100000:1.0:1787780028.328576:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 390 00000100:00100000:1.0:1787780028.328581:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347fa8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+5:2411:x1874622863750400:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1787780028.328604:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347fa8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+5:2411:x1874622863750400:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 23us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780028.328610:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 390 00000100:00100000:1.0:1787780028.328619:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 391 00000100:00100000:1.0:1787780028.328625:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347faa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+5:2411:x1874622863750528:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1787780028.328646:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347faa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+5:2411:x1874622863750528:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 21us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780028.328651:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 391 00000100:00080000:1.0:1787780028.328670:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787780028.328675:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787780028.329594:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863750016 00000100:00100000:3.0:1787780028.329603:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863750016 00000100:00100000:3.0:1787780028.329648:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 401 00000100:00100000:3.0:1787780028.329657:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471774c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+13:2411:x1874622863750016:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1787780028.329693:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471774c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+13:2411:x1874622863750016:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 38us (1425us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780028.329701:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 401 00000100:00100000:3.0:1787780028.329740:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863750272 00000100:00100000:3.0:1787780028.329744:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863750272 00000100:00100000:3.0:1787780028.329782:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 169 00000100:00100000:3.0:1787780028.329788:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347fa9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:2411:x1874622863750272:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1787780028.329813:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347fa9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:2411:x1874622863750272:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 26us (1527us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780028.329821:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 169 00000100:00080000:3.0:1787780028.330437:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787780028.572128:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787780028.766006:0:13794:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787780028.766026:0:13794:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787780028.766052:0:13794:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1787780028.766062:0:13794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787780028.766997:0:13794:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047785f840 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13794:1874622881634432:192.168.203.31@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787780028.767099:0:13794:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c04537e0240 going to sleep for 11 seconds 00000040:00080000:0.0:1787780028.781379:0:14807:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787780028.781388:0:14807:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787780028.781417:0:14807:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1787780028.781425:0:14807:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787780028.785228:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787780028.785300:0:13794:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047785f840 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13794:1874622881634432:192.168.203.31@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787780028.786375:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863750656 00000100:00100000:0.0:1787780028.786383:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863750656 00000100:00100000:0.0:1787780028.786445:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 250 00000100:00100000:0.0:1787780028.786455:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347fa8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+27:12534:x1874622863750656:12345-192.168.203.31@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787780028.786499:0:6513:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787780028.786608:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347fa8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+27:12534:x1874622863750656:12345-192.168.203.31@tcp:53:lhsmtool_posix.0 Request processed in 154us (1387us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780028.786616:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 250 00000100:00100000:3.0:1787780028.793614:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787780028.793687:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863750912 00000100:00100000:1.0:1787780028.793697:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863750912 00000100:00100000:1.0:1787780028.793831:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 251 00000100:00100000:1.0:1787780028.793918:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0345e761c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+27:12534:x1874622863750912:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787780028.793939:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787780028.793960:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4b400/0xc8fc0a51799616e6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea2165 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780028.794079:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a200/0xc8fc0a51799616ed lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780028.794100:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a200/0xc8fc0a51799616ed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780028.794115:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a200/0xc8fc0a51799616ed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787780028.794127:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:1.0:1787780028.795593:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4b400/0xc8fc0a51799616e6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea2165 expref: 30 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780028.795614:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a200/0xc8fc0a51799616ed lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea2165 expref: 29 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780028.795624:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c0443d81800) 00010000:00010000:1.0:1787780028.795628:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787780028.795631:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0347e4a200, rc 0) 00000100:00100000:1.0:1787780028.795705:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0345e761c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+29:12534:x1874622863750912:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 1791us (2100us total) trans 4294967518 rc 0/0 00000100:00100000:1.0:1787780028.795715:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 251 00000100:00100000:0.0:1787780028.807432:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787780028.807476:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787780028.807525:0:12488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863751296 00000100:00100000:0.0:1787780028.807533:0:12488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863751296 00000100:00100000:0.0:1787780028.807581:0:12488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 252 00000100:00100000:0.0:1787780028.807591:0:12488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346efde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:781d29bb-23d2-48e3-b16d-c29e52cd5375+29:12534:x1874622863751296:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787780028.807664:0:12488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0481372c00/0xc8fc0a51799616fb lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780028.807682:0:12488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0481372c00/0xc8fc0a51799616fb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780028.807694:0:12488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0481372c00/0xc8fc0a51799616fb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780028.807904:0:12488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0481372c00/0xc8fc0a51799616fb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780028.807913:0:12488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0481372c00/0xc8fc0a51799616fb lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780028.807920:0:12488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0481372c00/0xc8fc0a51799616fb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780028.807944:0:12488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0481372c00 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:0.0:1787780028.807948:0:12488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0481372c00/0xc8fc0a51799616fb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780028.807957:0:12488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0481372c00/0xc8fc0a51799616fb lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780028.807972:0:12488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c0443d81800) 00010000:00010000:0.0:1787780028.807976:0:12488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787780028.807980:0:12488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0481372c00/0xc8fc0a51799616fb lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780028.807988:0:12488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0481372c00/0xc8fc0a51799616fb lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12488 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787780028.808107:0:12488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346efde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:781d29bb-23d2-48e3-b16d-c29e52cd5375+30:12534:x1874622863751296:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 Request processed in 516us (628us total) trans 4294967519 rc 0/0 00000100:00100000:0.0:1787780028.808116:0:12488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 252 00000100:00100000:3.0:1787780028.809009:0:7921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863751040 00000100:00100000:3.0:1787780028.809019:0:7921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863751040 00000100:00100000:3.0:1787780028.809179:0:7921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 18 00000100:00100000:3.0:1787780028.809189:0:7921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346efe940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+30:2410:x1874622863751040:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787780028.809204:0:7921:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787780028.809226:0:7921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a200/0xc8fc0a51799616ed lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea2165 expref: 30 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780028.809242:0:7921:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c0443d81800) 00010000:00010000:3.0:1787780028.809246:0:7921:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787780028.809432:0:7921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346efe940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+29:2410:x1874622863751040:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 243us (2008us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780028.809441:0:7921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 18 00000040:00080000:1.0:1787780028.809642:0:13794:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787780028.809647:0:13794:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787780028.810398:0:13794:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1787780028.810411:0:13794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787780028.811911:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787780028.811986:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863751552 00000100:00100000:3.0:1787780028.811995:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863751552 00000100:00100000:3.0:1787780028.812048:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 64 00000100:00100000:3.0:1787780028.812058:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346efcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+29:12534:x1874622863751552:12345-192.168.203.31@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787780028.812408:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346efcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+30:12534:x1874622863751552:12345-192.168.203.31@tcp:35:lhsmtool_posix.0 Request processed in 351us (500us total) trans 4294967520 rc 0/0 00000100:00100000:3.0:1787780028.812418:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 64 00000100:00100000:3.0:1787780029.212697:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347fab0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874622881634560:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787780029.212775:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780029.213055:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881634560 00000100:00100000:1.0:1787780029.213062:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881634560 00000100:00100000:1.0:1787780029.213133:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1787780029.213142:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0345e74780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1874622881634560:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787780029.213184:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1787780029.213237:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0345e74780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1874622881634560:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780029.213244:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1787780029.213357:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347fab0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874622881634560:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787780029.597694:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787780029.724360:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787780029.730700:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0458b89680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881634688:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787780029.730781:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780029.736227:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881634688 00000100:00100000:3.0:1787780029.736242:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881634688 00000100:00100000:3.0:1787780029.736430:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1787780029.736453:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347fab0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881634688:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787780029.736498:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787780029.736698:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347fab0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881634688:12345-0@lo:41:osp-pre-1-0.0 Request processed in 248us (5916us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780029.736706:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1787780029.736817:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0458b89680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881634688:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1787780030.620064:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787780030.828681:0:14858:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787780030.828691:0:14858:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787780030.829817:0:14858:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1787780030.829828:0:14858:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787780031.054726:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787780031.054762:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863751808 00000100:00100000:3.0:1787780031.054771:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863751808 00000100:00100000:3.0:1787780031.054864:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 253 00000100:00100000:3.0:1787780031.054875:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347ee3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+30:12555:x1874622863751808:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:3.0:1787780031.054900:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787780031.054921:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc600/0xc8fc0a5179961702 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea216c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780031.055024:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a5179961709 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780031.055040:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a5179961709 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780031.055064:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a5179961709 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787780031.055078:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:3.0:1787780031.055185:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc600/0xc8fc0a5179961702 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea216c expref: 33 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780031.055201:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a5179961709 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea216c expref: 32 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780031.055211:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c0443d81800) 00010000:00010000:3.0:1787780031.055214:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1787780031.055217:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c04766dc400, rc 0) 00000100:00100000:3.0:1787780031.055277:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347ee3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+32:12555:x1874622863751808:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 403us (558us total) trans 4294967521 rc 0/0 00000100:00100000:3.0:1787780031.055286:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 253 00000100:00080000:3.0:1787780031.055314:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787780031.060108:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787780031.060422:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863751936 00000100:00100000:2.0:1787780031.060432:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863751936 00000100:00100000:2.0:1787780031.060496:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 254 00000100:00100000:2.0:1787780031.060506:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346efd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+32:12555:x1874622863751936:12345-192.168.203.31@tcp:54:lfs.0 00010000:00010000:2.0:1787780031.060569:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18a00/0xc8fc0a5179961717 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780031.060585:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18a00/0xc8fc0a5179961717 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780031.060596:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18a00/0xc8fc0a5179961717 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780031.060630:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18a00/0xc8fc0a5179961717 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780031.060636:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18a00/0xc8fc0a5179961717 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780031.060660:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18a00/0xc8fc0a5179961717 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780031.060667:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0444c18a00 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:2.0:1787780031.060671:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18a00/0xc8fc0a5179961717 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780031.060679:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18a00/0xc8fc0a5179961717 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780031.060691:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c0443d81800) 00010000:00010000:2.0:1787780031.060694:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787780031.060698:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18a00/0xc8fc0a5179961717 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780031.060715:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c18a00/0xc8fc0a5179961717 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787780031.060785:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346efd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+32:12555:x1874622863751936:12345-192.168.203.31@tcp:54:lfs.0 Request processed in 280us (686us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780031.060792:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 254 00000100:00100000:3.0:1787780031.187236:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787780031.187544:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863752064 00000100:00100000:0.0:1787780031.187556:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863752064 00000100:00100000:0.0:1787780031.187638:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 78 00000100:00100000:0.0:1787780031.187648:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347ee1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+7:2408:x1874622863752064:12345-192.168.203.31@tcp:101:cat.0 00010000:00010000:0.0:1787780031.187664:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787780031.187684:0:8427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000026d60510/0xc8fc0a517996171e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea2173 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787780031.187728:0:8427:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 13, mtime: 0x6a8f5bbb, atime: 0x6a8f5bba, ctime: 0x6a8f5bbb, blocks: 0x8 00000100:00080000:3.0:1787780031.187740:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1787780031.187748:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=439s v=(0 0) 00010000:00010000:0.0:1787780031.187755:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787780031.187766:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000026d60510/0xc8fc0a517996171e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea2173 expref: 8 pid: 8427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780031.187787:0:8427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000026d60510/0xc8fc0a517996171e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea2173 expref: 8 pid: 8427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780031.187800:0:8427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0481372000, rc 0) 00000100:00100000:0.0:1787780031.187892:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347ee1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+8:2408:x1874622863752064:12345-192.168.203.31@tcp:101:cat.0 Request processed in 245us (665us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780031.187900:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 78 00000100:00100000:3.0:1787780031.197187:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787780031.197367:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863752192 00000100:00100000:0.0:1787780031.197378:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863752192 00002000:00100000:0.0:1787780031.197427:0:8435:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x6:0x0] (0->4095) req@ffff9c0347ee03c0 x1874622863752192/t0(0) o3->781d29bb-23d2-48e3-b16d-c29e52cd5375@192.168.203.31@tcp:442/0 lens 488/0 e 0 to 0 dl 1787780042 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787780031.197439:0:8435:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c0347ee03c0 with x1874622863752192 ext(0->4095) 00002000:00010000:0.0:1787780031.197445:0:8435:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c0347ee03c0 00000100:00100000:0.0:1787780031.197487:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 7 00000100:00100000:0.0:1787780031.197497:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347ee03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+8:2410:x1874622863752192:12345-192.168.203.31@tcp:3:cat.0 00000100:00100000:0.0:1787780031.197685:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347ee03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+8:2410:x1874622863752192:12345-192.168.203.31@tcp:3:cat.0 Request processed in 188us (506us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787780031.197703:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 7 00002000:00100000:0.0:1787780031.197719:0:8435:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x6:0x0] (0->4095) req@ffff9c0347ee03c0 x1874622863752192/t0(0) o3->781d29bb-23d2-48e3-b16d-c29e52cd5375@192.168.203.31@tcp:442/0 lens 488/4536 e 0 to 0 dl 1787780042 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787780031.197727:0:8435:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c0347ee03c0 with x1874622863752192 ext(0->4095) 00002000:00010000:0.0:1787780031.197730:0:8435:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c0347ee03c0 00010000:00010000:0.0:1787780031.644128:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787780031.772271:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346efe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874622881635072:0@lo:400:kworker.0 00000100:00100000:0.0:1787780031.772344:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787780031.772401:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346efe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1874622881635584:0@lo:400:kworker.0 00000100:00100000:0.0:1787780031.772428:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787780031.772465:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346eff840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1874622881636096:0@lo:400:kworker.0 00000100:00100000:0.0:1787780031.772499:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787780031.772526:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1787780031.772543:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346efc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1874622881634944:0@lo:400:kworker.0 00000100:00100000:0.0:1787780031.772566:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787780031.772581:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346efcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1874622881635456:0@lo:400:kworker.0 00000100:00100000:0.0:1787780031.772601:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787780031.772620:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346efc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1874622881635968:0@lo:400:kworker.0 00000100:00100000:0.0:1787780031.772640:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787780031.772671:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881635584 00000100:00100000:0.0:1787780031.772677:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881635584 00000100:00100000:0.0:1787780031.772720:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881636096 00000100:00100000:0.0:1787780031.772723:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881636096 00000100:00100000:0.0:1787780031.772739:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881634944 00000100:00100000:0.0:1787780031.772742:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881634944 00000100:00100000:0.0:1787780031.772773:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881635456 00000100:00100000:0.0:1787780031.772777:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881635456 00000100:00100000:0.0:1787780031.772789:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881635968 00000100:00100000:0.0:1787780031.772792:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881635968 00000100:00100000:0.0:1787780031.772806:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 392 00000100:00100000:0.0:1787780031.772812:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04778430c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1874622881635584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787780031.772888:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04778430c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1874622881635584:12345-0@lo:400:kworker.0 Request processed in 75us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780031.772895:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 392 00000100:00100000:0.0:1787780031.772913:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 393 00000100:00100000:0.0:1787780031.772918:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347e5ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1874622881636096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787780031.772942:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347e5ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1874622881636096:12345-0@lo:400:kworker.0 Request processed in 24us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780031.772947:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 393 00000100:00100000:0.0:1787780031.772957:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 394 00000100:00100000:0.0:1787780031.772962:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347e5b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1874622881634944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787780031.772986:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347e5b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1874622881634944:12345-0@lo:400:kworker.0 Request processed in 24us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780031.772992:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 394 00000100:00100000:0.0:1787780031.773002:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 395 00000100:00100000:0.0:1787780031.773007:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347e58b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1874622881635456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787780031.773030:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347e58b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1874622881635456:12345-0@lo:400:kworker.0 Request processed in 23us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780031.773036:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 395 00000100:00100000:0.0:1787780031.773049:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 396 00000100:00100000:0.0:1787780031.773055:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347e5a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1874622881635968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787780031.773093:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347e5a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1874622881635968:12345-0@lo:400:kworker.0 Request processed in 38us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780031.773099:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 396 00000100:00100000:0.0:1787780031.773139:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346efc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1874622881634944:0@lo:400:kworker.0 00000100:00100000:0.0:1787780031.773150:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346efcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1874622881635456:0@lo:400:kworker.0 00000100:00100000:0.0:1787780031.773158:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346efc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1874622881635968:0@lo:400:kworker.0 00010000:00080000:0.0:1787780031.773170:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0346efe580 x1874622881635584/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787780047 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787780031.773180:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346efe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1874622881635584:0@lo:400:kworker.0 00010000:00080000:0.0:1787780031.773189:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0346eff840 x1874622881636096/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787780047 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787780031.773196:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346eff840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1874622881636096:0@lo:400:kworker.0 00000100:00100000:2.0:1787780031.773778:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346eff0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1f575176-36bc-4786-83ee-2fea064a12a9:3644:1874622881634816:0@lo:400:kworker.0 00000100:00100000:2.0:1787780031.773824:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787780031.773889:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346efc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881635328:0@lo:400:kworker.0 00000100:00100000:2.0:1787780031.773914:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787780031.773932:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346effc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881635840:0@lo:400:kworker.0 00000100:00100000:2.0:1787780031.773969:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787780031.773984:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347e57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881636352:0@lo:400:kworker.0 00000100:00100000:2.0:1787780031.774019:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787780031.774041:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1787780031.774048:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346efed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874622881635200:0@lo:400:kworker.0 00000100:00100000:2.0:1787780031.774071:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787780031.774089:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346efda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881635712:0@lo:400:kworker.0 00000100:00100000:2.0:1787780031.774109:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787780031.774138:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347e54b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881636224:0@lo:400:kworker.0 00000100:00100000:0.0:1787780031.774327:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881634816 00000100:00100000:0.0:1787780031.774334:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881634816 00000100:00100000:0.0:1787780031.774371:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 402 00000100:00100000:0.0:1787780031.774378:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471775c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+24:3644:x1874622881634816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787780031.774412:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471775c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+24:3644:x1874622881634816:12345-0@lo:400:kworker.0 Request processed in 34us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780031.774418:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 402 00000100:00100000:2.0:1787780031.774556:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780031.774722:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881635072 00000100:00100000:3.0:1787780031.774727:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881635072 00000100:00100000:3.0:1787780031.774753:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881635328 00000100:00100000:3.0:1787780031.774756:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881635328 00000100:00100000:3.0:1787780031.774768:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1787780031.774774:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477842580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1874622881635072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787780031.774818:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477842580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1874622881635072:12345-0@lo:400:kworker.0 Request processed in 45us (2475us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780031.774834:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1787780031.774863:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1787780031.774869:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c047785c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881635328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787780031.774899:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c047785c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881635328:12345-0@lo:400:kworker.0 Request processed in 31us (985us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780031.774905:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1787780031.775391:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881635200 00000100:00100000:0.0:1787780031.775396:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881635200 00000100:00100000:0.0:1787780031.775425:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 397 00000100:00100000:0.0:1787780031.775431:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c047785f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1874622881635200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787780031.775507:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c047785f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1874622881635200:12345-0@lo:400:kworker.0 Request processed in 75us (1434us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780031.775513:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 397 00000100:00100000:2.0:1787780031.777132:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346eff0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1f575176-36bc-4786-83ee-2fea064a12a9:3644:1874622881634816:0@lo:400:kworker.0 00000100:00100000:2.0:1787780031.777272:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346efc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881635328:0@lo:400:kworker.0 00000100:00100000:2.0:1787780031.777302:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346efed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874622881635200:0@lo:400:kworker.0 00000100:00100000:3.0:1787780031.777903:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881635840 00000100:00100000:3.0:1787780031.777912:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881635840 00000100:00100000:3.0:1787780031.778052:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881636352 00000100:00100000:3.0:1787780031.778056:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881636352 00000100:00100000:3.0:1787780031.778073:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881635712 00000100:00100000:3.0:1787780031.778075:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881635712 00000100:00100000:3.0:1787780031.778376:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881636224 00000100:00100000:3.0:1787780031.778380:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881636224 00000100:00100000:3.0:1787780031.778398:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1787780031.778407:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c047785f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3644:x1874622881635840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787780031.779049:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1787780031.779061:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c047785da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3644:x1874622881636352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787780031.779268:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c047785f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3644:x1874622881635840:12345-0@lo:400:kworker.0 Request processed in 861us (5297us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780031.779304:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c047785da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3644:x1874622881636352:12345-0@lo:400:kworker.0 Request processed in 247us (5284us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780031.779312:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1787780031.779339:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1787780031.779346:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04779883c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881635712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787780031.779413:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1787780031.779433:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1787780031.779626:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477989680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881636224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787780031.779662:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477989680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881636224:12345-0@lo:400:kworker.0 Request processed in 41us (5107us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780031.779668:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00080000:0.0:1787780031.786304:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787780031.786315:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787780031.786319:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787780031.786322:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787780031.786560:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347e5a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881636480:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787780031.787293:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346efe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874622881635072:0@lo:400:kworker.0 00000100:00100000:1.0:1787780031.788631:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04779883c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881635712:12345-0@lo:400:kworker.0 Request processed in 9280us (14515us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780031.788645:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1787780031.789135:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347e54b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881636224:0@lo:400:kworker.0 00000100:00100000:2.0:1787780031.789153:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346effc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881635840:0@lo:400:kworker.0 00000100:00100000:2.0:1787780031.789165:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347e57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881636352:0@lo:400:kworker.0 00000100:00100000:2.0:1787780031.789423:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346efda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881635712:0@lo:400:kworker.0 00000100:00100000:0.0:1787780031.792716:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00080000:0.0:1787780031.793925:0:8423:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000100:00100000:2.0:1787780031.798085:0:8529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881636480 00000100:00100000:2.0:1787780031.798101:0:8529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881636480 00000100:00100000:3.0:1787780031.799203:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1787780031.799234:0:8529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347e5b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881636480:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787780031.799270:0:8529:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1787780031.799364:0:8529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347e5b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881636480:12345-0@lo:13:osp-pre-1-1.0 Request processed in 135us (6655us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780031.799372:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1787780031.799432:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347e5a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881636480:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787780032.285547:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000004:00080000:0.0:1787780032.285547:0:9898:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 440289705293ns, next at 441289702369ns, rc = 0 00000100:00100000:1.0:1787780032.285574:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347e5a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881636608:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787780032.285678:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780032.285816:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881636608 00000100:00100000:1.0:1787780032.285824:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881636608 00000100:00100000:0.0:1787780032.286051:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1787780032.286062:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347e58f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3641:x1874622881636608:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787780032.286078:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347ee1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881636736:0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787780032.286086:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1787780032.286114:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787780032.286212:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347e58f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3641:x1874622881636608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 151us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780032.286220:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1787780032.286283:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347e5a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881636608:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787780032.295402:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881636736 00000100:00100000:0.0:1787780032.295417:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881636736 00000100:00100000:0.0:1787780032.295461:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1787780032.295482:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347ee0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881636736:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787780032.295518:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787780032.295586:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347ee0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881636736:12345-0@lo:13:osp-pre-0-1.0 Request processed in 106us (9470us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780032.295610:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1787780032.298068:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347ee1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881636736:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1787780032.683076:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787780032.799426:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047798a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881636864:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787780032.799503:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787780032.800419:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881636864 00000100:00100000:0.0:1787780032.800427:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881636864 00000100:00100000:0.0:1787780032.800486:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1787780032.800497:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477988b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881636864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787780032.800521:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787780032.800578:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477988b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881636864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (1075us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780032.800585:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1787780032.800626:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:0.0:1787780032.800632:0:3644:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967310 committed transno 4294967311 00000004:00080000:0.0:1787780032.800651:0:3644:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c0345e76940, transno 4294967311 00000100:00100000:0.0:1787780032.800669:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047798a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881636864:0@lo:13:osp-pre-0-0.0 00000004:00080000:2.0:1787780032.801995:0:6491:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 10 committed 00000001:00080000:2.0:1787780032.802029:0:6491:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00000020:00080000:2.0:1787780032.802061:0:6491:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9c04428f7cc0 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:2.0:1787780032.802066:0:6491:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c0477af5500 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9c04428f7540 00000020:00080000:2.0:1787780032.802069:0:6491:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c0477af5700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9c0460244a00 00000020:00080000:2.0:1787780032.802085:0:6491:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00010000:00010000:2.0:1787780032.802104:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0481372e00/0xc8fc0a5179961699 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780032.802115:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0481372e00/0xc8fc0a5179961699 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780032.802123:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0481372e00/0xc8fc0a5179961699 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780032.802129:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0481372e00 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:2.0:1787780032.802134:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0481372e00/0xc8fc0a5179961699 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780032.802142:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0481372e00/0xc8fc0a5179961699 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780032.802156:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9c0443d81500) 00010000:00010000:2.0:1787780032.802159:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787780032.802164:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0481372e00/0xc8fc0a5179961699 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780032.802170:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0481372e00/0xc8fc0a5179961699 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1787780032.802197:0:6544:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:2.0:1787780032.802242:0:6544:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000100:00100000:0.0:1787780032.802589:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347e59680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881636992:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1787780032.802640:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787780032.802692:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881636992 00000100:00100000:0.0:1787780032.802698:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881636992 00000100:00100000:0.0:1787780032.802745:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787780032.802753:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347e5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3641:x1874622881636992:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1787780032.803133:0:8428:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1787780032.803137:0:8428:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb mtime from disk: 1787780027 -> 1787780027 00002000:00010000:0.0:1787780032.803140:0:8428:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb atime from disk: 1787780026 -> 1787780026 00002000:00010000:0.0:1787780032.803142:0:8428:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb ctime from disk: 1787780027 -> 1787780027 00002000:00010000:0.0:1787780032.803144:0:8428:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1787780032.803188:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347e5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3641:x1874622881636992:12345-0@lo:2:osp-syn-1-0.0 Request processed in 436us (548us total) trans 4294967325 rc 0/0 00000100:00100000:0.0:1787780032.803202:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000004:00080000:3.0:1787780032.803530:0:3641:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c0347e59680/2, rc 0, transno 4294967325 00000100:00100000:3.0:1787780032.803538:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347e59680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881636992:0@lo:2:osp-syn-1-0.0 00000001:00080000:3.0:1787780032.804254:0:9508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000001:00080000:3.0:1787780032.804263:0:9508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00000100:00100000:1.0:1787780033.440982:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787780033.441026:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787780033.441076:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787780033.441106:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787780033.441122:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787780033.441156:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787780033.441198:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787780033.441225:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863752832 00000100:00100000:1.0:1787780033.441232:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863752832 00000100:00100000:1.0:1787780033.441288:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863752704 00000100:00100000:1.0:1787780033.441291:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863752704 00000100:00100000:3.0:1787780033.441297:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 174 00000100:00100000:3.0:1787780033.441312:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0461bee580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+7:2411:x1874622863752832:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1787780033.441322:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 175 00000100:00100000:1.0:1787780033.441332:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0461bede00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:2411:x1874622863752704:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1787780033.441412:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863752576 00000100:00100000:2.0:1787780033.441423:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863752576 00000100:00100000:2.0:1787780033.441452:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863753088 00000100:00100000:2.0:1787780033.441454:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863753088 00000100:00100000:2.0:1787780033.441479:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863752448 00000100:00100000:2.0:1787780033.441481:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863752448 00000100:00100000:2.0:1787780033.441491:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863752960 00000100:00100000:2.0:1787780033.441493:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863752960 00000100:00100000:2.0:1787780033.441505:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 398 00000100:00100000:2.0:1787780033.441511:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0461bef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:2411:x1874622863752576:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1787780033.441570:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0461bede00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:2411:x1874622863752704:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 239us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780033.441578:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 175 00000100:00100000:0.0:1787780033.441707:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863752320 00000100:00100000:0.0:1787780033.441712:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863752320 00000100:00100000:0.0:1787780033.441746:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 403 00000100:00100000:0.0:1787780033.441754:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471774050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+13:2411:x1874622863752320:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1787780033.445184:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0461bee580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+7:2411:x1874622863752832:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 3862us (4092us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780033.445184:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0461bef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:2411:x1874622863752576:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 3658us (4143us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780033.445208:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 398 00000100:00100000:3.0:1787780033.445209:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 174 00000100:00100000:2.0:1787780033.445255:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 399 00000100:00100000:2.0:1787780033.445270:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0461beda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+5:2411:x1874622863753088:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1787780033.445283:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 400 00000100:00100000:3.0:1787780033.445293:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0461bec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+18:2411:x1874622863752448:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1787780033.445328:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0461beda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+5:2411:x1874622863753088:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 63us (4219us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780033.445336:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0461bec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+18:2411:x1874622863752448:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 44us (4211us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780033.445340:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 399 00000100:00100000:3.0:1787780033.445350:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 400 00000100:00100000:2.0:1787780033.445363:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 401 00000100:00100000:2.0:1787780033.445374:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0461bee940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+5:2411:x1874622863752960:12345-192.168.203.31@tcp:400:kworker.0 00000100:00080000:3.0:1787780033.445395:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787780033.445402:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787780033.445403:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0461bee940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+5:2411:x1874622863752960:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 30us (4202us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780033.445410:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 401 00000100:00080000:3.0:1787780033.445422:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787780033.445426:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787780033.450833:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471774050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+13:2411:x1874622863752320:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 9066us (9848us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780033.450870:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 403 00010000:00010000:3.0:1787780033.692311:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787780033.757552:0:13797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1787780033.948035:0:13794:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787780033.948043:0:13794:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787780033.948062:0:13794:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1787780033.948069:0:13794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787780034.333474:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787780034.333499:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0461bed680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881637120:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787780034.333572:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780034.333865:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881637120 00000100:00100000:1.0:1787780034.333874:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881637120 00000100:00100000:1.0:1787780034.333924:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1787780034.333933:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347ee1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881637120:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787780034.333966:0:14310:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1787780034.334021:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347ee1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881637120:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780034.334028:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1787780034.334159:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0461bed680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881637120:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787780034.718097:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787780034.844383:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787780034.844406:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347ee2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881637248:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787780034.844486:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780034.846626:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881637248 00000100:00100000:3.0:1787780034.846638:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881637248 00000100:00100000:3.0:1787780034.846748:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1787780034.846758:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347e58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881637248:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787780034.846867:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787780034.849903:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347e58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881637248:12345-0@lo:41:osp-pre-1-0.0 Request processed in 3137us (5406us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780034.849919:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1787780034.850235:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347ee2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881637248:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787780035.740130:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787780036.755296:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787780036.755457:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863753216 00000100:00100000:0.0:1787780036.755466:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863753216 00000100:00100000:0.0:1787780036.755536:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 255 00000100:00100000:0.0:1787780036.755547:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347ee30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+18:12200:x1874622863753216:12345-192.168.203.31@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1787780036.755652:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347ee30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+18:12200:x1874622863753216:12345-192.168.203.31@tcp:60:lhsmtool_posix.0 Request processed in 106us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780036.755660:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 255 00000100:00080000:3.0:1787780036.755753:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787780036.758752:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787780036.761605:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863753344 00000100:00100000:2.0:1787780036.761621:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863753344 00000100:00100000:2.0:1787780036.761713:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 256 00000100:00100000:2.0:1787780036.761725:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347ee1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:12200:x1874622863753344:12345-192.168.203.31@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1787780036.761857:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347ee1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:12200:x1874622863753344:12345-192.168.203.31@tcp:60:lhsmtool_posix.0 Request processed in 135us (3114us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780036.761864:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 256 00000100:00080000:3.0:1787780036.762117:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1787780036.769172:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787780036.769306:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787780036.769380:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863753600 00000100:00100000:3.0:1787780036.769390:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863753600 00000100:00100000:3.0:1787780036.769464:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 65 00000100:00100000:3.0:1787780036.769475:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347e592c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+18:12200:x1874622863753600:12345-192.168.203.31@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787780036.769765:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347e592c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+19:12200:x1874622863753600:12345-192.168.203.31@tcp:35:lhsmtool_posix.0 Request processed in 291us (464us total) trans 4294967522 rc 0/0 00000100:00100000:3.0:1787780036.769774:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 65 00000100:00100000:2.0:1787780036.892167:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347e58780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881637376:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787780036.892241:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787780036.892372:0:8529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881637376 00000100:00100000:0.0:1787780036.892380:0:8529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881637376 00000100:00080000:2.0:1787780036.892543:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787780036.892672:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1787780036.892683:0:8529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c047798b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881637376:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787780036.892731:0:8529:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1787780036.892781:0:8529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c047798b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881637376:12345-0@lo:13:osp-pre-1-1.0 Request processed in 100us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780036.892789:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1787780036.892834:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347e58780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881637376:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787780036.898858:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0461bec780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874622881637888:0@lo:400:kworker.0 00000100:00100000:1.0:1787780036.898946:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780036.898989:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477aed680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881638400:0@lo:400:kworker.0 00000100:00100000:1.0:1787780036.899015:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780036.899034:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477aede00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881638912:0@lo:400:kworker.0 00000100:00100000:1.0:1787780036.899053:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780036.899075:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1787780036.899081:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0461beed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881637760:0@lo:400:kworker.0 00000100:00100000:1.0:1787780036.899104:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780036.899120:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0461bed680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1874622881638272:0@lo:400:kworker.0 00000100:00100000:1.0:1787780036.899140:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780036.899162:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477aed2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1874622881638784:0@lo:400:kworker.0 00000100:00100000:1.0:1787780036.899182:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780036.899219:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881638400 00000100:00100000:1.0:1787780036.899226:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881638400 00000100:00100000:1.0:1787780036.899276:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881638912 00000100:00100000:1.0:1787780036.899279:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881638912 00000100:00100000:1.0:1787780036.899307:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1787780036.899316:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477aef840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881638400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787780036.899365:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477aef840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881638400:12345-0@lo:400:kworker.0 Request processed in 50us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780036.899372:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1787780036.899389:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1787780036.899395:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477aeda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3644:x1874622881638912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787780036.899495:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477aeda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3644:x1874622881638912:12345-0@lo:400:kworker.0 Request processed in 29us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780036.899502:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1787780036.899533:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881637760 00000100:00100000:1.0:1787780036.899538:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881637760 00000100:00100000:1.0:1787780036.899561:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1787780036.899568:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477aefc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881637760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787780036.899602:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477aefc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881637760:12345-0@lo:400:kworker.0 Request processed in 35us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780036.899609:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1787780036.899626:0:12488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881637888 00000100:00100000:1.0:1787780036.899629:0:12488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881637888 00000100:00100000:1.0:1787780036.899651:0:12488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881638272 00000100:00100000:1.0:1787780036.899655:0:12488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881638272 00000100:00100000:1.0:1787780036.899672:0:12488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881638784 00000100:00100000:1.0:1787780036.899675:0:12488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881638784 00000100:00100000:1.0:1787780036.899689:0:12488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 402 00000100:00100000:1.0:1787780036.899695:0:12488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477aecb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1874622881637888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787780036.899725:0:12488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477aecb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1874622881637888:12345-0@lo:400:kworker.0 Request processed in 30us (780us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780036.899731:0:12488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 402 00000100:00100000:1.0:1787780036.899744:0:12488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 403 00000100:00100000:1.0:1787780036.899750:0:12488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477aee1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874622881638272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787780036.899776:0:12488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477aee1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874622881638272:12345-0@lo:400:kworker.0 Request processed in 26us (635us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780036.899781:0:12488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 403 00000100:00100000:1.0:1787780036.899792:0:12488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 404 00000100:00100000:1.0:1787780036.899797:0:12488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477aecf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1874622881638784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787780036.899822:0:12488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477aecf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1874622881638784:12345-0@lo:400:kworker.0 Request processed in 25us (639us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780036.899872:0:12488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 404 00000100:00080000:1.0:1787780036.899898:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787780036.899902:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787780036.899904:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787780036.899938:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0461beed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881637760:0@lo:400:kworker.0 00010000:00080000:1.0:1787780036.899953:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0461bed680 x1874622881638272/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787780052 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787780036.899964:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0461bed680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1874622881638272:0@lo:400:kworker.0 00010000:00080000:1.0:1787780036.899974:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0477aed2c0 x1874622881638784/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787780052 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787780036.899982:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477aed2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1874622881638784:0@lo:400:kworker.0 00000100:00100000:1.0:1787780036.899992:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0461bec780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874622881637888:0@lo:400:kworker.0 00000100:00100000:1.0:1787780036.900000:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477aed680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881638400:0@lo:400:kworker.0 00000100:00100000:1.0:1787780036.900007:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:1.0:1787780036.900011:0:3644:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c0347fa9680, transno 4294967322 00000004:00080000:1.0:1787780036.900019:0:3644:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:1.0:1787780036.900040:0:3644:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9c0347e59680 x1874622881636992/t4294967325(4294967325) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1787780048 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787780036.900048:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477aede00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881638912:0@lo:400:kworker.0 00000100:00100000:3.0:1787780036.900561:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0461becf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1f575176-36bc-4786-83ee-2fea064a12a9:3641:1874622881637504:0@lo:400:kworker.0 00000100:00100000:3.0:1787780036.900607:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780036.900641:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0461befc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881638016:0@lo:400:kworker.0 00000100:00100000:3.0:1787780036.900665:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780036.900682:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477aec3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881638528:0@lo:400:kworker.0 00000100:00100000:3.0:1787780036.900702:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780036.900719:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1787780036.900725:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0461becb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874622881637632:0@lo:400:kworker.0 00000100:00100000:3.0:1787780036.900743:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780036.900760:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0461bed2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1874622881638144:0@lo:400:kworker.0 00000100:00100000:3.0:1787780036.900778:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780036.900792:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477aec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1874622881638656:0@lo:400:kworker.0 00000100:00100000:3.0:1787780036.900809:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780036.900834:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881637632 00000100:00100000:3.0:1787780036.900860:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881637632 00000100:00100000:3.0:1787780036.900887:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881638144 00000100:00100000:3.0:1787780036.900890:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881638144 00000100:00100000:3.0:1787780036.900910:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881638656 00000100:00100000:3.0:1787780036.900913:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881638656 00000100:00100000:3.0:1787780036.900929:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 405 00000100:00100000:3.0:1787780036.900935:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347ee3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874622881637632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787780036.900977:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347ee3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874622881637632:12345-0@lo:400:kworker.0 Request processed in 42us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780036.900983:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 405 00000100:00100000:3.0:1787780036.900998:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 406 00000100:00100000:3.0:1787780036.901004:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347ee2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874622881638144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787780036.901031:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347ee2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874622881638144:12345-0@lo:400:kworker.0 Request processed in 28us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780036.901045:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 406 00000100:00100000:3.0:1787780036.901058:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 407 00000100:00100000:3.0:1787780036.901063:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347ee0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1874622881638656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787780036.901092:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347ee0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1874622881638656:12345-0@lo:400:kworker.0 Request processed in 29us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780036.901098:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 407 00000100:00100000:3.0:1787780036.901118:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881638016 00000100:00100000:3.0:1787780036.901122:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881638016 00000100:00100000:3.0:1787780036.901144:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1787780036.901151:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347ee12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874622881638016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787780036.901181:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347ee12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874622881638016:12345-0@lo:400:kworker.0 Request processed in 31us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780036.901187:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00080000:3.0:1787780036.901202:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787780036.901232:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0461becb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874622881637632:0@lo:400:kworker.0 00000100:00100000:3.0:1787780036.901242:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0461bed2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1874622881638144:0@lo:400:kworker.0 00000100:00100000:3.0:1787780036.901251:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477aec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1874622881638656:0@lo:400:kworker.0 00000100:00100000:3.0:1787780036.901260:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0461befc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881638016:0@lo:400:kworker.0 00000100:00100000:1.0:1787780036.902884:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881637504 00000100:00100000:1.0:1787780036.902895:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881637504 00000100:00100000:1.0:1787780036.902954:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 404 00000100:00100000:1.0:1787780036.902962:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471776450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+24:3641:x1874622881637504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787780036.903053:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471776450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f575176-36bc-4786-83ee-2fea064a12a9+24:3641:x1874622881637504:12345-0@lo:400:kworker.0 Request processed in 92us (2445us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780036.903062:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 404 00000100:00100000:1.0:1787780036.903103:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881638528 00000100:00100000:1.0:1787780036.903107:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881638528 00000100:00100000:1.0:1787780036.903147:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1787780036.903154:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347ee21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874622881638528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787780036.903188:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347ee21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874622881638528:12345-0@lo:400:kworker.0 Request processed in 35us (2485us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780036.903194:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00080000:3.0:1787780036.907213:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787780036.907269:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0461becf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1f575176-36bc-4786-83ee-2fea064a12a9:3641:1874622881637504:0@lo:400:kworker.0 00000100:00100000:3.0:1787780036.907290:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477aec3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881638528:0@lo:400:kworker.0 00000100:00100000:1.0:1787780037.116802:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787780037.117021:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863753728 00000100:00100000:3.0:1787780037.117031:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863753728 00000100:00100000:3.0:1787780037.117125:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 257 00000100:00100000:3.0:1787780037.117134:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477aede00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+5:13012:x1874622863753728:12345-192.168.203.31@tcp:101:lsof.0 00010000:00010000:3.0:1787780037.117155:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787780037.117176:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc600/0xc8fc0a5179961725 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea217a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780037.117240:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc200/0xc8fc0a517996172c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780037.117254:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc200/0xc8fc0a517996172c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780037.117266:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc200/0xc8fc0a517996172c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787780037.117313:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787780037.117317:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787780037.117339:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc200/0xc8fc0a517996172c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780037.117364:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc600/0xc8fc0a5179961725 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea217a expref: 7 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780037.117380:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc200/0xc8fc0a517996172c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea217a expref: 6 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780037.117388:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c0443d81000) 00010000:00010000:3.0:1787780037.117391:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787780037.117394:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c04766dc200, rc 0) 00000100:00080000:0.0:1787780037.117559:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787780037.117633:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477aede00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+6:13012:x1874622863753728:12345-192.168.203.31@tcp:101:lsof.0 Request processed in 499us (841us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780037.117647:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 257 00000100:00100000:1.0:1787780037.404241:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787780037.404275:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347e58780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881639040:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787780037.404364:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787780037.404615:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881639040 00000100:00100000:0.0:1787780037.404624:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881639040 00000100:00100000:0.0:1787780037.404674:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1787780037.404683:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477aed680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3642:x1874622881639040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787780037.404705:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1787780037.404758:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477aed680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3642:x1874622881639040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780037.404765:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1787780037.405106:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787780037.405117:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04779892c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881639168:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787780037.405148:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787780037.405224:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881639168 00000100:00100000:2.0:1787780037.405229:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881639168 00000100:00100000:2.0:1787780037.405267:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1787780037.405274:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347ee0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881639168:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787780037.405294:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787780037.405340:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347ee0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881639168:12345-0@lo:13:osp-pre-0-1.0 Request processed in 66us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780037.405356:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1787780037.405632:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04779892c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881639168:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787780037.405764:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347e58780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881639040:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787780037.789137:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787780037.917009:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047798b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881639296:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787780037.917082:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787780037.917252:0:8529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881639296 00000100:00100000:2.0:1787780037.917261:0:8529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881639296 00000100:00100000:2.0:1787780037.917316:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1787780037.917324:0:8529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347ee0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881639296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787780037.917346:0:8529:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787780037.917396:0:8529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347ee0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881639296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780037.917402:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1787780037.918653:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047798b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881639296:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787780038.555365:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787780038.555591:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863753856 00000100:00100000:1.0:1787780038.555600:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863753856 00000100:00100000:1.0:1787780038.555664:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 405 00000100:00100000:1.0:1787780038.555674:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471772050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+13:2410:x1874622863753856:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1787780038.555749:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471772050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+13:2410:x1874622863753856:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 76us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780038.555758:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 405 00000100:00100000:2.0:1787780038.558701:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787780038.558744:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787780038.559014:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863754112 00000100:00100000:3.0:1787780038.559023:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863754112 00000100:00100000:3.0:1787780038.559102:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863753984 00000100:00100000:3.0:1787780038.559106:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863753984 00000100:00100000:3.0:1787780038.559135:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 408 00000100:00100000:3.0:1787780038.559146:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477988000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:2410:x1874622863754112:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1787780038.559310:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477988000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:2410:x1874622863754112:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 166us (618us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780038.559318:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 408 00000100:00100000:3.0:1787780038.559349:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 409 00000100:00100000:3.0:1787780038.559358:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c047798a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+19:2410:x1874622863753984:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1787780038.559390:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c047798a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+19:2410:x1874622863753984:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 35us (646us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780038.559397:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 409 00000100:00080000:0.0:1787780038.559765:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787780038.559770:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787780038.560593:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787780038.560629:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787780038.560690:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787780038.560901:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787780038.560927:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863754496 00000100:00100000:3.0:1787780038.560934:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863754496 00000100:00100000:3.0:1787780038.560972:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863754624 00000100:00100000:3.0:1787780038.560975:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863754624 00000100:00100000:3.0:1787780038.561001:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 410 00000100:00100000:3.0:1787780038.561009:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0458b89680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+6:2411:x1874622863754496:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1787780038.561063:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0458b89680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+6:2411:x1874622863754496:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 54us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780038.561071:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 410 00000100:00100000:3.0:1787780038.561086:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 411 00000100:00100000:3.0:1787780038.561092:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347fe92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+5:2411:x1874622863754624:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1787780038.561115:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347fe92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+5:2411:x1874622863754624:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 23us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780038.561120:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 411 00000100:00080000:0.0:1787780038.561500:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787780038.566351:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863754240 00000100:00100000:2.0:1787780038.566366:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863754240 00000100:00100000:2.0:1787780038.566463:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863754368 00000100:00100000:2.0:1787780038.566467:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863754368 00000100:00100000:3.0:1787780038.566665:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 179 00000100:00100000:3.0:1787780038.566678:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347ee2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:2411:x1874622863754240:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1787780038.566758:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347ee2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:2411:x1874622863754240:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 84us (6168us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780038.566767:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 179 00000100:00080000:0.0:1787780038.567264:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787780038.567620:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 180 00000100:00100000:2.0:1787780038.567629:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347fe8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+7:2411:x1874622863754368:12345-192.168.203.31@tcp:400:kworker.0 00000100:00080000:0.0:1787780038.567740:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787780038.571871:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347fe8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+7:2411:x1874622863754368:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 4229us (11166us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780038.571888:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 180 00010000:00010000:2.0:1787780038.816296:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787780038.942785:0:9508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967325 is committed 00000001:00080000:2.0:1787780038.943022:0:6491:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967522 is committed 00000020:00080000:2.0:1787780038.943029:0:6491:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:3.0:1787780038.943080:0:6544:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:3.0:1787780038.943089:0:6544:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000100:00100000:1.0:1787780039.452372:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787780039.452395:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477aed2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881639424:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787780039.452472:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780039.452582:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881639424 00000100:00100000:1.0:1787780039.452588:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881639424 00000100:00100000:1.0:1787780039.452649:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1787780039.452658:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477aec780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881639424:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787780039.452688:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1787780039.452736:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477aec780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881639424:12345-0@lo:41:osp-pre-0-1.0 Request processed in 80us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780039.452750:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1787780039.452798:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477aed2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881639424:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1787780039.842364:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787780039.966332:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347fe83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881639552:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787780039.966403:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787780039.978965:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881639552 00000100:00100000:2.0:1787780039.978981:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881639552 00000100:00100000:2.0:1787780039.979057:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1787780039.979068:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347e59e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874622881639552:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787780039.979107:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787780039.979195:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347e59e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874622881639552:12345-0@lo:41:osp-pre-1-0.0 Request processed in 129us (12790us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780039.979202:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1787780039.979408:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347fe83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881639552:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1787780040.861126:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787780040.991990:0:15057:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 17:34:00 (1787780040) 00010000:00010000:2.0:1787780041.884713:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787780042.012111:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787780042.012135:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347e5bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881639680:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787780042.012208:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787780042.012418:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881639680 00000100:00100000:0.0:1787780042.012426:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881639680 00000100:00100000:0.0:1787780042.012502:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1787780042.012512:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347fead00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881639680:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787780042.012539:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1787780042.012586:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347fead00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881639680:12345-0@lo:13:osp-pre-1-1.0 Request processed in 76us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780042.012592:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1787780042.012641:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347e5bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881639680:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1787780042.012784:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787780042.015776:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347e583c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874622881639936:0@lo:400:kworker.0 00000100:00100000:0.0:1787780042.015858:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347e5a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881640064:0@lo:400:kworker.0 00000100:00100000:2.0:1787780042.015876:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787780042.015903:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787780042.015929:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477841a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1874622881640576:0@lo:400:kworker.0 00000100:00100000:2.0:1787780042.015934:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0345e76940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1874622881640448:0@lo:400:kworker.0 00000100:00100000:0.0:1787780042.015961:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787780042.015982:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881639936 00000100:00100000:2.0:1787780042.015990:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881639936 00000100:00100000:0.0:1787780042.016010:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346efed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1874622881641088:0@lo:400:kworker.0 00000100:00100000:0.0:1787780042.016039:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787780042.016053:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881640576 00000100:00100000:2.0:1787780042.016058:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881640576 00000100:00100000:0.0:1787780042.016072:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1787780042.016080:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347e58780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874622881640192:0@lo:400:kworker.0 00000100:00100000:2.0:1787780042.016100:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881641088 00000100:00100000:2.0:1787780042.016105:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881641088 00000100:00100000:0.0:1787780042.016105:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787780042.016124:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346efda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881640704:0@lo:400:kworker.0 00000100:00100000:2.0:1787780042.016127:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881640192 00000100:00100000:2.0:1787780042.016132:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881640192 00000100:00100000:2.0:1787780042.016155:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 412 00000100:00100000:0.0:1787780042.016155:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787780042.016169:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477988f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874622881639936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787780042.016180:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346efc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881641216:0@lo:400:kworker.0 00000100:00100000:0.0:1787780042.016204:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787780042.016242:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477988f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874622881639936:12345-0@lo:400:kworker.0 Request processed in 71us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780042.016243:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 413 00000100:00100000:2.0:1787780042.016254:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 412 00000100:00100000:0.0:1787780042.016258:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346eff840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1874622881640576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787780042.016279:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 414 00000100:00100000:2.0:1787780042.016288:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346efe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1874622881641088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787780042.016302:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346eff840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1874622881640576:12345-0@lo:400:kworker.0 Request processed in 49us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780042.016320:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 413 00000100:00100000:2.0:1787780042.016337:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346efe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1874622881641088:12345-0@lo:400:kworker.0 Request processed in 49us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780042.016342:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 415 00000100:00100000:2.0:1787780042.016350:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 414 00000100:00100000:0.0:1787780042.016355:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346efc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874622881640192:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787780042.016378:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787780042.016404:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346efc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874622881640192:12345-0@lo:400:kworker.0 Request processed in 44us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780042.016411:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 415 00000100:00100000:0.0:1787780042.016438:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881640704 00000100:00100000:0.0:1787780042.016442:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881640704 00000100:00100000:0.0:1787780042.016480:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881641216 00000100:00100000:0.0:1787780042.016483:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881641216 00000100:00100000:0.0:1787780042.016505:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1787780042.016511:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346efcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881640704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787780042.016542:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346efcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881640704:12345-0@lo:400:kworker.0 Request processed in 31us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780042.016547:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1787780042.016560:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1787780042.016565:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346efc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874622881641216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787780042.016591:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346efc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874622881641216:12345-0@lo:400:kworker.0 Request processed in 26us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780042.016596:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1787780042.016621:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787780042.016639:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346efe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1874622881640960:0@lo:400:kworker.0 00000100:00100000:0.0:1787780042.016661:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787780042.016692:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347e583c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874622881639936:0@lo:400:kworker.0 00000100:00100000:0.0:1787780042.016710:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1787780042.016736:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347e5bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1f575176-36bc-4786-83ee-2fea064a12a9:3644:1874622881639808:0@lo:400:kworker.0 00000100:00100000:0.0:1787780042.016767:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787780042.016791:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347fa9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881640320:0@lo:400:kworker.0 00000100:00100000:0.0:1787780042.016812:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787780042.016827:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346effc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881640832:0@lo:400:kworker.0 00000100:00100000:0.0:1787780042.016871:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787780042.016891:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787780042.016895:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787780042.016904:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881639808 00000100:00100000:0.0:1787780042.016909:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881639808 00000100:00100000:0.0:1787780042.016946:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 406 00000100:00100000:0.0:1787780042.016953:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471770450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+24:3644:x1874622881639808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787780042.016993:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471770450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+24:3644:x1874622881639808:12345-0@lo:400:kworker.0 Request processed in 41us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780042.016999:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 406 00000100:00100000:0.0:1787780042.017027:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881640064 00000100:00100000:0.0:1787780042.017031:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881640064 00000100:00100000:2.0:1787780042.017042:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347e5bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1f575176-36bc-4786-83ee-2fea064a12a9:3644:1874622881639808:0@lo:400:kworker.0 00000100:00100000:0.0:1787780042.017059:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881640320 00000100:00100000:0.0:1787780042.017064:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881640320 00000100:00100000:0.0:1787780042.017079:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1787780042.017085:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346eff0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881640064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787780042.017116:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346eff0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881640064:12345-0@lo:400:kworker.0 Request processed in 31us (1214us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780042.017122:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1787780042.017134:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1787780042.017140:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0348836940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881640320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787780042.017178:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0348836940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881640320:12345-0@lo:400:kworker.0 Request processed in 37us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780042.017194:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1787780042.017212:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881640448 00000100:00100000:0.0:1787780042.017215:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881640448 00000100:00100000:0.0:1787780042.017242:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881640960 00000100:00100000:0.0:1787780042.017246:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881640960 00000100:00100000:0.0:1787780042.017263:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 416 00000100:00100000:0.0:1787780042.017270:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0348834000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1874622881640448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787780042.017282:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347fa9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881640320:0@lo:400:kworker.0 00000100:00100000:0.0:1787780042.017309:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0348834000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1874622881640448:12345-0@lo:400:kworker.0 Request processed in 39us (686us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780042.017315:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 416 00000100:00100000:2.0:1787780042.017318:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0345e76940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1874622881640448:0@lo:400:kworker.0 00000100:00100000:0.0:1787780042.017334:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 417 00000100:00100000:0.0:1787780042.017342:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0348836d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1874622881640960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787780042.017385:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0348836d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1874622881640960:12345-0@lo:400:kworker.0 Request processed in 44us (723us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780042.017392:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 417 00000100:00100000:2.0:1787780042.017422:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346efe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1874622881640960:0@lo:400:kworker.0 00000100:00080000:0.0:1787780042.017424:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787780042.017436:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881640832 00000100:00100000:0.0:1787780042.017440:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881640832 00000100:00080000:2.0:1787780042.017482:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787780042.017486:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1787780042.017494:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0348837c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881640832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787780042.017538:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0348837c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881640832:12345-0@lo:400:kworker.0 Request processed in 46us (668us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780042.017544:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1787780042.017578:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347e58780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874622881640192:0@lo:400:kworker.0 00000100:00100000:0.0:1787780042.017589:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346efda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881640704:0@lo:400:kworker.0 00000100:00100000:0.0:1787780042.017596:0:3641:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 2 00000004:00080000:0.0:1787780042.017607:0:3641:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c0347e59680, transno 4294967325 00000100:00100000:0.0:1787780042.017619:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346efc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881641216:0@lo:400:kworker.0 00000100:00100000:0.0:1787780042.017632:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347e5a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881640064:0@lo:400:kworker.0 00010000:00080000:0.0:1787780042.017645:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0477841a40 x1874622881640576/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787780058 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787780042.017655:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477841a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1874622881640576:0@lo:400:kworker.0 00010000:00080000:0.0:1787780042.017666:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0346efed00 x1874622881641088/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787780058 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787780042.017674:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346efed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1874622881641088:0@lo:400:kworker.0 00000100:00100000:2.0:1787780042.018418:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346effc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881640832:0@lo:400:kworker.0 00000100:00100000:3.0:1787780042.525387:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347fe8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881641344:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787780042.525610:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780042.525930:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881641344 00000100:00100000:3.0:1787780042.525937:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881641344 00000100:00100000:3.0:1787780042.525976:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1787780042.525983:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347feb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881641344:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787780042.526010:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787780042.526048:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347feb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881641344:12345-0@lo:13:osp-pre-0-1.0 Request processed in 66us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780042.526055:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1787780042.526095:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347fe8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881641344:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787780042.528400:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787780042.536417:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047798a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881641472:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787780042.536496:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780042.539886:0:8529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881641472 00000100:00100000:1.0:1787780042.539901:0:8529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881641472 00000100:00100000:1.0:1787780042.539970:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1787780042.539980:0:8529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347fe8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881641472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787780042.540006:0:8529:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1787780042.540330:0:8529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347fe8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881641472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 340us (3822us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780042.540338:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1787780042.542126:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047798a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881641472:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787780042.908069:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787780043.035992:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347fe9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881641600:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787780043.036073:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780043.036244:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881641600 00000100:00100000:3.0:1787780043.036252:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881641600 00000100:00100000:3.0:1787780043.036308:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1787780043.036318:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03488343c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874622881641600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787780043.036341:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787780043.036399:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03488343c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874622881641600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780043.036407:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1787780043.036462:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347fe9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881641600:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1787780043.164147:0:13794:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787780043.164155:0:13794:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787780043.164246:0:13794:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:1.0:1787780043.164253:0:13794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787780043.671449:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787780043.671490:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787780043.671533:0:12488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863754880 00000100:00100000:1.0:1787780043.671543:0:12488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863754880 00000100:00100000:0.0:1787780043.671565:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863754752 00000100:00100000:0.0:1787780043.671570:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863754752 00000100:00100000:1.0:1787780043.671624:0:12488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 418 00000100:00100000:1.0:1787780043.671635:0:12488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347fe9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:781d29bb-23d2-48e3-b16d-c29e52cd5375+18:2409:x1874622863754880:12345-192.168.203.31@tcp:400:kworker.0 00000100:00080000:3.0:1787780043.671699:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787780043.671706:0:12488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347fe9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:781d29bb-23d2-48e3-b16d-c29e52cd5375+18:2409:x1874622863754880:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 72us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780043.671731:0:12488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 418 00000100:00100000:0.0:1787780043.672045:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 407 00000100:00100000:0.0:1787780043.672057:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471771450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+13:2409:x1874622863754752:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1787780043.672091:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471771450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+13:2409:x1874622863754752:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 37us (650us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780043.672711:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787780043.672753:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787780043.672776:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787780043.672798:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863755136 00000100:00100000:3.0:1787780043.672803:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863755136 00000100:00100000:3.0:1787780043.672864:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 184 00000100:00100000:3.0:1787780043.672873:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347febc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:2408:x1874622863755136:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1787780043.672923:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347febc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:2408:x1874622863755136:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 51us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780043.672929:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 184 00000100:00100000:3.0:1787780043.672950:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863755392 00000100:00100000:3.0:1787780043.672954:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863755392 00000100:00100000:3.0:1787780043.672978:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863755008 00000100:00100000:3.0:1787780043.672981:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863755008 00000100:00100000:3.0:1787780043.673001:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 419 00000100:00100000:3.0:1787780043.673007:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347fea940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+6:2408:x1874622863755392:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1787780043.673035:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347fea940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+6:2408:x1874622863755392:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 27us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780043.673041:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 419 00000100:00100000:3.0:1787780043.673053:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 420 00000100:00100000:3.0:1787780043.673058:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347feb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:2408:x1874622863755008:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1787780043.673077:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347feb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:2408:x1874622863755008:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 20us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780043.673091:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 420 00000100:00080000:3.0:1787780043.673112:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787780043.673115:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787780043.673117:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787780043.674329:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787780043.674358:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787780043.674403:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863755264 00000100:00100000:3.0:1787780043.674409:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863755264 00000100:00100000:3.0:1787780043.674449:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 185 00000100:00100000:3.0:1787780043.674457:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347fe9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+7:2408:x1874622863755264:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1787780043.674501:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347fe9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+7:2408:x1874622863755264:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 46us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780043.674508:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 185 00000100:00080000:3.0:1787780043.674528:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787780043.674615:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863755520 00000100:00100000:3.0:1787780043.674619:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863755520 00000100:00100000:3.0:1787780043.674655:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 421 00000100:00100000:3.0:1787780043.674662:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347fea580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+5:2408:x1874622863755520:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1787780043.674692:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347fea580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+5:2408:x1874622863755520:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 31us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780043.674699:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 421 00000100:00080000:3.0:1787780043.674712:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787780043.679197:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 407 00010000:00010000:0.0:1787780043.932070:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787780043.996580:0:13797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787780044.572719:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477aed2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874622881641728:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787780044.572787:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787780044.573226:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881641728 00000100:00100000:2.0:1787780044.573234:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881641728 00000100:00100000:2.0:1787780044.573284:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1787780044.573292:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347feb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1874622881641728:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787780044.573324:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1787780044.573390:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347feb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1874622881641728:12345-0@lo:41:osp-pre-0-1.0 Request processed in 98us (602us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780044.573397:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1787780044.573561:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477aed2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874622881641728:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1787780044.956197:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787780045.085170:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787780045.085194:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347fea1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881641856:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787780045.085273:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780045.085507:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881641856 00000100:00100000:1.0:1787780045.085514:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881641856 00000100:00100000:1.0:1787780045.085569:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1787780045.085578:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0348835a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881641856:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787780045.085610:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787780045.085664:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0348835a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881641856:12345-0@lo:41:osp-pre-1-0.0 Request processed in 86us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780045.085670:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1787780045.085768:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347fea1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881641856:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787780045.645639:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787780045.645737:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863755776 00000100:00100000:0.0:1787780045.645747:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863755776 00000100:00100000:0.0:1787780045.645830:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 66 00000100:00100000:0.0:1787780045.645873:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347fea1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+18:13235:x1874622863755776:12345-192.168.203.31@tcp:35:umount.0 00000100:00100000:0.0:1787780045.646133:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347fea1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+19:13235:x1874622863755776:12345-192.168.203.31@tcp:35:umount.0 Request processed in 294us (504us total) trans 4294967523 rc 0/0 00000100:00100000:0.0:1787780045.646142:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 66 00000100:00080000:3.0:1787780045.648449:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787780045.655143:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787780045.655493:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863756032 00000100:00100000:0.0:1787780045.655502:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863756032 00000100:00100000:0.0:1787780045.655557:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 67 00000100:00100000:0.0:1787780045.655566:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347fe8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+19:13235:x1874622863756032:12345-192.168.203.31@tcp:35:umount.0 00000100:00100000:0.0:1787780045.655906:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347fe8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+20:13235:x1874622863756032:12345-192.168.203.31@tcp:35:umount.0 Request processed in 340us (773us total) trans 4294967524 rc 0/0 00000100:00100000:0.0:1787780045.655914:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 67 00000100:00100000:2.0:1787780045.661212:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787780045.661591:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863756288 00000100:00100000:0.0:1787780045.661601:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863756288 00000100:00100000:0.0:1787780045.661777:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 68 00000100:00100000:0.0:1787780045.661788:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0443619850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+20:13235:x1874622863756288:12345-192.168.203.31@tcp:35:umount.0 00000100:00100000:0.0:1787780045.662041:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0443619850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+21:13235:x1874622863756288:12345-192.168.203.31@tcp:35:umount.0 Request processed in 254us (839us total) trans 4294967525 rc 0/0 00000100:00100000:0.0:1787780045.662050:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 68 00000100:00100000:3.0:1787780045.666509:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787780045.667741:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863756544 00000100:00100000:1.0:1787780045.667754:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863756544 00000100:00100000:1.0:1787780045.667806:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 69 00000100:00100000:1.0:1787780045.667815:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347fe8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+21:13235:x1874622863756544:12345-192.168.203.31@tcp:35:umount.0 00000100:00100000:1.0:1787780045.668151:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347fe8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:781d29bb-23d2-48e3-b16d-c29e52cd5375+22:13235:x1874622863756544:12345-192.168.203.31@tcp:35:umount.0 Request processed in 336us (1650us total) trans 4294967526 rc 0/0 00000100:00100000:1.0:1787780045.668160:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 69 00000100:00100000:3.0:1787780045.675934:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787780045.675961:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787780045.675986:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863756672 00000100:00100000:1.0:1787780045.675995:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863756672 00000100:00100000:3.0:1787780045.676005:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787780045.676045:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863756928 00000100:00100000:1.0:1787780045.676049:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863756928 00000100:00100000:3.0:1787780045.676055:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863756800 00000100:00100000:3.0:1787780045.676059:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863756800 00000100:00100000:1.0:1787780045.676067:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 19 00000100:00100000:1.0:1787780045.676075:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347fe9e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+15:2411:x1874622863756672:12345-192.168.203.31@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787780045.676089:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 20 00010000:00010000:1.0:1787780045.676090:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1787780045.676094:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347fe83c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+15:2411:x1874622863756928:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787780045.676100:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787780045.676110:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c0477869a00/0xc8fc0a517996091e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1da6 expref: 15 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780045.676110:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c04766dda00/0xc8fc0a5179960703 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1ccd expref: 15 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780045.676126:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787780045.676134:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787780045.676180:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347fe9e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+13:2411:x1874622863756672:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 105us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780045.676189:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 19 00000100:00100000:1.0:1787780045.676207:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 21 00000100:00100000:1.0:1787780045.676212:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347fea1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+12:2411:x1874622863756800:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787780045.676222:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787780045.676230:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c0440031000/0xc8fc0a5179960646 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1c8e expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780045.676239:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787780045.677941:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347fe83c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+11:2411:x1874622863756928:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 1838us (1971us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780045.677954:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 20 00000100:00100000:1.0:1787780045.678616:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347fea1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+10:2411:x1874622863756800:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 2399us (2606us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780045.678626:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 21 00000100:00100000:2.0:1787780045.683468:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787780045.684409:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863757312 00000100:00100000:3.0:1787780045.684420:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863757312 00000100:00100000:3.0:1787780045.684557:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 80 00000100:00100000:3.0:1787780045.684568:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c047798a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+7:2407:x1874622863757312:12345-192.168.203.31@tcp:9:umount.0 00000020:00000080:3.0:1787780045.684603:0:9899:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc8fc0a5179960c97 00000020:00010000:3.0:1787780045.684610:0:9899:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9c0347e3c000: total 0 00000100:00080000:3.0:1787780045.684628:0:9899:0:(import.c:65:import_set_state_nolock()) ffff9c0347e39000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787780045.684680:0:9899:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000020:00010000:2.0:1787780045.684830:0:7453:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9c0347e3c000: total 0 00000100:00100000:3.0:1787780045.684861:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c047798a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:2407:x1874622863757312:12345-192.168.203.31@tcp:9:umount.0 Request processed in 294us (1402us total) trans 0 rc 0/0 00010000:00010000:2.0:1787780045.684892:0:7453:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9c0347e3c000, canceled 0 locks, left on hash table 2. 00000100:00100000:3.0:1787780045.684933:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 80 00010000:00010000:2.0:1787780045.684945:0:7453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000026d60510/0xc8fc0a517996171e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea2173 expref: 5 pid: 8427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780045.684983:0:7453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000164ee716/0xc8fc0a517996104f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1f90 expref: 3 pid: 8428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787780045.684989:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1787780045.684997:0:7453:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9c0347e3c000, canceled 2 locks, left on hash table 0. 00010000:00010000:2.0:1787780045.685010:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787780045.685012:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787780045.685014:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787780045.688333:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787780045.688518:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863757440 00000100:00100000:3.0:1787780045.688529:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863757440 00000100:00100000:3.0:1787780045.689029:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 81 00000100:00100000:3.0:1787780045.689051:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c047798b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:2407:x1874622863757440:12345-192.168.203.31@tcp:9:umount.0 00000020:00000080:3.0:1787780045.689083:0:8428:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc8fc0a5179960a21 00000100:00080000:3.0:1787780045.689093:0:8428:0:(import.c:65:import_set_state_nolock()) ffff9c044963f800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787780045.689173:0:8428:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:3.0:1787780045.689353:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c047798b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+2:2407:x1874622863757440:12345-192.168.203.31@tcp:9:umount.0 Request processed in 302us (1015us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780045.689363:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 81 00010000:00010000:2.0:1787780045.690029:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787780045.693170:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787780045.702943:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787780045.703035:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863758464 00000100:00100000:3.0:1787780045.703045:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863758464 00000100:00100000:3.0:1787780045.703111:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 258 00000100:00100000:3.0:1787780045.703121:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0348835e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+22:2407:x1874622863758464:12345-192.168.203.31@tcp:39:umount.0 00000020:00000080:3.0:1787780045.703153:0:6513:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc8fc0a5179960654 00000020:00010000:3.0:1787780045.703172:0:6513:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9c0347cef800: total 0 00000100:00080000:3.0:1787780045.703177:0:6513:0:(import.c:65:import_set_state_nolock()) ffff9c0347cef000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787780045.703211:0:6513:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000020:00010000:2.0:1787780045.703286:0:6500:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9c0347cef800: total 0 00010000:00010000:2.0:1787780045.703344:0:6500:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9c0347cef800, canceled 0 locks, left on hash table 13. 00010000:00010000:2.0:1787780045.703387:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c04533a3600) 00010000:00010000:2.0:1787780045.703391:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00000100:00100000:3.0:1787780045.703397:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0348835e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:781d29bb-23d2-48e3-b16d-c29e52cd5375+21:2407:x1874622863758464:12345-192.168.203.31@tcp:39:umount.0 Request processed in 278us (465us total) trans 4294967527 rc 0/0 00010000:00010000:2.0:1787780045.703399:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19a00/0xc8fc0a517996103a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1f89 expref: 21 pid: 12488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787780045.703405:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 258 00010000:00010000:2.0:1787780045.703420:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c0443d81900) 00010000:00010000:2.0:1787780045.703423:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787780045.703427:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a800/0xc8fc0a5179960cf2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1ea9 expref: 19 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780045.703441:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c0347a50800) 00010000:00010000:2.0:1787780045.703443:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787780045.703447:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70200/0xc8fc0a517996099c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1dbb expref: 18 pid: 12488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780045.703464:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c0443d81800) 00010000:00010000:2.0:1787780045.703467:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787780045.703471:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868200/0xc8fc0a51799615ff lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea2126 expref: 17 pid: 7821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780045.703483:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c04478d7d00) 00010000:00010000:2.0:1787780045.703486:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787780045.703489:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19e00/0xc8fc0a51799610d4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1fb3 expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780045.703500:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c04533a3600) 00010000:00010000:2.0:1787780045.703503:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787780045.703514:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0444c19200/0xc8fc0a5179960f30 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1f43 expref: 15 pid: 7821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780045.703529:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9c0347a50600) 00010000:00010000:2.0:1787780045.703531:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787780045.703534:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70e00/0xc8fc0a5179960980 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1db4 expref: 14 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780045.703548:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c0443d81800) 00010000:00010000:2.0:1787780045.703550:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787780045.703553:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0481373400/0xc8fc0a51799616df lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea215e expref: 13 pid: 7821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780045.703564:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c0443d81800) 00010000:00010000:2.0:1787780045.703566:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787780045.703570:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc400/0xc8fc0a5179961709 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea216c expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780045.703584:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c0443d81900) 00010000:00010000:2.0:1787780045.703587:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787780045.703591:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0346dd7400/0xc8fc0a51799609f7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1dd0 expref: 11 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780045.703607:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c0443d81000) 00010000:00010000:2.0:1787780045.703619:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787780045.703624:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc000/0xc8fc0a51799610b8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1fac expref: 10 pid: 12488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780045.703636:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c04533a3600) 00010000:00010000:2.0:1787780045.703646:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787780045.703650:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dd400/0xc8fc0a5179961010 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1f7b expref: 9 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780045.703667:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c04478d7d00) 00010000:00010000:2.0:1787780045.703670:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787780045.703673:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868a00/0xc8fc0a51799613c1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea208c expref: 8 pid: 12488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780045.703685:0:6500:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9c0347cef800, canceled 13 locks, left on hash table 0. 00010000:00010000:2.0:1787780045.703700:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787780045.703702:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787780045.703704:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787780045.718749:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787780045.718939:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863758592 00000100:00100000:3.0:1787780045.718964:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863758592 00000100:00100000:2.0:1787780045.719143:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 259 00000100:00100000:2.0:1787780045.719154:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c047798ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+5:2407:x1874622863758592:12345-192.168.203.31@tcp:39:umount.0 00000020:00000080:2.0:1787780045.719187:0:6514:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc8fc0a517996065b 00000100:00080000:2.0:1787780045.719204:0:6514:0:(import.c:65:import_set_state_nolock()) ffff9c0347ced800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787780045.719278:0:6514:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1787780045.719447:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c047798ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:781d29bb-23d2-48e3-b16d-c29e52cd5375+3:2407:x1874622863758592:12345-192.168.203.31@tcp:39:umount.0 Request processed in 295us (708us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1787780045.719456:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 259 00000100:00080000:0.0:1787780045.719770:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1787780045.719805:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787780045.980195:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787780047.005095:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787780047.132152:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348834780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874622881642240:0@lo:400:kworker.0 00000100:00100000:0.0:1787780047.132228:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787780047.132311:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348836580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1874622881642752:0@lo:400:kworker.0 00000100:00100000:0.0:1787780047.132340:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787780047.132373:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347e5a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1874622881643264:0@lo:400:kworker.0 00000100:00100000:0.0:1787780047.132397:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780047.132500:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881642752 00000100:00100000:3.0:1787780047.132506:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881642752 00000100:00100000:3.0:1787780047.132561:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881643264 00000100:00100000:3.0:1787780047.132566:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881643264 00000100:00100000:3.0:1787780047.132588:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 422 00000100:00100000:3.0:1787780047.132596:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03489f70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1874622881642752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787780047.132656:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03489f70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1874622881642752:12345-0@lo:400:kworker.0 Request processed in 61us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780047.132663:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 422 00000100:00100000:3.0:1787780047.132681:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 423 00000100:00100000:3.0:1787780047.132687:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03489f7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1874622881643264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787780047.132729:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03489f7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1874622881643264:12345-0@lo:400:kworker.0 Request processed in 42us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780047.132735:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 423 00000100:00100000:3.0:1787780047.132772:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881642240 00000100:00100000:3.0:1787780047.132776:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881642240 00000100:00100000:3.0:1787780047.132798:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1787780047.132805:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347e583c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1874622881642240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787780047.132859:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347e583c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1874622881642240:12345-0@lo:400:kworker.0 Request processed in 32us (609us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780047.132867:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1787780047.132886:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c03488370c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874622881642112:0@lo:400:kworker.0 00000100:00100000:3.0:1787780047.132911:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780047.132929:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348834b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1874622881642624:0@lo:400:kworker.0 00000100:00100000:3.0:1787780047.132948:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780047.132962:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347e59680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1874622881643136:0@lo:400:kworker.0 00000100:00100000:3.0:1787780047.132992:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780047.133007:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347fe8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881643648:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787780047.133026:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780047.133053:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881642112 00000100:00100000:3.0:1787780047.133057:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881642112 00000100:00100000:3.0:1787780047.133073:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881642624 00000100:00100000:3.0:1787780047.133076:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881642624 00000100:00100000:3.0:1787780047.133088:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881643136 00000100:00100000:3.0:1787780047.133091:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881643136 00000100:00100000:3.0:1787780047.133103:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 424 00000100:00100000:3.0:1787780047.133109:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347dad2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874622881642112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787780047.133139:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347dad2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874622881642112:12345-0@lo:400:kworker.0 Request processed in 31us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780047.133145:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 424 00000100:00100000:3.0:1787780047.133156:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 425 00000100:00100000:3.0:1787780047.133162:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347dafc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874622881642624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787780047.133185:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347dafc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874622881642624:12345-0@lo:400:kworker.0 Request processed in 24us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780047.133191:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 425 00000100:00100000:3.0:1787780047.133201:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 426 00000100:00100000:3.0:1787780047.133206:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347dade00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1874622881643136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787780047.133228:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347dade00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1874622881643136:12345-0@lo:400:kworker.0 Request processed in 22us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780047.133233:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 426 00000100:00100000:3.0:1787780047.133268:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c03488370c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874622881642112:0@lo:400:kworker.0 00000100:00100000:3.0:1787780047.133279:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348834b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1874622881642624:0@lo:400:kworker.0 00000100:00100000:3.0:1787780047.133299:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347e59680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1874622881643136:0@lo:400:kworker.0 00000100:00080000:3.0:1787780047.133344:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787780047.133348:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1787780047.133548:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0347e5a1c0 x1874622881643264/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787780063 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787780047.133559:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347e5a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1874622881643264:0@lo:400:kworker.0 00000100:00100000:0.0:1787780047.133577:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348834780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874622881642240:0@lo:400:kworker.0 00010000:00080000:0.0:1787780047.133586:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0348836580 x1874622881642752/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787780063 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787780047.133594:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348836580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1874622881642752:0@lo:400:kworker.0 00000100:00100000:2.0:1787780047.133716:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348835680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874622881642368:0@lo:400:kworker.0 00000100:00100000:2.0:1787780047.133751:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787780047.133767:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477841a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881642880:0@lo:400:kworker.0 00000100:00100000:2.0:1787780047.133803:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787780047.133824:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347e58780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881643392:0@lo:400:kworker.0 00000100:00100000:2.0:1787780047.133861:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787780047.133880:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:2.0:1787780047.133886:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348837480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1f575176-36bc-4786-83ee-2fea064a12a9:3643:1874622881641984:0@lo:400:kworker.0 00000100:00100000:2.0:1787780047.133912:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787780047.133935:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c03488352c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881642496:0@lo:400:kworker.0 00000100:00100000:2.0:1787780047.133956:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787780047.133973:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347e592c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881643008:0@lo:400:kworker.0 00000100:00100000:2.0:1787780047.133993:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787780047.134009:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347e5bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881643520:0@lo:400:kworker.0 00000100:00100000:2.0:1787780047.134030:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787780047.134056:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881642368 00000100:00100000:2.0:1787780047.134060:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881642368 00000100:00100000:2.0:1787780047.134089:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 427 00000100:00100000:2.0:1787780047.134096:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c047798b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1874622881642368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787780047.134134:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c047798b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1874622881642368:12345-0@lo:400:kworker.0 Request processed in 38us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780047.134140:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 427 00000100:00100000:2.0:1787780047.134157:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881642880 00000100:00100000:2.0:1787780047.134161:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881642880 00000100:00100000:2.0:1787780047.134182:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881643392 00000100:00100000:2.0:1787780047.134184:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881643392 00000100:00100000:2.0:1787780047.134196:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881643008 00000100:00100000:2.0:1787780047.134198:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881643008 00000100:00100000:2.0:1787780047.134209:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881643520 00000100:00100000:2.0:1787780047.134211:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881643520 00000100:00100000:2.0:1787780047.134235:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1787780047.134241:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04779892c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881642880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787780047.134270:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04779892c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881642880:12345-0@lo:400:kworker.0 Request processed in 30us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780047.134276:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1787780047.134287:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1787780047.134293:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477988780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881643392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787780047.134318:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477988780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881643392:12345-0@lo:400:kworker.0 Request processed in 26us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780047.134324:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1787780047.134334:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1787780047.134340:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c047798a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881643008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787780047.134376:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c047798a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881643008:12345-0@lo:400:kworker.0 Request processed in 37us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780047.134382:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1787780047.134393:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1787780047.134399:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346efcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881643520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787780047.134425:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346efcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881643520:12345-0@lo:400:kworker.0 Request processed in 26us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780047.134431:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1787780047.134450:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881641984 00000100:00100000:2.0:1787780047.134453:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881641984 00000100:00100000:2.0:1787780047.134488:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 408 00000100:00100000:2.0:1787780047.134494:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471770c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+24:3643:x1874622881641984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787780047.134522:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471770c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f575176-36bc-4786-83ee-2fea064a12a9+24:3643:x1874622881641984:12345-0@lo:400:kworker.0 Request processed in 29us (610us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780047.134539:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 408 00000100:00100000:2.0:1787780047.134576:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881642496 00000100:00100000:2.0:1787780047.134580:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881642496 00000100:00100000:2.0:1787780047.135485:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1787780047.135500:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c047798bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881642496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787780047.135548:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c047798bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881642496:12345-0@lo:400:kworker.0 Request processed in 53us (1591us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780047.135656:0:8529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881643648 00000100:00100000:0.0:1787780047.135661:0:8529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881643648 00000100:00100000:0.0:1787780047.135696:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1787780047.135702:0:8529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347dac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881643648:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787780047.135724:0:8529:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1787780047.135762:0:8529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347dac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881643648:12345-0@lo:13:osp-pre-1-1.0 Request processed in 61us (2735us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780047.135769:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1787780047.135813:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347fe8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881643648:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787780047.135878:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348837480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1f575176-36bc-4786-83ee-2fea064a12a9:3643:1874622881641984:0@lo:400:kworker.0 00000100:00100000:0.0:1787780047.135889:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c03488352c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881642496:0@lo:400:kworker.0 00000100:00100000:0.0:1787780047.135898:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347e592c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881643008:0@lo:400:kworker.0 00000100:00100000:0.0:1787780047.135920:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347e5bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881643520:0@lo:400:kworker.0 00000100:00100000:0.0:1787780047.135931:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348835680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874622881642368:0@lo:400:kworker.0 00000100:00100000:0.0:1787780047.135947:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477841a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881642880:0@lo:400:kworker.0 00000100:00100000:0.0:1787780047.135956:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347e58780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881643392:0@lo:400:kworker.0 00000100:00080000:0.0:1787780047.135985:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787780047.135989:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787780047.140111:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1787780047.644100:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347dada40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874622881643776:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787780047.644168:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780047.644328:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881643776 00000100:00100000:3.0:1787780047.644335:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881643776 00000100:00100000:3.0:1787780047.644396:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1787780047.644406:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03489f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1874622881643776:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787780047.644440:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787780047.644489:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03489f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1874622881643776:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780047.644496:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1787780047.644600:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347dada40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874622881643776:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787780047.646742:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787780047.651682:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c03489f61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881643904:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787780047.651758:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787780047.662589:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881643904 00000100:00100000:0.0:1787780047.662602:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881643904 00000100:00100000:0.0:1787780047.662783:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1787780047.662794:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477aee580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881643904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787780047.662821:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1787780047.662924:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477aee580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881643904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 132us (11166us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780047.662942:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1787780047.663025:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c03489f61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881643904:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787780047.935441:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787780047.935498:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787780047.935547:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787780047.935737:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863758720 00000100:00100000:2.0:1787780047.935757:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863758720 00000100:00100000:2.0:1787780047.935831:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863758976 00000100:00100000:2.0:1787780047.935835:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863758976 00000100:00100000:2.0:1787780047.935881:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863758848 00000100:00100000:2.0:1787780047.935885:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863758848 00000100:00100000:2.0:1787780047.935902:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 22 00000100:00100000:2.0:1787780047.935912:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03489f4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+12:2408:x1874622863758720:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787780047.935932:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787780047.935961:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c0477869e00/0xc8fc0a5179960757 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1ce2 expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780047.935981:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787780047.936047:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03489f4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+11:2408:x1874622863758720:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 136us (621us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780047.936056:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 22 00000100:00100000:2.0:1787780047.936076:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 23 00000100:00100000:2.0:1787780047.936082:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03489f43c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+10:2408:x1874622863758976:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787780047.936089:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787780047.936116:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c0346dd6200/0xc8fc0a5179960917 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1d9f expref: 10 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780047.936126:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787780047.936145:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03489f43c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+9:2408:x1874622863758976:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 64us (647us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780047.936152:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 23 00000100:00100000:2.0:1787780047.936164:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 24 00000100:00100000:2.0:1787780047.936171:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0461979450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+8:2408:x1874622863758848:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787780047.936179:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787780047.936188:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c0477868600/0xc8fc0a517996075e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1d13 expref: 8 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780047.936208:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787780047.936225:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0461979450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+7:2408:x1874622863758848:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 55us (678us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780047.936232:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 24 00000100:00100000:3.0:1787780047.947644:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787780047.947829:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863759232 00000100:00100000:0.0:1787780047.947888:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863759232 00000100:00100000:1.0:1787780047.948081:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 260 00000100:00100000:1.0:1787780047.948099:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347dad680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+6:2407:x1874622863759232:12345-192.168.203.31@tcp:39:umount.0 00000020:00000080:1.0:1787780047.948140:0:7821:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc8fc0a517996076c 00000020:00010000:1.0:1787780047.948150:0:7821:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9c0347d29800: total 0 00000100:00080000:1.0:1787780047.948176:0:7821:0:(import.c:65:import_set_state_nolock()) ffff9c0347d2e000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787780047.948202:0:7821:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000100:00100000:1.0:1787780047.948382:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347dad680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+5:2407:x1874622863759232:12345-192.168.203.31@tcp:39:umount.0 Request processed in 289us (752us total) trans 4294967528 rc 0/0 00000100:00100000:1.0:1787780047.948391:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 260 00000020:00010000:2.0:1787780047.948864:0:7453:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9c0347d29800: total 0 00010000:00010000:2.0:1787780047.948872:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787780047.948958:0:7453:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9c0347d29800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1787780047.949027:0:7453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c0443d81000) 00010000:00010000:2.0:1787780047.949031:0:7453:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787780047.949042:0:7453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c04766dc200/0xc8fc0a517996172c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea217a expref: 4 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780047.949069:0:7453:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9c0347d29800, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1787780047.949080:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787780047.949082:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787780047.949096:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787780047.949367:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:2.0:1787780047.955168:0:6491:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 25f2eabf-81ed-4798-a9a9-6e0f6dda29ab 00000001:00080000:2.0:1787780047.955189:0:6491:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967528 is committed 00000020:00000080:2.0:1787780047.955248:0:6491:0:(genops.c:885:class_export_put()) final put ffff9c0347d29800/25f2eabf-81ed-4798-a9a9-6e0f6dda29ab 00000001:00100000:2.0:1787780047.955274:0:6491:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 781d29bb-23d2-48e3-b16d-c29e52cd5375 00000001:00080000:2.0:1787780047.955283:0:6491:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00000080:2.0:1787780047.955296:0:6491:0:(genops.c:885:class_export_put()) final put ffff9c0347cef800/781d29bb-23d2-48e3-b16d-c29e52cd5375 00000020:00000080:0.0:1787780047.955374:0:2253:0:(genops.c:844:class_export_destroy()) destroying export ffff9c0347d29800/25f2eabf-81ed-4798-a9a9-6e0f6dda29ab for lustre-MDT0000 00000020:00000080:0.0:1787780047.955451:0:2253:0:(genops.c:844:class_export_destroy()) destroying export ffff9c0347cef800/781d29bb-23d2-48e3-b16d-c29e52cd5375 for lustre-MDT0000 00000020:00000080:0.0:1787780047.955492:0:2253:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c0347d2e000 for lustre-MDT0000 00000020:00000080:0.0:1787780047.955497:0:2253:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c0347cef000 for lustre-MDT0000 00000100:00100000:2.0:1787780047.971676:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787780047.971918:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863759360 00000100:00100000:0.0:1787780047.971940:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863759360 00000100:00080000:3.0:1787780047.972433:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787780047.975783:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 261 00000100:00100000:2.0:1787780047.975822:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346efe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+5:2407:x1874622863759360:12345-192.168.203.31@tcp:39:umount.0 00000020:00000080:2.0:1787780047.976080:0:6513:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc8fc0a5179960773 00000100:00080000:2.0:1787780047.976168:0:6513:0:(import.c:65:import_set_state_nolock()) ffff9c0347d2d000 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1787780047.976200:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:2.0:1787780047.976207:0:6513:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:2.0:1787780047.976698:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346efe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:25f2eabf-81ed-4798-a9a9-6e0f6dda29ab+3:2407:x1874622863759360:12345-192.168.203.31@tcp:39:umount.0 Request processed in 893us (5026us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1787780047.979376:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 261 00010000:00010000:2.0:1787780048.028325:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787780048.041255:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787780048.041381:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863759616 00000100:00100000:1.0:1787780048.041394:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863759616 00000100:00100000:1.0:1787780048.041464:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 409 00000100:00100000:1.0:1787780048.041476:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471771c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+7:2407:x1874622863759616:12345-192.168.203.31@tcp:251:umount.0 00000020:00000080:1.0:1787780048.041542:0:6505:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc8fc0a5179960631 00000020:00010000:1.0:1787780048.041552:0:6505:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9c0347d29000: total 0 00000100:00080000:1.0:1787780048.041557:0:6505:0:(import.c:65:import_set_state_nolock()) ffff9c0347d2c000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1787780048.041661:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471771c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d07925b3-67b5-4bfe-9c63-01bf2f1cd011+3:2407:x1874622863759616:12345-192.168.203.31@tcp:251:umount.0 Request processed in 187us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780048.041669:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 409 00000020:00010000:3.0:1787780048.042808:0:7453:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9c0347d29000: total 0 00010000:00010000:3.0:1787780048.042938:0:7453:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9c0347d29000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1787780048.042998:0:7453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c0346dd7e00/0xc8fc0a517996070a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea1cd4 expref: 2 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780048.043020:0:7453:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9c0347d29000, canceled 1 locks, left on hash table 0. 00000020:00000080:3.0:1787780048.043034:0:7453:0:(genops.c:885:class_export_put()) final put ffff9c0347d29000/d07925b3-67b5-4bfe-9c63-01bf2f1cd011 00010000:00010000:3.0:1787780048.043106:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787780048.043109:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787780048.043111:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787780048.053864:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c0347d29000/d07925b3-67b5-4bfe-9c63-01bf2f1cd011 for MGS 00000020:00000080:0.0:1787780048.054078:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c0347d2c000 for MGS 00000100:00100000:2.0:1787780048.156130:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787780048.156163:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347dacb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881644032:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787780048.156260:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787780048.156366:0:8529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881644032 00000100:00100000:0.0:1787780048.156376:0:8529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881644032 00000100:00100000:0.0:1787780048.156446:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1787780048.156459:0:8529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346effc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881644032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787780048.156499:0:8529:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787780048.156561:0:8529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346effc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881644032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780048.156577:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1787780048.156620:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347dacb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881644032:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787780049.068942:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787780049.692136:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477aeed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881644160:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787780049.692209:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780049.692280:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881644160 00000100:00100000:3.0:1787780049.692296:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881644160 00000100:00100000:3.0:1787780049.692378:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1787780049.692390:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346efc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881644160:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787780049.692459:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1787780049.701520:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346efc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881644160:12345-0@lo:41:osp-pre-0-1.0 Request processed in 9116us (9294us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780049.701542:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1787780049.706562:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477aeed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881644160:0@lo:41:osp-pre-0-1.0 00000020:01000004:1.0:1787780050.011397:0:15253:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1787780050.014957:0:15253:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1787780050.015012:0:15253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c04427db400/0xc8fc0a51799606d9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a51799606e0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780050.015025:0:15253:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c04427db400/0xc8fc0a51799606d9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xc8fc0a51799606e0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780050.015032:0:15253:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c04427db400/0xc8fc0a51799606d9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xc8fc0a51799606e0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780050.015049:0:15253:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.131@tcp lock: ffff9c04427db400/0xc8fc0a51799606d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xc8fc0a51799606e0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780050.015082:0:15253:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787780050.015088:0:15253:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1787780050.015287:0:15253:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787780050.015292:0:15253:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1787780050.015297:0:15253:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1787780050.015319:0:15253:0:(import.c:65:import_set_state_nolock()) ffff9c0445f86800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1787780050.015360:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477aeed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874622881644288:0@lo:39:umount.0 00000100:00100000:1.0:1787780050.015425:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787780050.015618:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787780050.015626:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff9c04427db400/0xc8fc0a51799606d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xc8fc0a51799606e0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780050.015635:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c04427db400 already unused, calling callback (ffffffffc139ac20) 10000000:00010000:0.0:1787780050.015639:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff9c04427db400/0xc8fc0a51799606d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xc8fc0a51799606e0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780050.015648:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff9c04427db400/0xc8fc0a51799606d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xc8fc0a51799606e0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787780050.015656:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff9c04427db400/0xc8fc0a51799606d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xc8fc0a51799606e0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787780050.015663:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787780050.015666:0:6500:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1787780050.015669:0:6500:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1787780050.015702:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff9c04427db400/0xc8fc0a51799606d9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xc8fc0a51799606e0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780050.015709:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787780050.015871:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff9c04427db400/0xc8fc0a51799606d9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xc8fc0a51799606e0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780050.015880:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff9c04427db400/0xc8fc0a51799606d9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xc8fc0a51799606e0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780050.015892:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787780050.015894:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787780050.015896:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787780050.015911:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881644288 00000100:00100000:0.0:1787780050.015917:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881644288 00000100:00100000:0.0:1787780050.015963:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1787780050.015971:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477aed2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874622881644288:12345-0@lo:39:umount.0 00000020:00000080:0.0:1787780050.015993:0:6512:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc8fc0a5179960248 00000100:00080000:0.0:1787780050.016001:0:6512:0:(import.c:65:import_set_state_nolock()) ffff9c0445f82800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1787780050.016323:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477aed2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3640:x1874622881644288:12345-0@lo:39:umount.0 Request processed in 350us (895us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780050.016331:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000020:00000080:0.0:1787780050.016352:0:6512:0:(genops.c:885:class_export_put()) final put ffff9c0445f87000/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00080000:0.0:1787780050.016398:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9c0445f86800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1787780050.016408:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477aeed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874622881644288:0@lo:39:umount.0 00000100:00100000:1.0:1787780050.016460:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c03489f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1f575176-36bc-4786-83ee-2fea064a12a9:3642:1874622881644416:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787780050.016492:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787780050.016537:0:15253:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787780050.016540:0:15253:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1787780050.016543:0:15253:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:0.0:1787780050.016918:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881644416 00000100:00100000:0.0:1787780050.016923:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881644416 00000100:00100000:0.0:1787780050.016962:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787780050.016969:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477aec3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1f575176-36bc-4786-83ee-2fea064a12a9+24:3642:x1874622881644416:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787780050.016993:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787780050.017010:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c0477a70c00/0xc8fc0a51799606e0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc8fc0a51799606d9 expref: 24 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780050.017023:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787780050.017829:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477aec3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1f575176-36bc-4786-83ee-2fea064a12a9+23:3642:x1874622881644416:12345-0@lo:103:ldlm_bl.0 Request processed in 857us (1332us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780050.017855:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787780050.017903:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c03489f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1f575176-36bc-4786-83ee-2fea064a12a9:3642:1874622881644416:0@lo:103:ldlm_bl.0 00000020:00000080:0.0:1787780050.019378:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c0445f87000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1787780050.019442:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c0445f82800 for lustre-MDT0000 00010000:00010000:1.0:1787780050.019983:0:15253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c0346dd7000/0xc8fc0a51799606e7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a51799606ee expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780050.019997:0:15253:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c0346dd7000/0xc8fc0a51799606e7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xc8fc0a51799606ee expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780050.020005:0:15253:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c0346dd7000/0xc8fc0a51799606e7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xc8fc0a51799606ee expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780050.020012:0:15253:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.131@tcp lock: ffff9c0346dd7000/0xc8fc0a51799606e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xc8fc0a51799606ee expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780050.021213:0:15253:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787780050.021225:0:15253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c0440031a00/0xc8fc0a51799605eb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a51799605f2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780050.021242:0:15253:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c0440031a00/0xc8fc0a51799605eb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc8fc0a51799605f2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780050.021249:0:15253:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c0440031a00/0xc8fc0a51799605eb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc8fc0a51799605f2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780050.021255:0:15253:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.131@tcp lock: ffff9c0440031a00/0xc8fc0a51799605eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc8fc0a51799605f2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780050.025310:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787780050.025325:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff9c0346dd7000/0xc8fc0a51799606e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xc8fc0a51799606ee expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780050.025337:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0346dd7000 already unused, calling callback (ffffffffc139ac20) 10000000:00010000:0.0:1787780050.025352:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff9c0346dd7000/0xc8fc0a51799606e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xc8fc0a51799606ee expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780050.025363:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff9c0346dd7000/0xc8fc0a51799606e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xc8fc0a51799606ee expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787780050.025370:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff9c0346dd7000/0xc8fc0a51799606e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xc8fc0a51799606ee expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787780050.025376:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787780050.025379:0:6501:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:0.0:1787780050.025416:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff9c0346dd7000/0xc8fc0a51799606e7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xc8fc0a51799606ee expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780050.025433:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787780050.025469:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff9c0346dd7000/0xc8fc0a51799606e7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xc8fc0a51799606ee expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780050.025477:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff9c0346dd7000/0xc8fc0a51799606e7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xc8fc0a51799606ee expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780050.025489:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787780050.025493:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff9c0440031a00/0xc8fc0a51799605eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc8fc0a51799605f2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780050.025498:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0440031a00 already unused, calling callback (ffffffffc139ac20) 10000000:00010000:0.0:1787780050.025501:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff9c0440031a00/0xc8fc0a51799605eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc8fc0a51799605f2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780050.025507:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff9c0440031a00/0xc8fc0a51799605eb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xc8fc0a51799605f2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787780050.025513:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff9c0440031a00/0xc8fc0a51799605eb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xc8fc0a51799605f2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787780050.025518:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1787780050.025520:0:6501:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:0.0:1787780050.025532:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff9c0440031a00/0xc8fc0a51799605eb lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xc8fc0a51799605f2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780050.025538:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787780050.025544:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff9c0440031a00/0xc8fc0a51799605eb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xc8fc0a51799605f2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780050.025562:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787780050.025563:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787780050.025565:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787780050.025606:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c03489f52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1f575176-36bc-4786-83ee-2fea064a12a9:3644:1874622881644672:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787780050.025671:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787780050.025971:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787780050.025979:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c03489f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1f575176-36bc-4786-83ee-2fea064a12a9:3644:1874622881644544:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787780050.026006:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787780050.026117:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881644672 00000100:00100000:0.0:1787780050.026124:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881644672 00000100:00100000:0.0:1787780050.026171:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881644544 00000100:00100000:0.0:1787780050.026174:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881644544 00000100:00100000:0.0:1787780050.026678:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787780050.026687:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03489f4f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1f575176-36bc-4786-83ee-2fea064a12a9+24:3644:x1874622881644672:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787780050.026700:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787780050.026715:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c04766dcc00/0xc8fc0a51799605f2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc8fc0a51799605eb expref: 24 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780050.026799:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787780050.026860:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03489f4f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1f575176-36bc-4786-83ee-2fea064a12a9+23:3644:x1874622881644672:12345-0@lo:103:ldlm_bl.0 Request processed in 174us (1189us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780050.026868:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787780050.026889:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787780050.026895:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03489f6580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1f575176-36bc-4786-83ee-2fea064a12a9+22:3644:x1874622881644544:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787780050.026904:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787780050.026913:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c04766dd800/0xc8fc0a51799606ee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc8fc0a51799606e7 expref: 22 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780050.026931:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787780050.026955:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03489f6580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1f575176-36bc-4786-83ee-2fea064a12a9+21:3644:x1874622881644544:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (948us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780050.026961:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787780050.027000:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c03489f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1f575176-36bc-4786-83ee-2fea064a12a9:3644:1874622881644544:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787780050.027009:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c03489f52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1f575176-36bc-4786-83ee-2fea064a12a9:3644:1874622881644672:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787780050.027479:0:15253:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787780050.027487:0:15253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff9c0440031a00/0xc8fc0a51799605eb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xc8fc0a51799605f2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787780050.027500:0:15253:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1787780050.027511:0:15253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c0440030200/0xc8fc0a517996094f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a5179960956 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780050.027518:0:15253:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c0440030200/0xc8fc0a517996094f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc8fc0a5179960956 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780050.027524:0:15253:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c0440030200/0xc8fc0a517996094f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xc8fc0a5179960956 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780050.027531:0:15253:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.131@tcp lock: ffff9c0440030200/0xc8fc0a517996094f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xc8fc0a5179960956 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780050.027546:0:15253:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787780050.027550:0:15253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c044148aa00/0xc8fc0a51799601a7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a51799601ae expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780050.027564:0:15253:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c044148aa00/0xc8fc0a51799601a7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc8fc0a51799601ae expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780050.027570:0:15253:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c044148aa00/0xc8fc0a51799601a7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc8fc0a51799601ae expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780050.027575:0:15253:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.131@tcp lock: ffff9c044148aa00/0xc8fc0a51799601a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc8fc0a51799601ae expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780050.027598:0:15253:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1787780050.027601:0:15253:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:1.0:1787780050.027604:0:15253:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:1.0:1787780050.027635:0:15253:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:1.0:1787780050.027639:0:15253:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:1.0:1787780050.027644:0:15253:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787780050.027650:0:15253:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/9 00000020:00080000:1.0:1787780050.027655:0:15253:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9c0481210000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787780050.027661:0:15253:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9c0345e52000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787780050.027665:0:15253:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9c0476701800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787780050.027669:0:15253:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9c046ecd2800 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294967298 stale:0 00000020:00080000:1.0:1787780050.027674:0:15253:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff9c0445fc3370) has exports, disconnecting them 00000020:00080000:1.0:1787780050.027678:0:15253:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9c0481210000), last request at 1787780047 00000020:00000080:1.0:1787780050.027684:0:15253:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc8fc0a5179960558 00000100:00080000:1.0:1787780050.027699:0:15253:0:(import.c:65:import_set_state_nolock()) ffff9c0481217800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1787780050.028051:0:15253:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c0481210000): rc 0 00000020:00000080:1.0:1787780050.028055:0:15253:0:(genops.c:885:class_export_put()) final put ffff9c0481210000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:1.0:1787780050.028069:0:15253:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9c0345e52000), last request at 1787780047 00000020:00000080:1.0:1787780050.028081:0:15253:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc8fc0a5179960439 00000100:00080000:1.0:1787780050.028087:0:15253:0:(import.c:65:import_set_state_nolock()) ffff9c0345e56800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1787780050.028097:0:15253:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c0345e52000): rc 0 00000020:00000080:1.0:1787780050.028099:0:15253:0:(genops.c:885:class_export_put()) final put ffff9c0345e52000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:1.0:1787780050.028104:0:15253:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9c0476701800), last request at 1787779788 00000020:00000080:1.0:1787780050.028106:0:15253:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc8fc0a517996032f 00000100:00080000:1.0:1787780050.028109:0:15253:0:(import.c:65:import_set_state_nolock()) ffff9c0444000000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1787780050.028114:0:15253:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c0476701800): rc 0 00000020:00000080:1.0:1787780050.028116:0:15253:0:(genops.c:885:class_export_put()) final put ffff9c0476701800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:1.0:1787780050.028120:0:15253:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9c046ecd2800), last request at 1787779788 00000020:00000080:1.0:1787780050.028123:0:15253:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc8fc0a51799602f0 00000100:00080000:1.0:1787780050.028126:0:15253:0:(import.c:65:import_set_state_nolock()) ffff9c046da9c800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787780050.028131:0:15253:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000020:00080000:1.0:1787780050.028222:0:15253:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c046ecd2800): rc 0 00000004:00000080:1.0:1787780050.028228:0:15253:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb66b81583ae0 00000100:00080000:1.0:1787780050.028245:0:15253:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1787780050.028248:0:15253:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 3 00000100:00080000:1.0:1787780050.029530:0:15253:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1787780050.029559:0:15253:0:(import.c:65:import_set_state_nolock()) ffff9c0443654000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1787780050.029964:0:15253:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1787780050.029969:0:15253:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 3 00000004:00080000:1.0:1787780050.029988:0:15253:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1787780050.030042:0:15253:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1787780050.030055:0:15253:0:(import.c:65:import_set_state_nolock()) ffff9c0481216800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1787780050.030061:0:15253:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1787780050.030063:0:15253:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 3 00000004:00080000:1.0:1787780050.030076:0:15253:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1787780050.030130:0:15253:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1787780050.030154:0:15253:0:(import.c:65:import_set_state_nolock()) ffff9c0347c9c800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1787780050.030244:0:15253:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9c0445fc3370) has no exports 00010000:00010000:0.0:1787780050.030553:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787780050.030563:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff9c0440030200/0xc8fc0a517996094f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xc8fc0a5179960956 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780050.030573:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0440030200 already unused, calling callback (ffffffffc139ac20) 10000000:00010000:0.0:1787780050.030578:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff9c0440030200/0xc8fc0a517996094f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xc8fc0a5179960956 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780050.030602:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff9c0440030200/0xc8fc0a517996094f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xc8fc0a5179960956 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787780050.030609:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff9c0440030200/0xc8fc0a517996094f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xc8fc0a5179960956 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787780050.030615:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1787780050.030618:0:6500:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1787780050.030620:0:6500:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1787780050.030648:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff9c0440030200/0xc8fc0a517996094f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xc8fc0a5179960956 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780050.030654:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787780050.030682:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff9c0440030200/0xc8fc0a517996094f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xc8fc0a5179960956 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780050.030697:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff9c0440030200/0xc8fc0a517996094f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xc8fc0a5179960956 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780050.030710:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787780050.030714:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff9c044148aa00/0xc8fc0a51799601a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc8fc0a51799601ae expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780050.030719:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c044148aa00 already unused, calling callback (ffffffffc139ac20) 10000000:00010000:0.0:1787780050.030907:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff9c044148aa00/0xc8fc0a51799601a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc8fc0a51799601ae expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780050.030915:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff9c044148aa00/0xc8fc0a51799601a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xc8fc0a51799601ae expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787780050.030922:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff9c044148aa00/0xc8fc0a51799601a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xc8fc0a51799601ae expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787780050.030927:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1787780050.030929:0:6500:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1787780050.030931:0:6500:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1787780050.030946:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff9c044148aa00/0xc8fc0a51799601a7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xc8fc0a51799601ae expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780050.030951:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787780050.030958:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff9c044148aa00/0xc8fc0a51799601a7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xc8fc0a51799601ae expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780050.030964:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff9c044148aa00/0xc8fc0a51799601a7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xc8fc0a51799601ae expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780050.030984:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787780050.030986:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787780050.030988:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787780050.031005:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c03489f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1f575176-36bc-4786-83ee-2fea064a12a9:3642:1874622881645312:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787780050.031075:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787780050.031120:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787780050.031127:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c03489f52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1f575176-36bc-4786-83ee-2fea064a12a9:3642:1874622881645184:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787780050.031149:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787780050.031187:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881645312 00000100:00100000:0.0:1787780050.031194:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881645312 00000100:00100000:0.0:1787780050.031234:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881645184 00000100:00100000:0.0:1787780050.031237:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881645184 00000100:00100000:0.0:1787780050.031254:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787780050.031430:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03489f4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1f575176-36bc-4786-83ee-2fea064a12a9+22:3642:x1874622881645312:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787780050.031444:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787780050.031457:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c044148b400/0xc8fc0a51799601ae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc8fc0a51799601a7 expref: 22 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780050.031470:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787780050.031504:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03489f4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1f575176-36bc-4786-83ee-2fea064a12a9+21:3642:x1874622881645312:12345-0@lo:103:ldlm_bl.0 Request processed in 243us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780050.031512:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787780050.031531:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787780050.031537:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03489f43c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1f575176-36bc-4786-83ee-2fea064a12a9+20:3642:x1874622881645184:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787780050.031545:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787780050.031554:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c0477a71e00/0xc8fc0a5179960956 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc8fc0a517996094f expref: 20 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780050.031570:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787780050.031708:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03489f43c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1f575176-36bc-4786-83ee-2fea064a12a9+19:3642:x1874622881645184:12345-0@lo:103:ldlm_bl.0 Request processed in 170us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780050.031714:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787780050.031822:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c03489f52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1f575176-36bc-4786-83ee-2fea064a12a9:3642:1874622881645184:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787780050.031830:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c03489f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1f575176-36bc-4786-83ee-2fea064a12a9:3642:1874622881645312:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787780050.031882:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477aec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1874622881644800:0@lo:39:umount.0 00000100:00100000:0.0:1787780050.031914:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787780050.031941:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477aeed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1874622881644928:0@lo:9:umount.0 00000100:00100000:0.0:1787780050.031963:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787780050.031980:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0461becf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1874622881645056:0@lo:9:umount.0 00000100:00100000:0.0:1787780050.031998:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787780050.032027:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787780050.032905:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787780050.032931:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881644800 00000100:00100000:3.0:1787780050.032938:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881644800 00000100:00100000:3.0:1787780050.032979:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1787780050.032987:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03489f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1874622881644800:12345-0@lo:39:umount.0 00000020:00000080:3.0:1787780050.033013:0:6518:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc8fc0a517996038a 00000100:00080000:3.0:1787780050.033021:0:6518:0:(import.c:65:import_set_state_nolock()) ffff9c046eecd800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787780050.033042:0:6518:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:3.0:1787780050.033201:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03489f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+3:3640:x1874622881644800:12345-0@lo:39:umount.0 Request processed in 215us (1286us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1787780050.033209:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000020:00000080:3.0:1787780050.033234:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c0481210000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1787780050.033286:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c0345e52000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1787780050.033306:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c0476701800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1787780050.033329:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c0481217800 for lustre-MDT0000 00000020:00000080:3.0:1787780050.033333:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c0345e56800 for lustre-MDT0000 00000020:00000080:3.0:1787780050.033337:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c0444000000 for lustre-MDT0000 00010000:00010000:3.0:1787780050.033355:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787780050.033380:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9c0443654000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1787780050.033388:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477aec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1874622881644800:0@lo:39:umount.0 00000100:00100000:3.0:1787780050.033413:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881644928 00000100:00100000:3.0:1787780050.033418:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881644928 00000100:00100000:3.0:1787780050.033457:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881645056 00000100:00100000:3.0:1787780050.033470:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881645056 00000100:00100000:3.0:1787780050.033493:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787780050.033499:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03489f52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1874622881644928:12345-0@lo:9:umount.0 00000020:00000080:3.0:1787780050.033513:0:8430:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc8fc0a51799604da 00000100:00080000:3.0:1787780050.033518:0:8430:0:(import.c:65:import_set_state_nolock()) ffff9c0341d3a800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787780050.033550:0:8430:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:3.0:1787780050.033628:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03489f52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3640:x1874622881644928:12345-0@lo:9:umount.0 Request processed in 129us (1663us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780050.033635:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787780050.033647:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787780050.033654:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03489f61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1874622881645056:12345-0@lo:9:umount.0 00000020:00000080:3.0:1787780050.033665:0:8430:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc8fc0a517996061c 00000100:00080000:3.0:1787780050.033670:0:8430:0:(import.c:65:import_set_state_nolock()) ffff9c048124c000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787780050.033690:0:8430:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00080000:1.0:1787780050.033871:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787780050.033876:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787780050.034279:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03489f61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3640:x1874622881645056:12345-0@lo:9:umount.0 Request processed in 625us (2280us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780050.034286:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:3.0:1787780050.034323:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9c0481216800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1787780050.034347:0:3640:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1787780050.034350:0:3640:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787780050.034354:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477aeed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1874622881644928:0@lo:9:umount.0 00000100:00080000:3.0:1787780050.034367:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9c0347c9c800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1787780050.034383:0:3640:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1787780050.034385:0:3640:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787780050.034389:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0461becf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1874622881645056:0@lo:9:umount.0 00010000:00010000:3.0:1787780050.034414:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787780050.034419:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1787780050.071878:0:15253:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9c0445fc3370) has no exports 00010000:00010000:3.0:1787780050.076928:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787780050.163218:0:15253:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc8fc0a5179960202 00000020:00000080:1.0:1787780050.163232:0:15253:0:(genops.c:885:class_export_put()) final put ffff9c046dab3800/lustre-QMT0000_UUID 00000020:01000000:1.0:1787780050.163292:0:15253:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1787780050.165726:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c046dab3800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1787780050.165773:0:15253:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787780050.167623:0:15253:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787780050.167638:0:15253:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff9c0451568000) has no exports 00000020:00000080:0.0:1787780050.168121:0:15253:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc8fc0a51799601fb 00000020:00000080:0.0:1787780050.168129:0:15253:0:(genops.c:885:class_export_put()) final put ffff9c0445f5a800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1787780050.168167:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c0445f5a800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1787780050.168190:0:15253:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787780050.168200:0:15253:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1787780050.168203:0:15253:0:(genops.c:885:class_export_put()) final put ffff9c0445f5c800/lustre-QMT0000_UUID 00000020:00000080:0.0:1787780050.168205:0:15253:0:(genops.c:844:class_export_destroy()) destroying export ffff9c0445f5c800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1787780050.168210:0:15253:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000001:00100000:3.0:1787780050.727194:0:9508:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787780050.727205:0:9508:0:(genops.c:885:class_export_put()) final put ffff9c048124a800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1787780050.727237:0:9508:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 781d29bb-23d2-48e3-b16d-c29e52cd5375 00000020:00000080:3.0:1787780050.727240:0:9508:0:(genops.c:885:class_export_put()) final put ffff9c0347e3c000/781d29bb-23d2-48e3-b16d-c29e52cd5375 00000020:00000080:1.0:1787780050.727311:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c048124a800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1787780050.727423:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c0347e3c000/781d29bb-23d2-48e3-b16d-c29e52cd5375 for lustre-OST0001 00000020:00000080:1.0:1787780050.727446:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c048124c000 for lustre-OST0001 00000020:00000080:1.0:1787780050.727451:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c0347e39000 for lustre-OST0001 00000001:00100000:1.0:1787780050.740448:0:8423:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787780050.740457:0:8423:0:(genops.c:885:class_export_put()) final put ffff9c0341d38000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1787780050.740486:0:8423:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 781d29bb-23d2-48e3-b16d-c29e52cd5375 00000020:00000080:1.0:1787780050.740489:0:8423:0:(genops.c:885:class_export_put()) final put ffff9c044963a800/781d29bb-23d2-48e3-b16d-c29e52cd5375 00000020:00000080:3.0:1787780050.743213:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c0341d38000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1787780050.743289:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c044963a800/781d29bb-23d2-48e3-b16d-c29e52cd5375 for lustre-OST0000 00000020:00000080:3.0:1787780050.743320:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c0341d3a800 for lustre-OST0000 00000020:00000080:3.0:1787780050.743324:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c044963f800 for lustre-OST0000 00010000:00010000:3.0:1787780051.101450:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787780051.749404:0:7442:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1787780051.749421:0:7442:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967301 is committed 00000020:00000080:3.0:1787780051.749427:0:7442:0:(genops.c:885:class_export_put()) final put ffff9c046eecd000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1787780051.749456:0:7442:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 25f2eabf-81ed-4798-a9a9-6e0f6dda29ab 00000001:00080000:3.0:1787780051.749463:0:7442:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967300 is committed 00000020:00000080:3.0:1787780051.749466:0:7442:0:(genops.c:885:class_export_put()) final put ffff9c0347d2e800/25f2eabf-81ed-4798-a9a9-6e0f6dda29ab 00000001:00100000:3.0:1787780051.749472:0:7442:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 781d29bb-23d2-48e3-b16d-c29e52cd5375 00000001:00080000:3.0:1787780051.749476:0:7442:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967299 is committed 00000020:00000080:3.0:1787780051.749478:0:7442:0:(genops.c:885:class_export_put()) final put ffff9c0347ce9000/781d29bb-23d2-48e3-b16d-c29e52cd5375 00000020:00000080:1.0:1787780051.749693:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c046eecd000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:1.0:1787780051.749758:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c0347d2e800/25f2eabf-81ed-4798-a9a9-6e0f6dda29ab for lustre-MDT0001 00000020:00000080:1.0:1787780051.749790:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c0347ce9000/781d29bb-23d2-48e3-b16d-c29e52cd5375 for lustre-MDT0001 00000020:00000080:1.0:1787780051.749817:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c046eecd800 for lustre-MDT0001 00000020:00000080:1.0:1787780051.749824:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c0347d2d000 for lustre-MDT0001 00000020:00000080:1.0:1787780051.749828:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c0347ced800 for lustre-MDT0001 00010000:00010000:3.0:1787780052.124611:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787780052.252180:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787780052.252205:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347dae1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881645440:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787780052.252278:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780052.252492:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881645440 00000100:00100000:3.0:1787780052.252502:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881645440 00000100:00100000:3.0:1787780052.252587:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1787780052.252597:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0461befc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881645440:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787780052.252627:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1787780052.252674:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0461befc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881645440:12345-0@lo:13:osp-pre-1-1.0 Request processed in 79us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780052.252681:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00080000:1.0:1787780052.252751:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787780052.252787:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347dae1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881645440:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787780052.262000:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346efda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1f575176-36bc-4786-83ee-2fea064a12a9:3644:1874622881645568:0@lo:400:kworker.0 00000100:00100000:1.0:1787780052.262092:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780052.262154:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347e57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1874622881646080:0@lo:400:kworker.0 00000100:00100000:1.0:1787780052.262183:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780052.262208:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787780052.262214:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347fa9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1874622881645952:0@lo:400:kworker.0 00000100:00100000:1.0:1787780052.262237:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780052.262255:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348a0b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1874622881646464:0@lo:400:kworker.0 00000100:00100000:1.0:1787780052.262273:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780052.262303:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881646080 00000100:00100000:1.0:1787780052.262310:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881646080 00000100:00100000:1.0:1787780052.262374:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881645952 00000100:00100000:1.0:1787780052.262378:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881645952 00000100:00100000:1.0:1787780052.262389:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881646464 00000100:00100000:1.0:1787780052.262392:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881646464 00000100:00100000:1.0:1787780052.262409:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 428 00000100:00100000:1.0:1787780052.262417:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0461bed2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874622881646080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787780052.262478:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0461bed2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874622881646080:12345-0@lo:400:kworker.0 Request processed in 61us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780052.262485:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 428 00000100:00100000:1.0:1787780052.262503:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 429 00000100:00100000:1.0:1787780052.262510:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0461bec780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1874622881646464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787780052.262535:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0461bec780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1874622881646464:12345-0@lo:400:kworker.0 Request processed in 26us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780052.262540:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 429 00000100:00100000:1.0:1787780052.262793:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1787780052.262814:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0461becb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1874622881645952:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1787780052.262820:0:6514:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1787780052.262874:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0461becb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1874622881645952:12345-0@lo:400:kworker.0 Request processed in 60us (637us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787780052.262880:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00080000:1.0:1787780052.262898:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787780052.262923:0:3644:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1787780052.262928:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9c04777a2800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1787780052.262932:0:3644:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:2.0:1787780052.263181:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881645568 00000100:00100000:2.0:1787780052.263186:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881645568 00000100:00100000:2.0:1787780052.263218:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 410 00000100:00100000:2.0:1787780052.263225:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0471770050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+19:3644:x1874622881645568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787780052.263260:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0471770050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f575176-36bc-4786-83ee-2fea064a12a9+19:3644:x1874622881645568:12345-0@lo:400:kworker.0 Request processed in 36us (1169us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780052.263266:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 410 00000100:00100000:3.0:1787780052.263383:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346efe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881645696:0@lo:400:kworker.0 00000100:00100000:3.0:1787780052.263426:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780052.263467:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347e54b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881646208:0@lo:400:kworker.0 00000100:00100000:3.0:1787780052.263491:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780052.263513:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787780052.263519:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0345e76940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874622881645824:0@lo:400:kworker.0 00000100:00100000:3.0:1787780052.263542:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780052.263577:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348a08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1874622881646336:0@lo:400:kworker.0 00000100:00100000:3.0:1787780052.263599:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780052.263625:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881646208 00000100:00100000:3.0:1787780052.263629:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881646208 00000100:00100000:3.0:1787780052.263664:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1787780052.263671:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347dae580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881646208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787780052.263708:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347dae580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881646208:12345-0@lo:400:kworker.0 Request processed in 38us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780052.263714:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00080000:3.0:1787780052.263735:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787780052.263757:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347e54b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881646208:0@lo:400:kworker.0 00000100:00100000:3.0:1787780052.263776:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881645824 00000100:00100000:3.0:1787780052.263779:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881645824 00000100:00100000:3.0:1787780052.263791:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881646336 00000100:00100000:3.0:1787780052.263793:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881646336 00000100:00100000:3.0:1787780052.263802:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1787780052.263806:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347dac780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3641:x1874622881645824:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1787780052.263812:0:6514:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1787780052.263863:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347dac780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3641:x1874622881645824:12345-0@lo:400:kworker.0 Request processed in 54us (319us total) trans 0 rc -107/-107 00000100:00100000:3.0:1787780052.263869:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1787780052.263890:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1787780052.263895:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347daf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3641:x1874622881646336:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1787780052.263900:0:6514:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1787780052.263924:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347daf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3641:x1874622881646336:12345-0@lo:400:kworker.0 Request processed in 28us (324us total) trans 0 rc -107/-107 00000100:00100000:3.0:1787780052.263930:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00080000:3.0:1787780052.263952:0:3641:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1787780052.263955:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9c04777a3800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1787780052.263959:0:3641:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1787780052.263964:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9c04777a3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787780052.263968:0:3641:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 196 00000100:00080000:3.0:1787780052.263974:0:3641:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9c04777a3800 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:3.0:1787780052.264001:0:3641:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c0347dacf00 x1874622881646592/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787780052.264033:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0345e76940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874622881645824:0@lo:400:kworker.0 00000100:00080000:3.0:1787780052.264046:0:3641:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1787780052.264049:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9c0346f69000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1787780052.264052:0:3641:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1787780052.264054:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9c0346f69000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787780052.264057:0:3641:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 233 00000100:00080000:3.0:1787780052.264061:0:3641:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9c0346f69000 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:3.0:1787780052.264075:0:3641:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c0347daf480 x1874622881646720/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787780052.264086:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348a08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1874622881646336:0@lo:400:kworker.0 00000100:00100000:3.0:1787780052.264116:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347dacf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874622881646592:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1787780052.264142:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780052.264158:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347daf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1874622881646720:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1787780052.264175:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780052.264195:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881646592 00000100:00100000:3.0:1787780052.264199:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881646592 00000100:00100000:3.0:1787780052.264209:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881646720 00000100:00100000:3.0:1787780052.264211:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881646720 00000100:00100000:3.0:1787780052.264219:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1787780052.264223:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347dac3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3640:x1874622881646592:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:3.0:1787780052.264235:0:6514:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1787780052.264314:0:12488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1787780052.264320:0:12488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347dae1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3640:x1874622881646720:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:0.0:1787780052.264347:0:12488:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1787780052.264383:0:12488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347dae1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3640:x1874622881646720:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 62us (207us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787780052.264391:0:12488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00080000:0.0:1787780052.264422:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9c0346f69000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787780052.264426:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787780052.264429:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347daf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1874622881646720:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1787780052.265118:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881645696 00000100:00100000:2.0:1787780052.265125:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881645696 00000100:00100000:2.0:1787780052.265165:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1787780052.265172:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347daf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3641:x1874622881645696:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1787780052.265177:0:6517:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1787780052.265218:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347daf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3641:x1874622881645696:12345-0@lo:400:kworker.0 Request processed in 47us (1792us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787780052.265224:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00080000:2.0:1787780052.265255:0:3641:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1787780052.265259:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9c04777a6000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1787780052.265262:0:3641:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1787780052.265266:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9c04777a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787780052.265270:0:3641:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 196 00000100:00080000:2.0:1787780052.265275:0:3641:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9c04777a6000 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:2.0:1787780052.265295:0:3641:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c0348a09680 x1874622881646848/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787780052.265312:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346efe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881645696:0@lo:400:kworker.0 00000100:00100000:0.0:1787780052.265580:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348a09680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1874622881646848:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1787780052.265615:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787780052.266998:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881646848 00000100:00100000:2.0:1787780052.267042:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881646848 00000100:00100000:2.0:1787780052.267099:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1787780052.267107:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477841a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3640:x1874622881646848:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:2.0:1787780052.267128:0:14310:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1787780052.267203:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477841a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3640:x1874622881646848:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 96us (1586us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787780052.267210:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00080000:0.0:1787780052.267451:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9c04777a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787780052.267466:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787780052.267470:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348a09680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1874622881646848:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:1.0:1787780052.276546:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9c04777a2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787780052.276560:0:3644:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 213 00000100:00080000:1.0:1787780052.277700:0:3644:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9c04777a2800 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:1.0:1787780052.277757:0:3644:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c0461bed680 x1874622881646976/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787780052.277783:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347fa9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1874622881645952:0@lo:400:kworker.0 00010000:00080000:1.0:1787780052.277827:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0348a0b840 x1874622881646464/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787780068 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787780052.277918:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348a0b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1874622881646464:0@lo:400:kworker.0 00000100:00100000:1.0:1787780052.277934:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346efda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1f575176-36bc-4786-83ee-2fea064a12a9:3644:1874622881645568:0@lo:400:kworker.0 00010000:00080000:1.0:1787780052.277949:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0347e57480 x1874622881646080/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787780068 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787780052.277958:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347e57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1874622881646080:0@lo:400:kworker.0 00000100:00100000:0.0:1787780052.280112:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0461bed680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1874622881646976:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:0.0:1787780052.280199:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787780052.280269:0:12488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881646976 00000100:00100000:0.0:1787780052.280277:0:12488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881646976 00000100:00100000:0.0:1787780052.280313:0:12488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1787780052.280320:0:12488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347fe9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3640:x1874622881646976:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:0.0:1787780052.280348:0:12488:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1787780052.280391:0:12488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347fe9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3640:x1874622881646976:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 70us (193us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787780052.280398:0:12488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00080000:0.0:1787780052.280437:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9c04777a2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787780052.280443:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787780052.280446:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0461bed680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1874622881646976:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:3.0:1787780052.316120:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347dac3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3640:x1874622881646592:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 51885us (51966us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787780052.316136:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00080000:0.0:1787780052.316733:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9c04777a3800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787780052.316740:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787780052.316745:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347dacf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874622881646592:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1787780052.764250:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347daed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881647104:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787780052.764364:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780052.764797:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881647104 00000100:00100000:3.0:1787780052.764804:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881647104 00000100:00100000:3.0:1787780052.764891:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1787780052.764902:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0461beed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881647104:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787780052.764941:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787780052.765039:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0461beed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881647104:12345-0@lo:13:osp-pre-0-1.0 Request processed in 139us (675us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780052.765048:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1787780052.769725:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347daed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881647104:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1787780053.148404:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787780053.213909:0:13797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787780054.172120:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787780055.196128:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787780055.844928:0:6491:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1787780055.844939:0:6491:0:(genops.c:885:class_export_put()) final put ffff9c046ecd2800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1787780055.845065:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c046ecd2800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:3.0:1787780055.845152:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c046da9c800 for lustre-MDT0000 00010000:00010000:3.0:1787780056.220073:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1787780056.220293:0:15253:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9c0341cbc480 - data ffff9c0479336000/ffff9c0347cb8000 00000020:01000000:1.0:1787780056.220439:0:15253:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9c04459616c0 - data ffff9c047911bca8/ffff9c0476419800 00000001:00000004:1.0:1787780056.232422:0:15253:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000100:00080000:0.0:1787780056.307361:0:15253:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1787780056.307369:0:15253:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 4 00000100:00100000:0.0:1787780056.307384:0:15253:0:(client.c:3163:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9c0477aec000 x1874622881644800/t4294967301(4294967301) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787780060 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787780056.307410:0:15253:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1787780056.309364:0:15253:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1787780056.309371:0:15253:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 4 00000004:00080000:0.0:1787780056.309384:0:15253:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787780056.309387:0:15253:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1787780056.310224:0:8525:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1787780056.310229:0:8525:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:3.0:1787780056.310239:0:8525:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:0.0:1787780056.310895:0:15253:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1787780056.310899:0:15253:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 4 00000004:00080000:0.0:1787780056.310912:0:15253:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787780056.310914:0:15253:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1787780056.311233:0:9896:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1787780056.311237:0:9896:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:2.0:1787780056.311245:0:9896:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:0.0:1787780056.312731:0:15253:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc8fc0a51799601ca 00000020:00000080:0.0:1787780056.312742:0:15253:0:(genops.c:885:class_export_put()) final put ffff9c0445fcd000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787780056.314804:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c0445fcd000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1787780056.319156:0:15253:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc8fc0a51799601df 00000020:00000080:0.0:1787780056.319170:0:15253:0:(genops.c:885:class_export_put()) final put ffff9c0445fce000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1787780056.319557:0:15253:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1787780056.319563:0:15253:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787780056.319571:0:15253:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787780056.319575:0:15253:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff9c0445fc0000) has no exports 00000004:01000000:0.0:1787780056.319751:0:15253:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1787780056.319760:0:15253:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc8fc0a5179960615 00000020:00000080:0.0:1787780056.319765:0:15253:0:(genops.c:885:class_export_put()) final put ffff9c048124e000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787780056.323967:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c0445fce000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1787780056.325397:0:15253:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1787780056.325436:0:15253:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787780056.325461:0:15253:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1787780056.325467:0:15253:0:(genops.c:1558:class_disconnect_exports()) OBD device 28 (ffff9c0476623370) has no exports 00000020:00000080:0.0:1787780056.325476:0:15253:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc8fc0a517996060e 00000020:00000080:0.0:1787780056.325484:0:15253:0:(genops.c:885:class_export_put()) final put ffff9c0347c9c000/lustre-MDT0000-osd_UUID 00010000:01000000:0.0:1787780056.326077:0:15253:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1787780056.326082:0:15253:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1787780056.326093:0:15253:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 5 00000004:00080000:0.0:1787780056.326099:0:15253:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787780056.326102:0:15253:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787780056.326139:0:15253:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787780056.326147:0:15253:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787780056.326157:0:15253:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc8fc0a51799604d3 00000020:00000080:0.0:1787780056.326161:0:15253:0:(genops.c:885:class_export_put()) final put ffff9c04811de000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1787780056.326166:0:15253:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1787780056.326169:0:15253:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787780056.326174:0:15253:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1787780056.326177:0:15253:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff9c0477a18000) has no exports 00000020:00000080:0.0:1787780056.326181:0:15253:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc8fc0a51799604cc 00000020:00000080:0.0:1787780056.326184:0:15253:0:(genops.c:885:class_export_put()) final put ffff9c0481212000/lustre-MDT0000-osd_UUID 00010000:01000000:0.0:1787780056.326515:0:15253:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1787780056.326519:0:15253:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1787780056.326521:0:15253:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 5 00000004:00080000:0.0:1787780056.326524:0:15253:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787780056.326526:0:15253:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787780056.326559:0:15253:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787780056.326565:0:15253:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:0.0:1787780056.326578:0:15253:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:0.0:1787780056.326583:0:15253:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc8fc0a5179960383 00000020:00000080:0.0:1787780056.326588:0:15253:0:(genops.c:885:class_export_put()) final put ffff9c0444088800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1787780056.326592:0:15253:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:0.0:1787780056.326595:0:15253:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787780056.326599:0:15253:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1787780056.326609:0:15253:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9c044313b370) has no exports 00000020:00000080:0.0:1787780056.326613:0:15253:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc8fc0a517996037c 00000020:00000080:0.0:1787780056.326617:0:15253:0:(genops.c:885:class_export_put()) final put ffff9c0443655000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787780056.327178:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c048124e000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1787780056.327188:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c0347c9c000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1787780056.327193:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c0347c9c800 for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1787780056.327200:0:8:0:(genops.c:885:class_export_put()) final put ffff9c0481217000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787780056.327202:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c0481217000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:2.0:1787780056.327206:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787780056.327286:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c04811de000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1787780056.327291:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c0481212000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1787780056.327307:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c0481216800 for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1787780056.327311:0:8:0:(genops.c:885:class_export_put()) final put ffff9c0481211800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787780056.327313:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c0481211800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1787780056.327317:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787780056.327344:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c0444088800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:2.0:1787780056.327349:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c0443655000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1787780056.353010:0:15253:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:0.0:1787780056.353018:0:15253:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1787780056.353023:0:15253:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 5 00000100:00100000:0.0:1787780056.353031:0:15253:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787780056.353172:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c0443654000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1787780056.353513:0:15253:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787780056.353526:0:15253:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787780056.353532:0:15253:0:(genops.c:885:class_export_put()) final put ffff9c046da99000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787780056.353545:0:15253:0:(genops.c:844:class_export_destroy()) destroying export ffff9c046da99000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:0.0:1787780056.353556:0:15253:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787780056.353660:0:15253:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787780056.353665:0:15253:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787780056.353668:0:15253:0:(genops.c:885:class_export_put()) final put ffff9c0450071800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787780056.353670:0:15253:0:(genops.c:844:class_export_destroy()) destroying export ffff9c0450071800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1787780056.353675:0:15253:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787780056.353726:0:15253:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc8fc0a51799601e6 00000020:00000080:0.0:1787780056.353734:0:15253:0:(genops.c:885:class_export_put()) final put ffff9c0445fcb000/lustre-MDD0000_UUID 00000020:01000000:0.0:1787780056.353791:0:15253:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1787780056.353795:0:15253:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787780056.353800:0:15253:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787780056.353803:0:15253:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff9c0445fc19b8) has no exports 00000020:00000080:0.0:1787780056.353819:0:15253:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787780056.353822:0:15253:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1787780056.353826:0:15253:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc8fc0a51799601ed 00000020:00000080:0.0:1787780056.353830:0:15253:0:(genops.c:885:class_export_put()) final put ffff9c0445fc8000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787780056.360594:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c0445fcb000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1787780056.360607:0:8:0:(genops.c:885:class_export_put()) final put ffff9c0445fce800/lustre-MDD0000_UUID 00000020:00000080:3.0:1787780056.360610:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c0445fce800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1787780056.360620:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:3.0:1787780056.363376:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c0445fc8000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000004:0.0:1787780056.363442:0:15253:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c044407a000 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1787780056.363447:0:15253:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c044407a000 3 00000020:01000004:0.0:1787780056.363450:0:15253:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9c044407a000 from lustre-MDT0000 00000020:00000080:0.0:1787780056.363477:0:15253:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787780056.363501:0:15253:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1787780056.363506:0:15253:0:(genops.c:885:class_export_put()) final put ffff9c0445fcd800/lustre-MDT0000_UUID 00000020:00000080:0.0:1787780056.363509:0:15253:0:(genops.c:844:class_export_destroy()) destroying export ffff9c0445fcd800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1787780056.363517:0:15253:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1787780056.363589:0:15253:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:0.0:1787780056.363594:0:15253:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1787780056.363596:0:15253:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1787780056.363600:0:15253:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787780056.363604:0:15253:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787780056.363610:0:15253:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff9c046c8b2000 1f575176-36bc-4786-83ee-2fea064a12a9 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787780056.363616:0:15253:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff9c0450ce8000) has exports, disconnecting them 00000020:00080000:0.0:1787780056.363620:0:15253:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9c046c8b2000), last request at 1787779771 00000020:00000080:0.0:1787780056.363635:0:15253:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc8fc0a517996018b 00000020:00010000:0.0:1787780056.363641:0:15253:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9c046c8b2000: total 0 00000100:00080000:0.0:1787780056.363645:0:15253:0:(import.c:65:import_set_state_nolock()) ffff9c0444000800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1787780056.363666:0:15253:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c046c8b2000): rc 0 00000020:00080000:0.0:1787780056.363671:0:15253:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff9c0450ce8000) has no exports 00000020:00010000:3.0:1787780056.363711:0:6501:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9c046c8b2000: total 0 00010000:00010000:3.0:1787780056.363747:0:6501:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9c046c8b2000, canceled 0 locks, left on hash table 13. 00010000:00010000:3.0:1787780056.363785:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c0346dd7200/0xc8fc0a51799606c4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc8fc0a51799606bd expref: 14 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780056.363803:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c0477a71200/0xc8fc0a51799606d2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc8fc0a51799606cb expref: 13 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780056.363814:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c04427db000/0xc8fc0a5179960287 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc8fc0a5179960280 expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787780056.363833:0:6507:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9c0447d2e600:6507] 2 exiting: rc = 0 00010000:00010000:3.0:1787780056.363856:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c04427dac00/0xc8fc0a5179960295 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc8fc0a517996028e expref: 11 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780056.363869:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c0477a70000/0xc8fc0a517996092c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc8fc0a5179960925 expref: 10 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780056.363878:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c0477a71c00/0xc8fc0a517996093a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc8fc0a5179960933 expref: 9 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780056.363899:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c04766dc800/0xc8fc0a517996069a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc8fc0a5179960693 expref: 8 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780056.363909:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c0477a70400/0xc8fc0a5179960948 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc8fc0a5179960941 expref: 7 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780056.363919:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c044148a400/0xc8fc0a51799605ac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc8fc0a51799605a5 expref: 6 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780056.363931:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c04766dde00/0xc8fc0a51799606fc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc8fc0a51799606f5 expref: 5 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780056.363940:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c0346dd7800/0xc8fc0a517996068c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc8fc0a5179960685 expref: 4 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787780056.363948:0:6506:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9c0444f40000:6506] 1 exiting: rc = 0 00010000:00010000:3.0:1787780056.363950:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c0346dd6c00/0xc8fc0a51799606a8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc8fc0a51799606a1 expref: 3 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780056.363959:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c0346dd6800/0xc8fc0a51799606b6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc8fc0a51799606af expref: 2 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780056.363970:0:6501:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9c046c8b2000, canceled 13 locks, left on hash table 0. 00000020:00000080:3.0:1787780056.363983:0:6501:0:(genops.c:885:class_export_put()) final put ffff9c046c8b2000/1f575176-36bc-4786-83ee-2fea064a12a9 00010000:00010000:3.0:1787780056.363993:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787780056.363994:0:6505:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9c04618e5a00:6505] 0 exiting: rc = 1 00010000:00010000:3.0:1787780056.363995:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787780056.363997:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787780056.364003:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c046c8b2000/1f575176-36bc-4786-83ee-2fea064a12a9 for MGS 00000020:00000080:3.0:1787780056.364025:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c0444000800 for MGS 00000100:00100000:2.0:1787780056.445954:0:15253:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780056.445965:0:15253:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780056.445971:0:15253:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780056.445977:0:15253:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780056.445982:0:15253:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780056.445987:0:15253:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780056.445992:0:15253:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780056.445997:0:15253:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780056.446002:0:15253:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780056.446007:0:15253:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780056.446013:0:15253:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780056.446019:0:15253:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780056.446024:0:15253:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780056.446029:0:15253:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780056.446035:0:15253:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780056.446041:0:15253:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780056.446046:0:15253:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780056.446052:0:15253:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780056.446057:0:15253:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780056.446063:0:15253:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780056.446079:0:15253:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780056.446086:0:15253:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780056.446093:0:15253:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780056.446099:0:15253:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780056.446104:0:15253:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780056.446110:0:15253:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780056.446115:0:15253:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780056.446121:0:15253:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780056.446127:0:15253:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780056.446141:0:15253:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780056.446148:0:15253:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780056.446154:0:15253:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780056.446159:0:15253:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780056.446183:0:15253:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780056.446189:0:15253:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780056.446195:0:15253:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780056.446200:0:15253:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780056.446206:0:15253:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780056.446212:0:15253:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780056.446219:0:15253:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780056.446223:0:15253:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780056.446228:0:15253:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780056.446233:0:15253:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780056.446239:0:15253:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780056.446244:0:15253:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780056.446249:0:15253:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780056.446255:0:15253:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780056.446260:0:15253:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780056.446265:0:15253:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780056.446271:0:15253:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780056.446277:0:15253:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780056.446281:0:15253:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780056.446286:0:15253:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780056.446291:0:15253:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780056.446307:0:15253:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780056.446313:0:15253:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780056.446318:0:15253:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780056.446324:0:15253:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780056.446331:0:15253:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780056.446343:0:15253:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780056.446350:0:15253:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780056.446359:0:15253:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780056.446364:0:15253:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780056.446370:0:15253:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:2.0:1787780056.448449:0:15253:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9c0347a2f960 - data ffff9c04793290d8/ffff9c0347a7a400 00000020:01000000:2.0:1787780056.448574:0:15253:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9c045a925a80 - data ffff9c047900ea20/ffff9c0442d5b000 00000020:00000080:2.0:1787780056.449233:0:15253:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc8fc0a517996016f 00000020:00000080:2.0:1787780056.449251:0:15253:0:(genops.c:885:class_export_put()) final put ffff9c0444078800/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1787780056.449266:0:15253:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c044407a000 from MGS, refs=2 00000020:01000004:2.0:1787780056.449270:0:15253:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c044407a000 2 00000020:01000004:2.0:1787780056.449272:0:15253:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9c044407a000 from MGS 00000020:00000080:2.0:1787780056.449303:0:15253:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787780056.449310:0:15253:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1787780056.449313:0:15253:0:(genops.c:885:class_export_put()) final put ffff9c0444078000/MGS 00000020:00000080:2.0:1787780056.449315:0:15253:0:(genops.c:844:class_export_destroy()) destroying export ffff9c0444078000/MGS for MGS 00000020:01000000:2.0:1787780056.449322:0:15253:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:00000080:3.0:1787780056.449391:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c0444078800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1787780056.449623:0:15253:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1787780056.449628:0:15253:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787780056.449633:0:15253:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787780056.449640:0:15253:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9c0445f83800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787780056.449645:0:15253:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff9c0450ceb370) has exports, disconnecting them 00000020:00080000:2.0:1787780056.449650:0:15253:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9c0445f83800), last request at 1787779771 00000020:00000080:2.0:1787780056.449655:0:15253:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc8fc0a517996023a 00000020:00080000:2.0:1787780056.449666:0:15253:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c0445f83800): rc 0 00000020:00000080:2.0:1787780056.449670:0:15253:0:(genops.c:885:class_export_put()) final put ffff9c0445f83800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1787780056.450063:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c0445f83800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1787780056.458976:0:15253:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1787780056.458984:0:15253:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787780056.458988:0:15253:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787780056.458995:0:15253:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787780056.463673:0:15253:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787780056.463697:0:15253:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1787780056.463707:0:15253:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c044407a000 1 00000020:00000080:2.0:1787780056.463713:0:15253:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc8fc0a5179960161 00000020:00000080:2.0:1787780056.465005:0:15253:0:(genops.c:885:class_export_put()) final put ffff9c044407f800/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1787780056.465017:0:15253:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1787780056.465022:0:15253:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787780056.465028:0:15253:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787780056.465031:0:15253:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff9c045156b370) has no exports 00000020:00000080:2.0:1787780056.485911:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c0445f86800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1787780056.485933:0:36:0:(genops.c:885:class_export_put()) final put ffff9c0445f81000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1787780056.485937:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c0445f81000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1787780056.485946:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:2.0:1787780056.486080:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c044407f800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1787780056.523464:0:15253:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787780056.523479:0:15253:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1787780056.523485:0:15253:0:(genops.c:885:class_export_put()) final put ffff9c0450073800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787780056.523490:0:15253:0:(genops.c:844:class_export_destroy()) destroying export ffff9c0450073800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1787780056.523495:0:15253:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1787780056.523678:0:15253:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9c044407a800 00000020:02000400:2.0:1787780056.523739:0:15253:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:3.0:1787780057.244209:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787780057.372402:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787780057.372410:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787780057.372414:0:36:0:(import.c:65:import_set_state_nolock()) ffff9c04777a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787780057.372422:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 460 00000100:00080000:1.0:1787780057.372428:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787780057.372436:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9c04777a6000 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:1.0:1787780057.372465:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c0461becf00 x1874622881647360/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787780057.372488:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787780057.372491:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787780057.372493:0:36:0:(import.c:65:import_set_state_nolock()) ffff9c04777a3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787780057.372497:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 460 00000100:00080000:1.0:1787780057.372500:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787780057.372503:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9c04777a3800 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:1.0:1787780057.372517:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c0347fa9680 x1874622881647488/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787780057.372525:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787780057.372552:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787780057.372554:0:36:0:(import.c:65:import_set_state_nolock()) ffff9c04777a2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787780057.372558:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 460 00000100:00080000:1.0:1787780057.372561:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787780057.372564:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9c04777a2800 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:1.0:1787780057.372578:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c047785ed00 x1874622881647616/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787780057.372611:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787780057.372615:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787780057.372616:0:36:0:(import.c:65:import_set_state_nolock()) ffff9c0346f69000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787780057.372619:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 460 00000100:00080000:1.0:1787780057.372622:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787780057.372624:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9c0346f69000 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:1.0:1787780057.372635:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c03488e0b40 x1874622881648000/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787780057.372688:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0461becf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1874622881647360:0@lo:38:kworker.0 00000100:00100000:1.0:1787780057.372753:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780057.372814:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347fa9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874622881647488:0@lo:38:kworker.0 00000100:00100000:1.0:1787780057.372856:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780057.372881:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047785ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1874622881647616:0@lo:38:kworker.0 00000100:00100000:1.0:1787780057.372903:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780057.372918:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c03488e0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1874622881648000:0@lo:38:kworker.0 00000100:00100000:1.0:1787780057.372939:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780057.372974:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c03488e2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881647872:0@lo:400:kworker.0 00000100:00100000:1.0:1787780057.373011:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780057.373031:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787780057.373037:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c03488e3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1874622881648128:0@lo:400:kworker.0 00000100:00100000:1.0:1787780057.373064:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780057.373097:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881647360 00000100:00100000:1.0:1787780057.373104:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881647360 00000100:00100000:1.0:1787780057.373134:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1787780057.373141:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03488e3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3640:x1874622881647360:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1787780057.373171:0:6518:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787780057.373211:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03488e3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3640:x1874622881647360:12345-0@lo:38:kworker.0 Request processed in 68us (456us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787780057.373218:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1787780057.373239:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881647488 00000100:00100000:1.0:1787780057.373242:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881647488 00000100:00100000:1.0:1787780057.373256:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881647616 00000100:00100000:1.0:1787780057.373258:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881647616 00000100:00100000:1.0:1787780057.373266:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881648000 00000100:00100000:1.0:1787780057.373268:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881648000 00000100:00100000:1.0:1787780057.373275:0:7821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881648128 00000100:00100000:1.0:1787780057.373277:0:7821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881648128 00000100:00100000:1.0:1787780057.373319:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 430 00000100:00100000:1.0:1787780057.373325:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03488e1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1874622881648128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787780057.373366:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03488e1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1874622881648128:12345-0@lo:400:kworker.0 Request processed in 41us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780057.373373:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 430 00000100:00100000:1.0:1787780057.373386:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1787780057.373390:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03488e0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3640:x1874622881647488:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1787780057.373400:0:7821:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787780057.373433:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03488e0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3640:x1874622881647488:12345-0@lo:38:kworker.0 Request processed in 41us (593us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787780057.373439:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1787780057.373451:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1787780057.373455:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03488e30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3640:x1874622881647616:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1787780057.373464:0:7821:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787780057.373486:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03488e30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3640:x1874622881647616:12345-0@lo:38:kworker.0 Request processed in 30us (583us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787780057.373492:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1787780057.373503:0:7821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1787780057.373506:0:7821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03488e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3640:x1874622881648000:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1787780057.373515:0:7821:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787780057.373539:0:7821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03488e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3640:x1874622881648000:12345-0@lo:38:kworker.0 Request processed in 31us (600us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787780057.373544:0:7821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00010000:00080000:1.0:1787780057.373582:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff9c03488e3840 x1874622881648128/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787780073 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787780057.373594:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c03488e3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1874622881648128:0@lo:400:kworker.0 00000100:00080000:1.0:1787780057.373621:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9c04777a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787780057.373626:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787780057.373629:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0461becf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1874622881647360:0@lo:38:kworker.0 00000100:00080000:1.0:1787780057.373637:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9c04777a3800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787780057.373640:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787780057.373643:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347fa9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874622881647488:0@lo:38:kworker.0 00000100:00080000:1.0:1787780057.373660:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9c04777a2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787780057.373664:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787780057.373666:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047785ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1874622881647616:0@lo:38:kworker.0 00000100:00080000:1.0:1787780057.373673:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9c0346f69000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787780057.373675:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787780057.373678:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c03488e0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1874622881648000:0@lo:38:kworker.0 00000100:00100000:3.0:1787780057.374167:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881647872 00000100:00100000:3.0:1787780057.374172:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881647872 00000100:00100000:3.0:1787780057.374209:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1787780057.374217:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03488e2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881647872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787780057.374260:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03488e2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881647872:12345-0@lo:400:kworker.0 Request processed in 45us (1248us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780057.374267:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00080000:3.0:1787780057.374296:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787780057.374301:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787780057.374327:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c03488e2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881647872:0@lo:400:kworker.0 00000100:00100000:0.0:1787780057.374463:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047785fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1874622881647744:0@lo:400:kworker.0 00000100:00100000:0.0:1787780057.374496:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787780057.374536:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347dacb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874622881648384:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787780057.374561:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787780057.374579:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1787780057.374585:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0461bed680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1f575176-36bc-4786-83ee-2fea064a12a9:3642:1874622881647232:0@lo:400:kworker.0 00000400:00000100:0.0:1787780057.374604:0:3642:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874622881647232 offset 0 length 224: 4 00000100:00100000:0.0:1787780057.374622:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c03488e21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874622881648256:0@lo:400:kworker.0 00000100:00100000:0.0:1787780057.374654:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787780057.374872:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881647744 00000100:00100000:2.0:1787780057.374877:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881647744 00000100:00100000:2.0:1787780057.374923:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 431 00000100:00100000:2.0:1787780057.374930:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347fe83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1874622881647744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787780057.374971:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347fe83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1874622881647744:12345-0@lo:400:kworker.0 Request processed in 42us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780057.374977:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 431 00010000:00080000:2.0:1787780057.375012:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff9c047785fc00 x1874622881647744/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787780073 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787780057.375022:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047785fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1874622881647744:0@lo:400:kworker.0 00000100:00100000:3.0:1787780057.375248:0:8529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881648384 00000100:00100000:3.0:1787780057.375252:0:8529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881648384 00000100:00100000:3.0:1787780057.375298:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1787780057.375306:0:8529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347fea1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1874622881648384:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787780057.375330:0:8529:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1787780057.375371:0:8529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347fea1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1874622881648384:12345-0@lo:13:osp-pre-1-1.0 Request processed in 67us (809us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780057.375377:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1787780057.375395:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881648256 00000100:00100000:3.0:1787780057.375399:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881648256 00000100:00100000:3.0:1787780057.375422:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1787780057.375429:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347fe8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1874622881648256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787780057.375469:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347fe8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1874622881648256:12345-0@lo:400:kworker.0 Request processed in 40us (814us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780057.375475:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1787780057.375518:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c03488e21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874622881648256:0@lo:400:kworker.0 00000100:00100000:3.0:1787780057.375547:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347dacb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874622881648384:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1787780057.376407:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787780057.376413:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787780057.895592:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787780057.895614:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348a0b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881648512:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787780057.895688:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787780057.895756:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881648512 00000100:00100000:2.0:1787780057.895763:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881648512 00000100:00100000:2.0:1787780057.895811:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1787780057.895820:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0348a0ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881648512:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787780057.895893:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787780057.895940:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0348a0ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881648512:12345-0@lo:13:osp-pre-0-1.0 Request processed in 120us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780057.895948:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1787780057.895993:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348a0b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881648512:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1787780058.269095:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787780059.291957:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787780060.315975:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787780061.341002:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787780061.946025:0:15455:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1787780061.966729:0:15455:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:0.0:1787780061.966804:0:15455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c04766dce00/0xc8fc0a51799606bd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a51799606c4 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780061.966821:0:15455:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c04766dce00/0xc8fc0a51799606bd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xc8fc0a51799606c4 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780061.966829:0:15455:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c04766dce00/0xc8fc0a51799606bd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xc8fc0a51799606c4 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780061.966867:0:15455:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.131@tcp lock: ffff9c04766dce00/0xc8fc0a51799606bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xc8fc0a51799606c4 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780061.966890:0:15455:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787780061.966898:0:15455:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1787780061.966932:0:15455:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787780061.966937:0:15455:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1787780061.966944:0:15455:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787780061.966951:0:15455:0:(import.c:65:import_set_state_nolock()) ffff9c04777a3800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:0.0:1787780061.966957:0:15455:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787780061.966959:0:15455:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1787780061.966962:0:15455:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1787780061.967609:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787780061.967621:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff9c04766dce00/0xc8fc0a51799606bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xc8fc0a51799606c4 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780061.967631:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c04766dce00 already unused, calling callback (ffffffffc139ac20) 10000000:00010000:3.0:1787780061.967636:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff9c04766dce00/0xc8fc0a51799606bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xc8fc0a51799606c4 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780061.967646:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff9c04766dce00/0xc8fc0a51799606bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xc8fc0a51799606c4 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787780061.967654:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff9c04766dce00/0xc8fc0a51799606bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xc8fc0a51799606c4 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787780061.967660:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787780061.967663:0:6501:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1787780061.967666:0:6501:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1787780061.967718:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff9c04766dce00/0xc8fc0a51799606bd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xc8fc0a51799606c4 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780061.967725:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787780061.967757:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff9c04766dce00/0xc8fc0a51799606bd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xc8fc0a51799606c4 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780061.967765:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff9c04766dce00/0xc8fc0a51799606bd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xc8fc0a51799606c4 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780061.967804:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787780061.967807:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787780061.967808:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787780061.967831:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347dacb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1f575176-36bc-4786-83ee-2fea064a12a9:3644:1874622881648640:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787780061.967955:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780061.968046:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881648640 00000100:00100000:3.0:1787780061.968054:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881648640 00000100:00100000:3.0:1787780061.968103:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787780061.968111:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347dada40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3644:x1874622881648640:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1787780061.968119:0:6497:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787780061 with bad export cookie 14482461846765175179 00010000:00010000:0.0:1787780061.970395:0:15455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c04766dd000/0xc8fc0a51799606cb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a51799606d2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780061.970615:0:15455:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c04766dd000/0xc8fc0a51799606cb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xc8fc0a51799606d2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780061.970624:0:15455:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c04766dd000/0xc8fc0a51799606cb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xc8fc0a51799606d2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780061.970651:0:15455:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.131@tcp lock: ffff9c04766dd000/0xc8fc0a51799606cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xc8fc0a51799606d2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780061.970689:0:15455:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787780061.970697:0:15455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c044148a000/0xc8fc0a51799605a5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a51799605ac expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780061.970704:0:15455:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c044148a000/0xc8fc0a51799605a5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc8fc0a51799605ac expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780061.970710:0:15455:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c044148a000/0xc8fc0a51799605a5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc8fc0a51799605ac expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780061.970716:0:15455:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.131@tcp lock: ffff9c044148a000/0xc8fc0a51799605a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc8fc0a51799605ac expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780061.970731:0:15455:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787780061.970757:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787780061.970766:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff9c04766dd000/0xc8fc0a51799606cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xc8fc0a51799606d2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780061.970773:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c04766dd000 already unused, calling callback (ffffffffc139ac20) 10000000:00010000:0.0:1787780061.970777:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff9c04766dd000/0xc8fc0a51799606cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xc8fc0a51799606d2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780061.970786:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff9c04766dd000/0xc8fc0a51799606cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xc8fc0a51799606d2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787780061.970793:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff9c04766dd000/0xc8fc0a51799606cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xc8fc0a51799606d2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787780061.970807:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787780061.970810:0:6500:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 00010000:00010000:0.0:1787780061.970887:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff9c04766dd000/0xc8fc0a51799606cb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xc8fc0a51799606d2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780061.970894:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787780061.971985:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff9c04766dd000/0xc8fc0a51799606cb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xc8fc0a51799606d2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780061.972000:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff9c04766dd000/0xc8fc0a51799606cb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xc8fc0a51799606d2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780061.972017:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787780061.972022:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff9c044148a000/0xc8fc0a51799605a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc8fc0a51799605ac expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780061.972029:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c044148a000 already unused, calling callback (ffffffffc139ac20) 10000000:00010000:0.0:1787780061.972033:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff9c044148a000/0xc8fc0a51799605a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc8fc0a51799605ac expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780061.972041:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff9c044148a000/0xc8fc0a51799605a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xc8fc0a51799605ac expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787780061.972048:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff9c044148a000/0xc8fc0a51799605a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xc8fc0a51799605ac expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787780061.972054:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1787780061.972056:0:6500:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1787780061.972059:0:6500:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1787780061.972100:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff9c044148a000/0xc8fc0a51799605a5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc8fc0a51799605ac expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780061.972107:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787780061.972117:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff9c044148a000/0xc8fc0a51799605a5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc8fc0a51799605ac expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780061.972124:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff9c044148a000/0xc8fc0a51799605a5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc8fc0a51799605ac expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780061.972140:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787780061.972141:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787780061.972144:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787780061.972169:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346cfd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1f575176-36bc-4786-83ee-2fea064a12a9:3641:1874622881648768:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787780061.973988:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346cfcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1f575176-36bc-4786-83ee-2fea064a12a9:3642:1874622881648896:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787780061.974084:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780061.974185:0:7921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881648896 00000100:00100000:1.0:1787780061.974194:0:7921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881648896 00000100:00100000:1.0:1787780061.974245:0:7921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787780061.974265:0:7921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03488e0b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3642:x1874622881648896:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1787780061.974274:0:7921:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787780061 with bad export cookie 14482461846765175179 00000100:00100000:1.0:1787780061.974331:0:7921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03488e0b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3642:x1874622881648896:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (247us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787780061.974339:0:7921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:1.0:1787780061.974385:0:3642:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.131@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1787780061.974391:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9c0450075800 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1787780061.974395:0:3642:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.131@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00100000:0.0:1787780061.974632:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787780061.974691:0:15455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c0477a70800/0xc8fc0a5179960941 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a5179960948 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780061.974704:0:15455:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c0477a70800/0xc8fc0a5179960941 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc8fc0a5179960948 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780061.974712:0:15455:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c0477a70800/0xc8fc0a5179960941 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xc8fc0a5179960948 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780061.974719:0:15455:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.131@tcp lock: ffff9c0477a70800/0xc8fc0a5179960941 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xc8fc0a5179960948 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780061.974749:0:15455:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787780061.974757:0:15455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c04427db800/0xc8fc0a517996028e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a5179960295 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780061.974788:0:15455:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c04427db800/0xc8fc0a517996028e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc8fc0a5179960295 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780061.974794:0:15455:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c04427db800/0xc8fc0a517996028e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc8fc0a5179960295 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780061.974800:0:15455:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.131@tcp lock: ffff9c04427db800/0xc8fc0a517996028e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc8fc0a5179960295 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780061.974813:0:15455:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1787780061.974818:0:15455:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 10000000:01000000:0.0:1787780061.974823:0:15455:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00010000:00010000:0.0:1787780061.974883:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787780061.974890:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff9c0477a70800/0xc8fc0a5179960941 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xc8fc0a5179960948 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780061.974897:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0477a70800 already unused, calling callback (ffffffffc139ac20) 10000000:00010000:0.0:1787780061.974900:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff9c0477a70800/0xc8fc0a5179960941 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xc8fc0a5179960948 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780061.974909:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff9c0477a70800/0xc8fc0a5179960941 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xc8fc0a5179960948 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787780061.974917:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff9c0477a70800/0xc8fc0a5179960941 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xc8fc0a5179960948 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787780061.974923:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1787780061.974925:0:6500:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1787780061.974927:0:6500:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1787780061.986937:0:7453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787780061.986956:0:7453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff9c04427db800/0xc8fc0a517996028e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc8fc0a5179960295 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780061.986972:0:7453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c04427db800 already unused, calling callback (ffffffffc139ac20) 10000000:00010000:2.0:1787780061.986977:0:7453:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff9c04427db800/0xc8fc0a517996028e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc8fc0a5179960295 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780061.986989:0:7453:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff9c04427db800/0xc8fc0a517996028e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xc8fc0a5179960295 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787780061.986997:0:7453:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff9c04427db800/0xc8fc0a517996028e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xc8fc0a5179960295 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787780061.987003:0:7453:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1787780061.987006:0:7453:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1787780061.987011:0:7453:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1787780061.990265:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787780061.990462:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347dada40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3644:x1874622881648640:12345-0@lo:103:ldlm_bl.0 Request processed in 22342us (22500us total) trans 0 rc -107/-107 00000100:00100000:3.0:1787780061.990477:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:3.0:1787780061.990549:0:3644:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.131@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1787780062.008475:0:3642:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.131@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1787780062.008484:0:3642:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1787780062.008497:0:3642:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c0461bed680 x1874622881647232/t0(0) o400->MGC192.168.203.131@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787780073 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787780062.008514:0:3642:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c0347dacb40 x1874622881648640/t0(0) o103->MGC192.168.203.131@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787780077 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787780062.008555:0:3642:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c0346cfd2c0 x1874622881648768/t0(0) o103->MGC192.168.203.131@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787780077 ref 1 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787780062.008579:0:3642:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c0346cfcb40 x1874622881648896/t0(0) o103->MGC192.168.203.131@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787780077 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1787780062.008589:0:3642:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1787780062.008593:0:3642:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1787780062.008594:0:3642:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00010000:00010000:0.0:1787780062.009302:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff9c0477a70800/0xc8fc0a5179960941 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xc8fc0a5179960948 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780062.009317:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787780062.009343:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff9c0477a70800/0xc8fc0a5179960941 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xc8fc0a5179960948 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780062.009352:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff9c0477a70800/0xc8fc0a5179960941 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xc8fc0a5179960948 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780062.009377:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787780062.009379:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787780062.009382:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787780062.009550:0:15455:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0001 00000020:01000000:0.0:1787780062.009556:0:15455:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:0.0:1787780062.009562:0:15455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787780062.009569:0:15455:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:0.0:1787780062.009575:0:15455:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff9c0346bcb800 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787780062.009582:0:15455:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff9c0341d3b000 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787780062.009587:0:15455:0:(genops.c:1553:class_disconnect_exports()) OBD device 11 (ffff9c04716e4d28) has exports, disconnecting them 00000020:00080000:0.0:1787780062.009593:0:15455:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9c0346bcb800), last request at 1787780057 00000020:00000080:0.0:1787780062.009601:0:15455:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc8fc0a517996056d 00000100:00080000:0.0:1787780062.009620:0:15455:0:(import.c:65:import_set_state_nolock()) ffff9c0346bca000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1787780062.009668:0:15455:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c0346bcb800): rc 0 00000020:00000080:0.0:1787780062.009671:0:15455:0:(genops.c:885:class_export_put()) final put ffff9c0346bcb800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:0.0:1787780062.009679:0:15455:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9c0341d3b000), last request at 1787780057 00000020:00000080:0.0:1787780062.009683:0:15455:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc8fc0a5179960447 00000100:00080000:0.0:1787780062.009688:0:15455:0:(import.c:65:import_set_state_nolock()) ffff9c0341d3e000 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1787780062.009700:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1787780062.009707:0:15455:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c0341d3b000): rc 0 00000020:00000080:0.0:1787780062.009720:0:15455:0:(genops.c:885:class_export_put()) final put ffff9c0341d3b000/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:0.0:1787780062.009730:0:15455:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffb66b81577ae0 00000100:00080000:0.0:1787780062.009754:0:15455:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787780062.009759:0:15455:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 3 00000100:00080000:0.0:1787780062.010611:0:15455:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787780062.010619:0:15455:0:(import.c:65:import_set_state_nolock()) ffff9c04777a6000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00100000:0.0:1787780062.011369:0:7921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881648768 00000100:00100000:0.0:1787780062.011384:0:7921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881648768 00000100:00100000:0.0:1787780062.011467:0:7921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787780062.011476:0:7921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0461978450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3641:x1874622881648768:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1787780062.011484:0:7921:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787780061 with bad export cookie 14482461846765175179 00000100:00100000:0.0:1787780062.011798:0:7921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0461978450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3641:x1874622881648768:12345-0@lo:103:ldlm_bl.0 Request processed in 320us (37165us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787780062.011808:0:7921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:2.0:1787780062.012689:0:7453:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff9c04427db800/0xc8fc0a517996028e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc8fc0a5179960295 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780062.012706:0:7453:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787780062.012728:0:7453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff9c04427db800/0xc8fc0a517996028e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc8fc0a5179960295 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780062.012758:0:7453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff9c04427db800/0xc8fc0a517996028e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc8fc0a5179960295 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780062.012783:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787780062.012786:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787780062.012788:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787780062.013022:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346cfd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1f575176-36bc-4786-83ee-2fea064a12a9:3641:1874622881648768:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1787780062.013153:0:15455:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787780062.013158:0:15455:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 3 00000004:00080000:2.0:1787780062.013180:0:15455:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1787780062.013245:0:15455:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1787780062.013278:0:15455:0:(import.c:65:import_set_state_nolock()) ffff9c04811d9000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1787780062.013294:0:15455:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787780062.013297:0:15455:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967297 gen 3 00000004:00080000:2.0:1787780062.013376:0:15455:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1787780062.013654:0:15455:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1787780062.013667:0:15455:0:(import.c:65:import_set_state_nolock()) ffff9c0347cee800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1787780062.015625:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348a0b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1874622881649280:0@lo:9:umount.0 00000100:00100000:0.0:1787780062.015735:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787780062.015825:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348a083c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1874622881649408:0@lo:9:umount.0 00000100:00100000:0.0:1787780062.015884:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787780062.017621:0:3644:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9c0450075800 already not connected (conn 1, was 1): DISCONN 00000100:00080000:1.0:1787780062.017804:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9c0450075800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787780062.017813:0:3642:0:(import.c:510:import_select_connection()) MGC192.168.203.131@tcp: connect to NID 0@lo last attempt 179 00000100:00080000:1.0:1787780062.017825:0:3642:0:(import.c:624:import_select_connection()) MGC192.168.203.131@tcp: import ffff9c0450075800 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:1.0:1787780062.017906:0:3642:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c03488e1680 x1874622881649536/t0(0) o250->MGC192.168.203.131@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787780062.017950:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c03488e1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1f575176-36bc-4786-83ee-2fea064a12a9:3640:1874622881649536:0@lo:250:ptlrpcd_00_01.0 00000400:00000100:1.0:1787780062.018005:0:3640:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874622881649536 offset 0 length 520: 4 00000100:00100000:1.0:1787780062.018071:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0461bed680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1f575176-36bc-4786-83ee-2fea064a12a9:3642:1874622881647232:0@lo:400:kworker.0 00000100:00100000:1.0:1787780062.018095:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346cfcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1f575176-36bc-4786-83ee-2fea064a12a9:3642:1874622881648896:0@lo:103:ldlm_bl.0 00000020:00000080:0.0:1787780062.018180:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c0346bcb800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:0.0:1787780062.018238:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c0341d3b000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:0.0:1787780062.018272:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c0346bca000 for lustre-MDT0001 00000020:00000080:0.0:1787780062.018281:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c0341d3e000 for lustre-MDT0001 00000100:00100000:1.0:1787780062.019974:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346cfcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1f575176-36bc-4786-83ee-2fea064a12a9:0:1874622881649024:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787780062.020016:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1787780062.020122:0:15455:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9c04716e4d28) has no exports 00000100:00100000:3.0:1787780062.020682:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881649280 00000100:00100000:3.0:1787780062.020694:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881649280 00000100:00100000:3.0:1787780062.020776:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881649408 00000100:00100000:3.0:1787780062.020779:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881649408 00000100:00100000:3.0:1787780062.020810:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787780062.020820:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346cfd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1874622881649280:12345-0@lo:9:umount.0 00000020:00000080:3.0:1787780062.020873:0:9899:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc8fc0a5179960494 00000100:00080000:3.0:1787780062.020883:0:9899:0:(import.c:65:import_set_state_nolock()) ffff9c0481212800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787780062.020934:0:9899:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:3.0:1787780062.021154:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346cfd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+2:3640:x1874622881649280:12345-0@lo:9:umount.0 Request processed in 335us (5419us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780062.021178:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787780062.021200:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787780062.021207:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046f1b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1874622881649408:12345-0@lo:9:umount.0 00000020:00000080:3.0:1787780062.021221:0:9899:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc8fc0a51799605d6 00000100:00080000:3.0:1787780062.021227:0:9899:0:(import.c:65:import_set_state_nolock()) ffff9c0346f6c800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787780062.021251:0:9899:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:3.0:1787780062.021349:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046f1b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+2:3640:x1874622881649408:12345-0@lo:9:umount.0 Request processed in 143us (5464us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780062.021356:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:1.0:1787780062.021606:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787780062.021613:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787780062.021757:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9c04811d9000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1787780062.021780:0:3640:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1787780062.021783:0:3640:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787780062.021788:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348a0b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1874622881649280:0@lo:9:umount.0 00000100:00080000:3.0:1787780062.021803:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9c0347cee800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1787780062.021819:0:3640:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1787780062.021820:0:3640:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787780062.021823:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348a083c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1874622881649408:0@lo:9:umount.0 00010000:00010000:3.0:1787780062.021885:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787780062.021896:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787780062.021907:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348a08b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1f575176-36bc-4786-83ee-2fea064a12a9:0:1874622881649152:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787780062.021915:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347dacb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1f575176-36bc-4786-83ee-2fea064a12a9:3644:1874622881648640:0@lo:103:ldlm_bl.0 00000020:00080000:3.0:1787780062.039478:0:15455:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9c04716e4d28) has no exports 00000020:01000000:2.0:1787780062.164007:0:15455:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9c0341cbcba0 - data ffff9c04793365e8/ffff9c0347cb9400 00000020:01000000:2.0:1787780062.168642:0:15455:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9c0467fbc1e0 - data ffff9c04791366c0/ffff9c046edd1000 00000001:00000004:0.0:1787780062.183034:0:15455:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00080000:2.0:1787780062.249788:0:15455:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787780062.249800:0:15455:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 4 00000100:00100000:2.0:1787780062.249811:0:15455:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1787780062.252088:0:15455:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787780062.252098:0:15455:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 4 00000004:00080000:2.0:1787780062.252149:0:15455:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787780062.252152:0:15455:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1787780062.252759:0:8516:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1787780062.252766:0:8516:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 1 count 1 00000040:00080000:0.0:1787780062.252776:0:8516:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1787780062.254035:0:15455:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787780062.254042:0:15455:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967297 gen 4 00000004:00080000:2.0:1787780062.254064:0:15455:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787780062.254066:0:15455:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1787780062.254426:0:9890:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1787780062.254432:0:9890:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 1 count 1 00000040:00080000:1.0:1787780062.254444:0:9890:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:2.0:1787780062.258393:0:15455:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc8fc0a51799602b1 00000020:00000080:2.0:1787780062.258410:0:15455:0:(genops.c:885:class_export_put()) final put ffff9c0476700800/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1787780062.258622:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c0476700800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1787780062.261625:0:15455:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc8fc0a51799602c6 00000020:00000080:2.0:1787780062.261644:0:15455:0:(genops.c:885:class_export_put()) final put ffff9c0476707800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1787780062.261662:0:15455:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:2.0:1787780062.261667:0:15455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787780062.261677:0:15455:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787780062.261682:0:15455:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff9c04716e19b8) has no exports 00000004:01000000:2.0:1787780062.262022:0:15455:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1787780062.262034:0:15455:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc8fc0a51799605cf 00000020:00000080:2.0:1787780062.262040:0:15455:0:(genops.c:885:class_export_put()) final put ffff9c0347ce8800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1787780062.262045:0:15455:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:2.0:1787780062.262048:0:15455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787780062.262057:0:15455:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1787780062.262060:0:15455:0:(genops.c:1558:class_disconnect_exports()) OBD device 27 (ffff9c0445fc4d28) has no exports 00000020:00000080:2.0:1787780062.262068:0:15455:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc8fc0a51799605c8 00000020:00000080:2.0:1787780062.262071:0:15455:0:(genops.c:885:class_export_put()) final put ffff9c046efb9800/lustre-MDT0001-osd_UUID 00010000:01000000:2.0:1787780062.262599:0:15455:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:2.0:1787780062.262605:0:15455:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787780062.262610:0:15455:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967297 gen 5 00000004:00080000:2.0:1787780062.262622:0:15455:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787780062.262625:0:15455:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787780062.262712:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c0476707800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:00000080:0.0:1787780062.262723:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c0347ce8800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:0.0:1787780062.262727:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c046efb9800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1787780062.263155:0:15455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787780062.263166:0:15455:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1787780062.263173:0:15455:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc8fc0a517996048d 00000020:00000080:2.0:1787780062.263180:0:15455:0:(genops.c:885:class_export_put()) final put ffff9c0341d38800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1787780062.263184:0:15455:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:2.0:1787780062.263188:0:15455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787780062.263191:0:15455:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1787780062.263194:0:15455:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff9c0476624d28) has no exports 00000020:00000080:2.0:1787780062.263210:0:15455:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc8fc0a5179960486 00000020:00000080:2.0:1787780062.263213:0:15455:0:(genops.c:885:class_export_put()) final put ffff9c04811df000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1787780062.263727:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c0347cee800 for lustre-OST0001-osc-MDT0001 00000020:00000080:0.0:1787780062.263740:0:36:0:(genops.c:885:class_export_put()) final put ffff9c0345e51000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1787780062.263743:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c0345e51000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:0.0:1787780062.263749:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1787780062.263890:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c0341d38800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:0.0:1787780062.263896:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c04811df000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:2.0:1787780062.264121:0:15455:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:2.0:1787780062.264126:0:15455:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787780062.264130:0:15455:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 5 00000004:00080000:2.0:1787780062.264135:0:15455:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787780062.264137:0:15455:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787780062.264179:0:15455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787780062.264187:0:15455:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:2.0:1787780062.264201:0:15455:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:2.0:1787780062.264208:0:15455:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc8fc0a51799602e9 00000020:00000080:2.0:1787780062.264215:0:15455:0:(genops.c:885:class_export_put()) final put ffff9c0476704000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1787780062.264219:0:15455:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:2.0:1787780062.264223:0:15455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787780062.264227:0:15455:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1787780062.264347:0:15455:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff9c0450ce99b8) has no exports 00000020:00000080:2.0:1787780062.264353:0:15455:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc8fc0a51799602e2 00000020:00000080:2.0:1787780062.264357:0:15455:0:(genops.c:885:class_export_put()) final put ffff9c04777a3000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1787780062.264594:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c04811d9000 for lustre-OST0000-osc-MDT0001 00000020:00000080:0.0:1787780062.264602:0:36:0:(genops.c:885:class_export_put()) final put ffff9c0345e52800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1787780062.264604:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c0345e52800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:0.0:1787780062.264609:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1787780062.264664:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c0476704000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:0.0:1787780062.264669:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c04777a3000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:0.0:1787780062.272131:0:15455:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:0.0:1787780062.272143:0:15455:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787780062.272149:0:15455:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 5 00000100:00100000:0.0:1787780062.272160:0:15455:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787780062.272246:0:15455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787780062.272271:0:15455:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1787780062.272314:0:15455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787780062.272318:0:15455:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1787780062.272325:0:15455:0:(genops.c:885:class_export_put()) final put ffff9c04764fb800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1787780062.272332:0:15455:0:(genops.c:844:class_export_destroy()) destroying export ffff9c04764fb800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:0.0:1787780062.272342:0:15455:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1787780062.272583:0:15455:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc8fc0a51799602cd 00000020:00000080:0.0:1787780062.272593:0:15455:0:(genops.c:885:class_export_put()) final put ffff9c0476702800/lustre-MDD0001_UUID 00000020:01000000:0.0:1787780062.272599:0:15455:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:0.0:1787780062.272603:0:15455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787780062.272609:0:15455:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787780062.272613:0:15455:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff9c04716e0000) has no exports 00000020:00000080:0.0:1787780062.272637:0:15455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787780062.272640:0:15455:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:0.0:1787780062.272645:0:15455:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc8fc0a51799602d4 00000020:00000080:0.0:1787780062.272648:0:15455:0:(genops.c:885:class_export_put()) final put ffff9c0476703800/lustre-MDT0001-osd_UUID 00000020:01000004:0.0:1787780062.272657:0:15455:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c04764fa000 from lustre-MDT0001, refs=2 00000020:01000004:0.0:1787780062.272660:0:15455:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c04764fa000 2 00000020:01000004:0.0:1787780062.272664:0:15455:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9c04764fa000 from lustre-MDT0001 00000020:00000080:0.0:1787780062.272682:0:15455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787780062.272685:0:15455:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:0.0:1787780062.272687:0:15455:0:(genops.c:885:class_export_put()) final put ffff9c0476706000/lustre-MDT0001_UUID 00000020:00000080:0.0:1787780062.272689:0:15455:0:(genops.c:844:class_export_destroy()) destroying export ffff9c0476706000/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:0.0:1787780062.272696:0:15455:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:0.0:1787780062.272723:0:15455:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:0.0:1787780062.272726:0:15455:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:0.0:1787780062.272734:0:15455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787780062.272737:0:15455:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00000080:1.0:1787780062.272774:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c04777a6000 for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1787780062.272784:0:36:0:(genops.c:885:class_export_put()) final put ffff9c04777a5000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1787780062.272786:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c04777a5000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:1.0:1787780062.272798:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1787780062.272919:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c0476702800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:1.0:1787780062.272923:0:36:0:(genops.c:885:class_export_put()) final put ffff9c0476705800/lustre-MDD0001_UUID 00000020:00000080:1.0:1787780062.272925:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c0476705800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:1.0:1787780062.272929:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:1.0:1787780062.273101:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c0476703800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00080000:0.0:1787780062.273314:0:15455:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff9c0476705000 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787780062.273321:0:15455:0:(genops.c:1553:class_disconnect_exports()) OBD device 14 (ffff9c046ece8000) has exports, disconnecting them 00000020:00080000:0.0:1787780062.273326:0:15455:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff9c0476705000), last request at 1787779788 00000020:00000080:0.0:1787780062.273330:0:15455:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc8fc0a5179960328 00000020:00080000:0.0:1787780062.273337:0:15455:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c0476705000): rc 0 00000020:00000080:0.0:1787780062.273341:0:15455:0:(genops.c:885:class_export_put()) final put ffff9c0476705000/lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1787780062.276277:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c0476705000/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:1.0:1787780062.276899:0:15455:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:1.0:1787780062.276906:0:15455:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787780062.276911:0:15455:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1787780062.276919:0:15455:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787780062.276944:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c04777a3800 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1787780062.279240:0:15455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787780062.279620:0:15455:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:1.0:1787780062.279628:0:15455:0:(genops.c:885:class_export_put()) final put ffff9c0476707000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:1.0:1787780062.279633:0:15455:0:(genops.c:844:class_export_destroy()) destroying export ffff9c0476707000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:1.0:1787780062.279643:0:15455:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:1.0:1787780062.280300:0:15455:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c04764fa000 1 00000020:00000080:1.0:1787780062.280311:0:15455:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc8fc0a5179960264 00000020:00000080:1.0:1787780062.280320:0:15455:0:(genops.c:885:class_export_put()) final put ffff9c047647a800/lustre-MDT0001-osd_UUID 00000020:01000000:1.0:1787780062.280342:0:15455:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:1.0:1787780062.280353:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c047647a800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1787780062.280365:0:15455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787780062.280372:0:15455:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787780062.280375:0:15455:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff9c04716e3370) has no exports 00010000:00010000:1.0:1787780062.452188:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787780062.458214:0:15455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787780062.458228:0:15455:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:2.0:1787780062.458233:0:15455:0:(genops.c:885:class_export_put()) final put ffff9c04764fe800/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1787780062.458238:0:15455:0:(genops.c:844:class_export_destroy()) destroying export ffff9c04764fe800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:2.0:1787780062.458249:0:15455:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:2.0:1787780062.458383:0:15455:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9c04764fc000 00000020:01000000:2.0:1787780062.458402:0:15455:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:2.0:1787780062.458406:0:15455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787780062.458410:0:15455:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787780062.458414:0:15455:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff9c045156cd28) has no exports 00000100:00100000:2.0:1787780062.460249:0:6513:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9c04588d8e00:6513] 1 exiting: rc = 0 00000100:00100000:2.0:1787780062.460375:0:12488:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff9c046097b400:12488] 4 exiting: rc = 0 00000100:00100000:0.0:1787780062.460629:0:6512:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9c04796a5800:6512] 0 exiting: rc = 1 00000100:00100000:2.0:1787780062.462784:0:7821:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9c046ee9e800:7821] 3 exiting: rc = 0 00000100:00100000:2.0:1787780062.466291:0:6514:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9c0449630600:6514] 2 exiting: rc = 0 00000100:00100000:0.0:1787780062.466460:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787780062.466470:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787780062.466483:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787780062.466489:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787780062.466494:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787780062.466499:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787780062.466505:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787780062.466510:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787780062.466516:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787780062.466522:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787780062.466529:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787780062.466535:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787780062.466540:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787780062.466546:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787780062.466551:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787780062.466556:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787780062.466562:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787780062.466567:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787780062.466572:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787780062.466578:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787780062.466584:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787780062.466589:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787780062.466593:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787780062.466599:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787780062.466605:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787780062.466610:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787780062.466616:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787780062.466621:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787780062.466626:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787780062.466632:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787780062.466637:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787780062.466643:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787780062.466649:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787780062.466654:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787780062.466660:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787780062.466664:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787780062.466675:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787780062.466686:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787780062.466691:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787780062.466697:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787780062.466703:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787780062.466709:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787780062.466714:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787780062.466719:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787780062.466724:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787780062.466730:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787780062.466735:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787780062.466740:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787780062.466746:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787780062.466751:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787780062.466756:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787780062.466762:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787780062.466768:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787780062.466774:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787780062.466778:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787780062.466784:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787780062.466816:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787780062.466822:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787780062.466827:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787780062.466860:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787780062.466866:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787780062.466872:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787780062.466877:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787780062.466883:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.476659:0:6515:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9c0449630800:6515] 0 exiting: rc = 1 00000100:00100000:3.0:1787780062.479701:0:6516:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9c044775b400:6516] 1 exiting: rc = 0 00000100:00100000:1.0:1787780062.480072:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780062.480081:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780062.480087:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780062.480106:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780062.480113:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780062.480119:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780062.480125:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780062.480131:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780062.480137:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780062.480143:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780062.480148:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780062.480154:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780062.480171:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780062.480177:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780062.480183:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780062.480188:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780062.480193:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780062.480198:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780062.480204:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780062.480209:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780062.480214:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780062.480219:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780062.480224:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780062.480229:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780062.480234:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780062.480239:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780062.480245:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780062.480259:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780062.480265:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780062.480270:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780062.480275:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780062.480280:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780062.480289:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780062.480295:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780062.480300:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780062.480305:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780062.480311:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780062.480316:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780062.480328:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780062.480333:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780062.480338:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780062.480343:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780062.480349:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780062.480354:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780062.480359:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780062.480363:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780062.480369:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780062.480375:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780062.480380:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780062.480385:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780062.480391:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780062.480397:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780062.480403:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780062.480410:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780062.480416:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780062.480421:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780062.480426:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780062.480431:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780062.480543:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780062.480548:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780062.480553:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780062.480559:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780062.480564:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780062.480570:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780062.481058:0:6518:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9c04796a4e00:6518] 1 exiting: rc = 0 00000100:00100000:2.0:1787780062.481246:0:14310:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff9c0460245c00:14310] 2 exiting: rc = 0 00000100:00100000:2.0:1787780062.481333:0:6517:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9c04796a4200:6517] 0 exiting: rc = 1 00000100:00100000:1.0:1787780062.482420:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780062.482431:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780062.482573:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780062.482581:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780062.482587:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780062.482593:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780062.482599:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780062.482604:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780062.482610:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780062.482627:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780062.482633:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780062.482648:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780062.482654:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780062.482664:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780062.482671:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780062.482677:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780062.482684:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780062.482689:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780062.482696:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780062.482702:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780062.482708:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780062.482713:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780062.482719:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780062.482738:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780062.482745:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780062.482754:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780062.482759:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780062.482765:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780062.482771:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780062.482777:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780062.482783:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780062.487101:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780062.487116:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780062.487122:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780062.487128:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780062.487158:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780062.487164:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780062.487170:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780062.487176:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780062.487182:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780062.487188:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780062.487194:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780062.487200:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780062.487206:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780062.487225:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780062.487231:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780062.487237:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780062.487266:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780062.487274:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780062.487280:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780062.487286:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780062.487292:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780062.487299:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780062.487305:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780062.487311:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780062.487319:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780062.487327:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780062.487334:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780062.487342:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780062.487361:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780062.487367:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780062.487373:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780062.487379:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780062.487393:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00080000:2.0:1787780062.497332:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1f575176-36bc-4786-83ee-2fea064a12a9->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787780062.497343:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 1f575176-36bc-4786-83ee-2fea064a12a9->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787780062.497346:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787780062.497350:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787780062.497354:0:36:0:(import.c:65:import_set_state_nolock()) ffff9c04777a2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787780062.497362:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 465 00000100:00080000:2.0:1787780062.497369:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1787780062.497376:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9c04777a2800 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:2.0:1787780062.497418:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c0348a08780 x1874622881649664/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787780062.497475:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787780062.497479:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787780062.497480:0:36:0:(import.c:65:import_set_state_nolock()) ffff9c0346f69000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787780062.497484:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 465 00000100:00080000:2.0:1787780062.497487:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1787780062.497491:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9c0346f69000 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:2.0:1787780062.497503:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c0348a09680 x1874622881649920/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787780062.497627:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348a0b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1874622881649792:0@lo:400:kworker.0 00000400:00000100:2.0:1787780062.497677:0:3641:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874622881649792 offset 0 length 224: 4 00000100:00100000:2.0:1787780062.497743:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787780062.497762:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348a08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1874622881650048:0@lo:400:kworker.0 00000400:00000100:2.0:1787780062.497783:0:3641:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874622881650048 offset 0 length 224: 4 00000100:00100000:3.0:1787780062.498834:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348a08780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1874622881649664:0@lo:38:kworker.0 00000400:00000100:3.0:1787780062.498898:0:3640:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874622881649664 offset 0 length 520: 4 00000100:00100000:3.0:1787780062.498915:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348a09680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1874622881649920:0@lo:38:kworker.0 00000400:00000100:3.0:1787780062.498928:0:3640:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874622881649920 offset 0 length 520: 4 00000100:00100000:1.0:1787780062.501426:0:6519:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9c04440f5c00:6519] 0 exiting: rc = 1 00000100:00100000:3.0:1787780062.501470:0:6520:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9c04440f2400:6520] 1 exiting: rc = 0 00000100:00100000:0.0:1787780062.501616:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787780062.501625:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787780062.501632:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787780062.501640:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787780062.501648:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787780062.501658:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787780062.501663:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787780062.501669:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787780062.501685:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787780062.501695:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787780062.501704:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787780062.501712:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787780062.501723:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787780062.501728:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787780062.501733:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787780062.501739:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787780062.501744:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787780062.501749:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787780062.501754:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787780062.501759:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787780062.501767:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787780062.501779:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787780062.501924:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787780062.501934:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787780062.501942:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787780062.501949:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787780062.501954:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787780062.501958:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787780062.501964:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787780062.502036:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787780062.502042:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787780062.502047:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787780062.502052:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787780062.502058:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787780062.502064:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787780062.502071:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787780062.502078:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787780062.502086:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787780062.502093:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787780062.502100:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787780062.502109:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787780062.502118:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787780062.502127:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787780062.502144:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787780062.502154:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787780062.502162:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787780062.502166:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787780062.502172:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787780062.502180:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787780062.502189:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787780062.502199:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787780062.502209:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787780062.502219:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787780062.502228:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787780062.502233:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787780062.502237:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787780062.502242:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787780062.502247:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787780062.502264:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787780062.502269:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787780062.502274:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787780062.502279:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787780062.502284:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787780062.502290:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780062.502899:0:6521:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9c04440f2000:6521] 0 exiting: rc = 1 00000100:00100000:0.0:1787780062.503448:0:6522:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9c04440f2c00:6522] 1 exiting: rc = 0 00000100:00100000:2.0:1787780062.503503:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.503510:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.503515:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.503521:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.503526:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.503530:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.503536:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.503541:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.503547:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.503552:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.503557:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.503562:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.503568:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.503572:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.503577:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.503583:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.503588:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.503592:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.503598:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.503603:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.503608:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.503613:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.503618:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.503623:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.503628:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.503632:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.503638:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.503643:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.503647:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.503652:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.503658:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.503663:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.503677:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.503683:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.503688:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.503693:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.503698:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.503703:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.503709:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.503714:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.503719:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.503724:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.503729:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.503735:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.503740:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.503744:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.503749:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.503754:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.503760:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.503764:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.503769:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.503774:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.503778:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.503783:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.503788:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.503794:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.503798:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.503803:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.503808:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.503813:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.503818:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.503822:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.503827:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.503832:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780062.504290:0:6524:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9c04440f2800:6524] 1 exiting: rc = 0 00000100:00100000:1.0:1787780062.504594:0:6523:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9c04440f3800:6523] 0 exiting: rc = 1 00000100:00100000:2.0:1787780062.504897:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.504906:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.504913:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.504927:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.504934:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.504942:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.504959:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.504967:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.504972:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.504978:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.504983:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.504989:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.504995:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.505000:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.505006:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.505011:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.505016:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.505021:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.505027:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.505033:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.505038:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.505043:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.505049:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.505055:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.505060:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.505064:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.505070:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.505074:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.505079:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.505084:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.505089:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.505094:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.505099:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.505104:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.505109:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.505114:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.505119:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.505123:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.505134:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.505140:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.505145:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.505150:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.505155:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.505160:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.505174:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.505180:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.505186:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.505191:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.505196:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.505202:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.505207:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.505212:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.505217:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.505222:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.505297:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.505304:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.505309:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.505314:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.505320:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.505325:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.505329:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.505334:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.505339:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.505343:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787780062.505817:0:6525:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9c04440f3c00:6525] 0 exiting: rc = 1 00000100:00100000:3.0:1787780062.506074:0:6526:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9c04440f3400:6526] 1 exiting: rc = 0 00000100:00100000:1.0:1787780062.506462:0:6527:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9c04440f3600:6527] 2 exiting: rc = 0 00000100:00100000:2.0:1787780062.506566:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.506585:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.506592:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.506597:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.506602:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.506608:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.506614:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.506620:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.506625:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.506639:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.506644:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.506650:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.506656:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.506661:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.506667:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.506673:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.506679:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.506685:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.506691:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.506696:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.506702:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.506707:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.506712:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.506718:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.506724:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.506742:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.506749:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.506754:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.506759:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.506765:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.506770:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.506776:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.506782:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.506788:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.506793:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.506799:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.506805:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.506810:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.506815:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.506821:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.506826:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.506831:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.506857:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.506864:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.506875:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.506880:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.506886:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.506892:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.506898:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.506915:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.506922:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.506928:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.506933:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.506939:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.506944:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.506949:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.506954:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.506960:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.506966:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.506971:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.506977:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.506983:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.506988:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780062.506994:0:15455:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1787780062.511109:0:15455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787780062.511120:0:15455:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:2.0:1787780062.511125:0:15455:0:(genops.c:885:class_export_put()) final put ffff9c0450077000/MDS_uuid 00000020:00000080:2.0:1787780062.511129:0:15455:0:(genops.c:844:class_export_destroy()) destroying export ffff9c0450077000/MDS_uuid for MDS 00000020:01000000:2.0:1787780062.511138:0:15455:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:2.0:1787780062.511369:0:15455:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:3.0:1787780063.517183:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787780064.540928:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787780065.566113:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787780066.523942:0:2253:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1f575176-36bc-4786-83ee-2fea064a12a9->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787780066.523952:0:2253:0:(pinger.c:247:ptlrpc_pinger_process_import()) 1f575176-36bc-4786-83ee-2fea064a12a9->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787780066.523955:0:2253:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787780066.523958:0:2253:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787780066.524012:0:2253:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787780066.524016:0:2253:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787780066.524097:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c03488e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1874622881650176:0@lo:400:kworker.0 00000400:00000100:2.0:1787780066.524148:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874622881650176 offset 0 length 224: 4 00000100:00100000:2.0:1787780066.524198:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787780066.524204:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c03488e3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1874622881650304:0@lo:400:kworker.0 00000400:00000100:2.0:1787780066.524233:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874622881650304 offset 0 length 224: 4 00010000:00010000:3.0:1787780066.590171:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787780067.006937:0:15655:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1787780067.021057:0:15655:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:2.0:1787780067.021112:0:15655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c0477a71000/0xc8fc0a51799606a1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a51799606a8 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780067.021139:0:15655:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c0477a71000/0xc8fc0a51799606a1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xc8fc0a51799606a8 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780067.021147:0:15655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c0477a71000/0xc8fc0a51799606a1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xc8fc0a51799606a8 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780067.021154:0:15655:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.131@tcp lock: ffff9c0477a71000/0xc8fc0a51799606a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xc8fc0a51799606a8 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780067.021172:0:15655:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787780067.021177:0:15655:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1787780067.021203:0:15655:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787780067.021215:0:15655:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c0348a08780 x1874622881649664/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787780082 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787780067.021246:0:15655:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1787780067.021251:0:15655:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1787780067.021257:0:15655:0:(import.c:65:import_set_state_nolock()) ffff9c04777a2800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1787780067.021262:0:15655:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787780067.021266:0:15655:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c0348a08780 x1874622881649664/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787780082 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787780067.021274:0:15655:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1787780067.021277:0:15655:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1787780067.021336:0:7453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787780067.021342:0:7453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff9c0477a71000/0xc8fc0a51799606a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xc8fc0a51799606a8 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780067.021349:0:7453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0477a71000 already unused, calling callback (ffffffffc139ac20) 10000000:00010000:3.0:1787780067.021353:0:7453:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff9c0477a71000/0xc8fc0a51799606a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xc8fc0a51799606a8 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780067.021361:0:7453:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff9c0477a71000/0xc8fc0a51799606a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xc8fc0a51799606a8 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787780067.021367:0:7453:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff9c0477a71000/0xc8fc0a51799606a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xc8fc0a51799606a8 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787780067.021640:0:7453:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787780067.021642:0:7453:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1787780067.021645:0:7453:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1787780067.021659:0:7453:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9c0450075800 00010000:00010000:3.0:1787780067.021670:0:7453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff9c0477a71000/0xc8fc0a51799606a1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xc8fc0a51799606a8 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780067.021677:0:7453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff9c0477a71000/0xc8fc0a51799606a1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xc8fc0a51799606a8 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780067.021688:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787780067.021690:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787780067.021692:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787780067.021746:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348a08780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1874622881649664:0@lo:38:kworker.0 00000100:00080000:2.0:1787780067.023790:0:15655:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1787780067.023806:0:15655:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c0348a0b840 x1874622881649792/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787780078 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787780067.023899:0:15655:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c03488e3480 x1874622881650176/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787780082 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787780067.023929:0:15655:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1787780067.023934:0:15655:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1787780067.023958:0:15655:0:(import.c:65:import_set_state_nolock()) ffff9c044408b000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1787780067.024066:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348a0a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3640:1874622881650432:0@lo:39:umount.0 00000400:00000100:3.0:1787780067.024114:0:3640:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874622881650432 offset 0 length 224: 4 00000100:00100000:1.0:1787780067.024714:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c03488e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1874622881650176:0@lo:400:kworker.0 00000100:00100000:0.0:1787780067.024793:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348a0b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1874622881649792:0@lo:400:kworker.0 00000100:00080000:2.0:1787780067.548274:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1f575176-36bc-4786-83ee-2fea064a12a9->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787780067.548285:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 1f575176-36bc-4786-83ee-2fea064a12a9->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787780067.548288:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787780067.548291:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787780067.548402:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348a0a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1874622881650560:0@lo:400:kworker.0 00000400:00000100:0.0:1787780067.548460:0:3641:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874622881650560 offset 0 length 224: 4 00010000:00010000:3.0:1787780067.612158:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787780068.128660:0:8423:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1787780068.128669:0:8423:0:(genops.c:885:class_export_put()) final put ffff9c0481213800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1787780068.128939:0:2253:0:(genops.c:844:class_export_destroy()) destroying export ffff9c0481213800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1787780068.128990:0:2253:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c0481212800 for lustre-OST0000 00000001:00100000:3.0:1787780068.129088:0:9508:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1787780068.129092:0:9508:0:(genops.c:885:class_export_put()) final put ffff9c0346f6b000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1787780068.129160:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c0346f6b000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1787780068.129201:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c0346f6c800 for lustre-OST0001 00010000:00010000:3.0:1787780068.638542:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787780069.659998:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787780070.683984:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787780071.708009:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787780072.156510:0:3640:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787780062/real 1787780062] req@ffff9c03488e1680 x1874622881649536/t0(0) o250->MGC192.168.203.131@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787780072 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787780072.156543:0:3640:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c03488e1680 x1874622881649536/t0(0) o250->MGC192.168.203.131@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787780072 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787780072.156563:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9c0450075800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787780072.156592:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:3.0:1787780072.156597:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c03488e1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1f575176-36bc-4786-83ee-2fea064a12a9:3640:1874622881649536:0@lo:250:ptlrpcd_00_01.0 00000100:00080000:1.0:1787780072.157003:0:2253:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1f575176-36bc-4786-83ee-2fea064a12a9->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787780072.157008:0:2253:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1787780072.157011:0:2253:0:(import.c:65:import_set_state_nolock()) ffff9c0450075800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787780072.157016:0:2253:0:(import.c:510:import_select_connection()) MGC192.168.203.131@tcp: connect to NID 0@lo last attempt 470 00000100:00080000:1.0:1787780072.157021:0:2253:0:(import.c:589:import_select_connection()) MGC192.168.203.131@tcp: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787780072.157026:0:2253:0:(import.c:624:import_select_connection()) MGC192.168.203.131@tcp: import ffff9c0450075800 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:1.0:1787780072.157055:0:2253:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c03488e3480 x1874622881650688/t0(0) o250->MGC192.168.203.131@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787780072.157080:0:2253:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787780072.157084:0:2253:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787780072.157172:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787780072.157202:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c03488e12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1874622881650816:0@lo:400:kworker.0 00000400:00000100:0.0:1787780072.157261:0:3641:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874622881650816 offset 0 length 224: 4 00000100:00100000:3.0:1787780072.157415:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c03488e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1f575176-36bc-4786-83ee-2fea064a12a9:3640:1874622881650688:0@lo:250:kworker.0 00000400:00000100:3.0:1787780072.157445:0:3640:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874622881650688 offset 0 length 520: 4 00010000:00010000:3.0:1787780072.734668:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787780073.756649:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787780074.780029:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787780075.804174:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787780076.828016:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787780077.275976:0:3640:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787780067/real 1787780067] req@ffff9c0348a0a1c0 x1874622881650432/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787780077 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787780077.276006:0:3640:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c0348a0a1c0 x1874622881650432/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787780077 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787780077.276035:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9c044408b000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1787780077.276055:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348a0a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3640:1874622881650432:0@lo:39:umount.0 00000100:00080000:2.0:1787780077.276395:0:15655:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1787780077.276400:0:15655:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1787780077.276405:0:15655:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1787780077.277362:0:15655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c04427daa00/0xc8fc0a51799606af lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a51799606b6 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780077.277376:0:15655:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c04427daa00/0xc8fc0a51799606af lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc8fc0a51799606b6 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780077.277383:0:15655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c04427daa00/0xc8fc0a51799606af lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xc8fc0a51799606b6 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780077.277390:0:15655:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.131@tcp lock: ffff9c04427daa00/0xc8fc0a51799606af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xc8fc0a51799606b6 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780077.277415:0:15655:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787780077.277423:0:15655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c0346dd6400/0xc8fc0a5179960933 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a517996093a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780077.277443:0:15655:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c0346dd6400/0xc8fc0a5179960933 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc8fc0a517996093a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780077.277449:0:15655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c0346dd6400/0xc8fc0a5179960933 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc8fc0a517996093a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780077.277455:0:15655:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.131@tcp lock: ffff9c0346dd6400/0xc8fc0a5179960933 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc8fc0a517996093a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780077.277482:0:15655:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1787780077.277488:0:15655:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:2.0:1787780077.277513:0:15655:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:2.0:1787780077.277517:0:15655:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:2.0:1787780077.277521:0:15655:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787780077.277527:0:15655:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787780077.277531:0:15655:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff9c046eceb370) has no exports 00000020:00080000:2.0:1787780077.277553:0:15655:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff9c046eceb370) has no exports 00010000:00010000:0.0:1787780077.277695:0:7453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787780077.277709:0:7453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff9c04427daa00/0xc8fc0a51799606af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xc8fc0a51799606b6 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780077.277718:0:7453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c04427daa00 already unused, calling callback (ffffffffc139ac20) 10000000:00010000:0.0:1787780077.277722:0:7453:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff9c04427daa00/0xc8fc0a51799606af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xc8fc0a51799606b6 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780077.277732:0:7453:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff9c04427daa00/0xc8fc0a51799606af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xc8fc0a51799606b6 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787780077.277740:0:7453:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff9c04427daa00/0xc8fc0a51799606af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xc8fc0a51799606b6 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787780077.277746:0:7453:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787780077.277748:0:7453:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:0.0:1787780077.277750:0:7453:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:0.0:1787780077.277764:0:7453:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9c0450075800 00010000:00010000:0.0:1787780077.277768:0:7453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff9c04427daa00/0xc8fc0a51799606af lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xc8fc0a51799606b6 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780077.277776:0:7453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff9c04427daa00/0xc8fc0a51799606af lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xc8fc0a51799606b6 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780077.277814:0:7453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787780077.277819:0:7453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff9c0346dd6400/0xc8fc0a5179960933 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc8fc0a517996093a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780077.277825:0:7453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0346dd6400 already unused, calling callback (ffffffffc139ac20) 10000000:00010000:0.0:1787780077.277881:0:7453:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff9c0346dd6400/0xc8fc0a5179960933 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc8fc0a517996093a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780077.277890:0:7453:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff9c0346dd6400/0xc8fc0a5179960933 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xc8fc0a517996093a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787780077.277896:0:7453:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff9c0346dd6400/0xc8fc0a5179960933 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xc8fc0a517996093a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787780077.277901:0:7453:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1787780077.277904:0:7453:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1787780077.277906:0:7453:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1787780077.277913:0:7453:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9c0450075800 00010000:00010000:0.0:1787780077.277916:0:7453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff9c0346dd6400/0xc8fc0a5179960933 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xc8fc0a517996093a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780077.277923:0:7453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff9c0346dd6400/0xc8fc0a5179960933 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xc8fc0a517996093a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780077.277932:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787780077.277934:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787780077.277936:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1787780077.279399:0:15655:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9c0347ab4de0 - data ffff9c04792501b0/ffff9c0477af8c00 00000020:01000000:2.0:1787780077.279522:0:15655:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9c0346a03a80 - data ffff9c04791f5870/ffff9c04778b8400 00010000:00010000:3.0:1787780077.279881:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:2.0:1787780077.287752:0:15655:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1787780077.293239:0:15655:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc8fc0a5179960401 00000020:00000080:3.0:1787780077.293287:0:15655:0:(genops.c:885:class_export_put()) final put ffff9c0476701000/lustre-OST0000-osd_UUID 00000020:01000004:3.0:1787780077.293305:0:15655:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c046ecd6000 from lustre-OST0000, refs=2 00000020:01000004:3.0:1787780077.293310:0:15655:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c046ecd6000 2 00000020:01000004:3.0:1787780077.293313:0:15655:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9c046ecd6000 from lustre-OST0000 00000020:00000080:3.0:1787780077.293340:0:15655:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787780077.293353:0:15655:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:3.0:1787780077.293356:0:15655:0:(genops.c:885:class_export_put()) final put ffff9c0444088000/lustre-OST0000_UUID 00000020:00000080:3.0:1787780077.293360:0:15655:0:(genops.c:844:class_export_destroy()) destroying export ffff9c0444088000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:3.0:1787780077.293367:0:15655:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:00000080:0.0:1787780077.293433:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c0476701000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000004:3.0:1787780077.293586:0:15655:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:3.0:1787780077.293591:0:15655:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1787780077.293595:0:15655:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787780077.293600:0:15655:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1787780077.293607:0:15655:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9c04764fd800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787780077.293613:0:15655:0:(genops.c:1553:class_disconnect_exports()) OBD device 19 (ffff9c046ece99b8) has exports, disconnecting them 00000020:00080000:3.0:1787780077.293627:0:15655:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9c04764fd800), last request at 1787779805 00000020:00000080:3.0:1787780077.293631:0:15655:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc8fc0a517996042b 00000020:00080000:3.0:1787780077.293642:0:15655:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c04764fd800): rc 0 00000020:00000080:3.0:1787780077.293647:0:15655:0:(genops.c:885:class_export_put()) final put ffff9c04764fd800/lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1787780077.293827:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c04764fd800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:1.0:1787780077.296960:0:15655:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:1.0:1787780077.296969:0:15655:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787780077.296974:0:15655:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1787780077.296995:0:15655:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787780077.297217:0:15655:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787780077.297226:0:15655:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:1.0:1787780077.297234:0:15655:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1787780077.297239:0:15655:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787780077.297243:0:15655:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1787780077.297250:0:15655:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff9c04777a2000 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787780077.297257:0:15655:0:(genops.c:1553:class_disconnect_exports()) OBD device 20 (ffff9c046ececd28) has exports, disconnecting them 00000020:00080000:1.0:1787780077.297261:0:15655:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff9c04777a2000), last request at 1787779805 00000020:00000080:1.0:1787780077.297276:0:15655:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc8fc0a5179960440 00000020:00080000:1.0:1787780077.297292:0:15655:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c04777a2000): rc 0 00000020:00000080:1.0:1787780077.297298:0:15655:0:(genops.c:885:class_export_put()) final put ffff9c04777a2000/lustre-MDT0001-lwp-OST0000 00000020:00000080:0.0:1787780077.298229:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c04777a2800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1787780077.298240:0:36:0:(genops.c:885:class_export_put()) final put ffff9c046da9e800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:0.0:1787780077.298243:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c046da9e800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:0.0:1787780077.298250:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:0.0:1787780077.298312:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c04777a2000/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:0.0:1787780077.298340:0:15655:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:0.0:1787780077.298352:0:15655:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1787780077.298355:0:15655:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787780077.298359:0:15655:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787780077.298378:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c044408b000 for lustre-MDT0001-lwp-OST0000 00000020:00000080:0.0:1787780077.298824:0:15655:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787780077.298832:0:15655:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:0.0:1787780077.298835:0:15655:0:(genops.c:885:class_export_put()) final put ffff9c04764fc800/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:0.0:1787780077.298858:0:15655:0:(genops.c:844:class_export_destroy()) destroying export ffff9c04764fc800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:0.0:1787780077.298863:0:15655:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:0.0:1787780077.299102:0:15655:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c046ecd6000 1 00000020:00000080:0.0:1787780077.299109:0:15655:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc8fc0a51799603c9 00000020:00000080:0.0:1787780077.299115:0:15655:0:(genops.c:885:class_export_put()) final put ffff9c046efb9000/lustre-OST0000-osd_UUID 00000020:01000000:0.0:1787780077.299126:0:15655:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1787780077.299137:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c046efb9000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1787780077.299157:0:15655:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787780077.299162:0:15655:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787780077.299166:0:15655:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff9c0450cecd28) has no exports 00000100:00080000:0.0:1787780077.342229:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1f575176-36bc-4786-83ee-2fea064a12a9->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787780077.342241:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 1f575176-36bc-4786-83ee-2fea064a12a9->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787780077.342244:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787780077.342247:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787780077.342328:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787780077.342348:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346cfe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1874622881650944:0@lo:400:kworker.0 00000400:00000100:0.0:1787780077.342409:0:3644:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874622881650944 offset 0 length 224: 4 00000020:00000080:3.0:1787780077.383054:0:15655:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787780077.383064:0:15655:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:3.0:1787780077.383069:0:15655:0:(genops.c:885:class_export_put()) final put ffff9c046ecd0800/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1787780077.383073:0:15655:0:(genops.c:844:class_export_destroy()) destroying export ffff9c046ecd0800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:3.0:1787780077.383082:0:15655:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:3.0:1787780077.383184:0:15655:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9c046ecd0000 00000020:02000400:3.0:1787780077.383218:0:15655:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:3.0:1787780077.855953:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:2.0:1787780078.303304:0:3641:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787780062/real 1787780062] req@ffff9c0348a08000 x1874622881650048/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787780078 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787780078.327772:0:3641:0:(client.c:2547:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff9c0348a08000 x1874622881650048/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787780078 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787780078.327787:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9c048124a000 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1787780078.327791:0:3641:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1787780078.341228:0:3641:0:(import.c:418:ptlrpc_pinger_force()) lustre-MDT0001_UUID: waking up pinger s:DISCONN 00000100:00080000:3.0:1787780078.341262:0:2253:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1f575176-36bc-4786-83ee-2fea064a12a9->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787780078.341269:0:2253:0:(pinger.c:247:ptlrpc_pinger_process_import()) 1f575176-36bc-4786-83ee-2fea064a12a9->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787780078.341272:0:2253:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787780078.341275:0:2253:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787780078.341277:0:2253:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787780078.341280:0:2253:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1787780078.341284:0:2253:0:(import.c:65:import_set_state_nolock()) ffff9c048124a000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787780078.341370:0:2253:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 233 00000100:00080000:3.0:1787780078.341387:0:2253:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9c048124a000 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:3.0:1787780078.341421:0:2253:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c0347dacb40 x1874622881651072/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787780078.341473:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348a08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1874622881650048:0@lo:400:kworker.0 00000100:00100000:2.0:1787780078.341590:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347dacb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3640:1874622881651072:0@lo:38:kworker.0 00000400:00000100:2.0:1787780078.341641:0:3640:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874622881651072 offset 0 length 520: 4 00010000:00010000:0.0:1787780078.885882:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787780079.900022:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787780080.930289:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787780080.949816:0:15857:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1787780080.962577:0:15857:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:1.0:1787780080.962663:0:15857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c04427db200/0xc8fc0a5179960685 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a517996068c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780080.962675:0:15857:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c04427db200/0xc8fc0a5179960685 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc8fc0a517996068c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780080.962682:0:15857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c04427db200/0xc8fc0a5179960685 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xc8fc0a517996068c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780080.962689:0:15857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.131@tcp lock: ffff9c04427db200/0xc8fc0a5179960685 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xc8fc0a517996068c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780080.962714:0:15857:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787780080.962719:0:15857:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1787780080.962746:0:15857:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787780080.962755:0:15857:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c0348a09680 x1874622881649920/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787780082 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787780080.962765:0:15857:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1787780080.962770:0:15857:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1787780080.962774:0:15857:0:(import.c:65:import_set_state_nolock()) ffff9c0346f69000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1787780080.962778:0:15857:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787780080.962780:0:15857:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c0348a09680 x1874622881649920/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787780082 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787780080.962785:0:15857:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1787780080.962787:0:15857:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 2s for inflight to error out 00010000:00010000:0.0:1787780080.962908:0:7453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787780080.962917:0:7453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff9c04427db200/0xc8fc0a5179960685 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xc8fc0a517996068c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780080.962932:0:7453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c04427db200 already unused, calling callback (ffffffffc139ac20) 10000000:00010000:0.0:1787780080.962937:0:7453:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff9c04427db200/0xc8fc0a5179960685 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xc8fc0a517996068c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780080.962947:0:7453:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff9c04427db200/0xc8fc0a5179960685 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xc8fc0a517996068c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787780080.962954:0:7453:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff9c04427db200/0xc8fc0a5179960685 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xc8fc0a517996068c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787780080.962960:0:7453:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787780080.962963:0:7453:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1787780080.962965:0:7453:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1787780080.962977:0:7453:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9c0450075800 00010000:00010000:0.0:1787780080.962981:0:7453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff9c04427db200/0xc8fc0a5179960685 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xc8fc0a517996068c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780080.962988:0:7453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff9c04427db200/0xc8fc0a5179960685 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xc8fc0a517996068c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780080.962999:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787780080.963001:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787780080.963003:0:7453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787780080.963032:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348a09680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1874622881649920:0@lo:38:kworker.0 00000100:00080000:1.0:1787780080.964202:0:15857:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1787780080.964212:0:15857:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c03488e3c00 x1874622881650304/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787780082 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787780080.964231:0:15857:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c0348a0a580 x1874622881650560/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787780083 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787780080.964247:0:15857:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c03488e12c0 x1874622881650816/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787780088 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787780080.964255:0:15857:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c0346cfe1c0 x1874622881650944/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787780093 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787780080.964264:0:15857:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c0347dacb40 x1874622881651072/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787780088 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787780080.964273:0:15857:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1787780080.964277:0:15857:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1787780080.964282:0:15857:0:(import.c:65:import_set_state_nolock()) ffff9c048124a000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1787780080.964576:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c03488e12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1874622881650816:0@lo:400:kworker.0 00000100:00100000:0.0:1787780080.964660:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c03488e3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1874622881650304:0@lo:400:kworker.0 00000100:00100000:2.0:1787780080.964723:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348a0a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1874622881650560:0@lo:400:kworker.0 00000100:00100000:0.0:1787780080.965025:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346cfe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1874622881650944:0@lo:400:kworker.0 00000100:00080000:1.0:1787780080.965109:0:15857:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1787780080.965115:0:15857:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c0347dacb40 x1874622881651072/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787780088 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787780080.965135:0:15857:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1787780080.965138:0:15857:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 10s for inflight to error out 00000100:00100000:0.0:1787780080.965365:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347dacb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3640:1874622881651072:0@lo:38:kworker.0 00010000:00010000:0.0:1787780080.966776:0:15857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c04427da000/0xc8fc0a5179960693 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a517996069a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780080.966793:0:15857:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c04427da000/0xc8fc0a5179960693 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc8fc0a517996069a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780080.966801:0:15857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c04427da000/0xc8fc0a5179960693 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc8fc0a517996069a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780080.966808:0:15857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.131@tcp lock: ffff9c04427da000/0xc8fc0a5179960693 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc8fc0a517996069a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780080.966832:0:15857:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787780080.966941:0:15857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c0346dd7a00/0xc8fc0a5179960925 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a517996092c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780080.966950:0:15857:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c0346dd7a00/0xc8fc0a5179960925 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc8fc0a517996092c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780080.967101:0:15857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c0346dd7a00/0xc8fc0a5179960925 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc8fc0a517996092c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780080.967108:0:15857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.131@tcp lock: ffff9c0346dd7a00/0xc8fc0a5179960925 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc8fc0a517996092c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780080.967144:0:15857:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1787780080.967149:0:15857:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:0.0:1787780080.967176:0:15857:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:0.0:1787780080.967180:0:15857:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:0.0:1787780080.967185:0:15857:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00010000:00010000:1.0:1787780080.967453:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787780080.967459:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff9c04427da000/0xc8fc0a5179960693 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc8fc0a517996069a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780080.967467:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c04427da000 already unused, calling callback (ffffffffc139ac20) 10000000:00010000:1.0:1787780080.967470:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff9c04427da000/0xc8fc0a5179960693 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc8fc0a517996069a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780080.967479:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff9c04427da000/0xc8fc0a5179960693 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xc8fc0a517996069a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780080.967482:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787780080.967487:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff9c0346dd7a00/0xc8fc0a5179960925 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc8fc0a517996092c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780080.967494:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0346dd7a00 already unused, calling callback (ffffffffc139ac20) 10000000:00010000:1.0:1787780080.967495:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff9c04427da000/0xc8fc0a5179960693 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xc8fc0a517996069a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787780080.967496:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff9c0346dd7a00/0xc8fc0a5179960925 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc8fc0a517996092c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787780080.967502:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787780080.967504:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff9c0346dd7a00/0xc8fc0a5179960925 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xc8fc0a517996092c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787780080.967505:0:6501:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:1.0:1787780080.967507:0:6501:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:00010000:3.0:1787780080.967510:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff9c0346dd7a00/0xc8fc0a5179960925 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xc8fc0a517996092c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787780080.967514:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1787780080.967516:0:6500:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1787780080.967517:0:6500:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1787780080.967519:0:6501:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9c0450075800 00010000:00010000:3.0:1787780080.967522:0:6500:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9c0450075800 00010000:00010000:1.0:1787780080.967523:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff9c04427da000/0xc8fc0a5179960693 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xc8fc0a517996069a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780080.967524:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff9c0346dd7a00/0xc8fc0a5179960925 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xc8fc0a517996092c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780080.967530:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff9c04427da000/0xc8fc0a5179960693 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xc8fc0a517996069a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780080.967531:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff9c0346dd7a00/0xc8fc0a5179960925 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xc8fc0a517996092c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780080.967544:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787780080.967544:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787780080.967546:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787780080.967546:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787780080.967548:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787780080.967548:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787780080.967640:0:15857:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787780080.967644:0:15857:0:(genops.c:1558:class_disconnect_exports()) OBD device 24 (ffff9c0476620000) has no exports 00000020:00080000:0.0:1787780080.967667:0:15857:0:(genops.c:1558:class_disconnect_exports()) OBD device 24 (ffff9c0476620000) has no exports 00000020:01000000:0.0:1787780080.970408:0:15857:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9c0341cbca80 - data ffff9c0479326798/ffff9c0347cb9800 00000020:01000000:0.0:1787780080.970561:0:15857:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9c0347a2fc60 - data ffff9c0479268870/ffff9c0347cb3800 00100000:10000000:2.0:1787780080.988581:0:15857:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1787780080.999442:0:15857:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc8fc0a5179960527 00000020:00000080:1.0:1787780080.999454:0:15857:0:(genops.c:885:class_export_put()) final put ffff9c0481216000/lustre-OST0001-osd_UUID 00000020:01000004:1.0:1787780080.999465:0:15857:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c0346bcb000 from lustre-OST0001, refs=2 00000020:01000004:1.0:1787780080.999468:0:15857:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c0346bcb000 2 00000020:01000004:1.0:1787780080.999472:0:15857:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9c0346bcb000 from lustre-OST0001 00000020:00000080:1.0:1787780080.999494:0:15857:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787780080.999503:0:15857:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:1.0:1787780080.999506:0:15857:0:(genops.c:885:class_export_put()) final put ffff9c046ee66000/lustre-OST0001_UUID 00000020:00000080:1.0:1787780080.999509:0:15857:0:(genops.c:844:class_export_destroy()) destroying export ffff9c046ee66000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:1.0:1787780080.999515:0:15857:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000020:00000080:2.0:1787780080.999598:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c0481216000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00080000:1.0:1787780080.999787:0:15857:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 1f575176-36bc-4786-83ee-2fea064a12a9->MGS 00010000:00010000:1.0:1787780081.000090:0:15857:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff9c04427da600/0xc8fc0a5179960280 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xc8fc0a5179960287 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787780081.000131:0:15857:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff9c04427da600/0xc8fc0a5179960280 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xc8fc0a5179960287 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787780081.000140:0:15857:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:1.0:1787780081.000143:0:15857:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:1.0:1787780081.000147:0:15857:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:1.0:1787780081.000162:0:15857:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9c0450075800 00010000:00010000:1.0:1787780081.000166:0:15857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff9c04427da600/0xc8fc0a5179960280 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xc8fc0a5179960287 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780081.000183:0:15857:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff9c04427dae00/0xc8fc0a51799606f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xc8fc0a51799606fc expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787780081.000191:0:15857:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff9c04427dae00/0xc8fc0a51799606f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xc8fc0a51799606fc expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787780081.000197:0:15857:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787780081.000199:0:15857:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:1.0:1787780081.000201:0:15857:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:1.0:1787780081.000215:0:15857:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9c0450075800 00010000:00010000:1.0:1787780081.000218:0:15857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff9c04427dae00/0xc8fc0a51799606f5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xc8fc0a51799606fc expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787780081.000234:0:15857:0:(import.c:65:import_set_state_nolock()) ffff9c0450075800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:1.0:1787780081.000238:0:15857:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1787780081.000241:0:15857:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1787780081.000243:0:15857:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1787780081.000247:0:15857:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1787780081.000258:0:15857:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c03488e3480 x1874622881650688/t0(0) o250->MGC192.168.203.131@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1787780087 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1787780081.000285:0:15857:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1787780081.000288:0:15857:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 9s for inflight to error out 00000100:00100000:2.0:1787780081.000348:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c03488e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1f575176-36bc-4786-83ee-2fea064a12a9:3640:1874622881650688:0@lo:250:kworker.0 10000000:01000000:1.0:1787780081.000458:0:15857:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1787780081.000465:0:15857:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc8fc0a517996017d 00000020:00000080:1.0:1787780081.000470:0:15857:0:(genops.c:885:class_export_put()) final put ffff9c0450070000/1f575176-36bc-4786-83ee-2fea064a12a9 00000020:01000000:1.0:1787780081.000484:0:15857:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.203.131@tcp (flags='') 00000020:00000080:1.0:1787780081.000489:0:15857:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787780081.000493:0:15857:0:(obd_config.c:956:class_cleanup()) MGC192.168.203.131@tcp: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1787780081.000497:0:15857:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff9c04515699b8) has no exports 00000020:00000080:2.0:1787780081.000534:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c0450070000/1f575176-36bc-4786-83ee-2fea064a12a9 for MGC192.168.203.131@tcp 10000000:01000000:3.0:1787780081.000612:0:6509:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:1.0:1787780081.000777:0:15857:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.203.131@tcp: client import never connected 00000100:00080000:1.0:1787780081.000781:0:15857:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:1.0:1787780081.000784:0:15857:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1787780081.000787:0:15857:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:1.0:1787780081.000789:0:15857:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1787780081.000827:0:15857:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787780081.000833:0:15857:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.203.131@tcp (uuid 1f575176-36bc-4786-83ee-2fea064a12a9) 00000020:00000080:2.0:1787780081.000874:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c0450075800 for MGC192.168.203.131@tcp 00000020:00000080:2.0:1787780081.000883:0:36:0:(genops.c:885:class_export_put()) final put ffff9c0450076000/1f575176-36bc-4786-83ee-2fea064a12a9 00000020:00000080:2.0:1787780081.000886:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c0450076000/1f575176-36bc-4786-83ee-2fea064a12a9 for MGC192.168.203.131@tcp 00000020:01000000:2.0:1787780081.000890:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.203.131@tcp (1f575176-36bc-4786-83ee-2fea064a12a9) 00000020:01000000:1.0:1787780081.001270:0:15857:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1787780081.001275:0:15857:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787780081.001280:0:15857:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1787780081.001286:0:15857:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9c0346f6c000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787780081.001296:0:15857:0:(genops.c:1553:class_disconnect_exports()) OBD device 25 (ffff9c0443138000) has exports, disconnecting them 00000020:00080000:1.0:1787780081.001301:0:15857:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9c0346f6c000), last request at 1787779825 00000020:00000080:1.0:1787780081.001306:0:15857:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc8fc0a5179960551 00000020:00080000:1.0:1787780081.001318:0:15857:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c0346f6c000): rc 0 00000020:00000080:1.0:1787780081.001321:0:15857:0:(genops.c:885:class_export_put()) final put ffff9c0346f6c000/lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1787780081.001600:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c0346f6c000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1787780081.007904:0:15857:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1787780081.007914:0:15857:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787780081.007918:0:15857:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787780081.007926:0:15857:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787780081.008033:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c0346f69000 for lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1787780081.008153:0:15857:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787780081.008166:0:15857:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:2.0:1787780081.008172:0:15857:0:(genops.c:885:class_export_put()) final put ffff9c0346f68000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:2.0:1787780081.008177:0:15857:0:(genops.c:844:class_export_destroy()) destroying export ffff9c0346f68000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:2.0:1787780081.008183:0:15857:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:2.0:1787780081.008244:0:15857:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1787780081.008256:0:15857:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787780081.008261:0:15857:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787780081.008269:0:15857:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff9c046dab6800 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787780081.008275:0:15857:0:(genops.c:1553:class_disconnect_exports()) OBD device 26 (ffff9c0477a1b370) has exports, disconnecting them 00000020:00080000:2.0:1787780081.008280:0:15857:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff9c046dab6800), last request at 1787779825 00000020:00000080:2.0:1787780081.008284:0:15857:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc8fc0a5179960566 00000020:00080000:2.0:1787780081.008299:0:15857:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c046dab6800): rc 0 00000020:00000080:2.0:1787780081.008305:0:15857:0:(genops.c:885:class_export_put()) final put ffff9c046dab6800/lustre-MDT0001-lwp-OST0001 00000020:00000080:3.0:1787780081.008464:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c046dab6800/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:3.0:1787780081.010904:0:15857:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:3.0:1787780081.010919:0:15857:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1787780081.010923:0:15857:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1787780081.010928:0:15857:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787780081.010951:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c048124a000 for lustre-MDT0001-lwp-OST0001 00010000:00010000:3.0:1787780081.010984:0:7453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:3.0:1787780081.011102:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:0.0:1787780081.050966:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:3.0:1787780081.052569:0:6496:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9c0471767c00:6496] 1 exiting: rc = 0 00000100:00100000:1.0:1787780081.052942:0:6495:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9c0471766600:6495] 0 exiting: rc = 1 00000100:00100000:0.0:1787780081.053483:0:8454:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_002: service thread [ffff9c0346a1c800:8454] 2 exiting: rc = 0 00000100:00100000:3.0:1787780081.053589:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787780081.053892:0:6498:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9c04604cac00:6498] 1 exiting: rc = 0 00000100:00100000:0.0:1787780081.053959:0:7921:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9c046eedba00:7921] 3 exiting: rc = 0 00000100:00100000:0.0:1787780081.055164:0:6499:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9c04604cb200:6499] 2 exiting: rc = 0 00000100:00100000:1.0:1787780081.057398:0:6497:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9c04604c8400:6497] 0 exiting: rc = 1 00000100:00100000:3.0:1787780081.057516:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.057525:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.057530:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.057536:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.057541:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.057546:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.057551:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.057557:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.057562:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.057568:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.057699:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.057828:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.057857:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.057864:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.057869:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.057874:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.057879:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.057885:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.057890:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.057898:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.057903:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.057907:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.057912:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.057917:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.057922:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.057927:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.057942:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.057947:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.057952:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.057957:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.057962:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.057967:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.057972:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.057977:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.057982:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.057987:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.057992:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.057996:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.058002:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.058007:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.058012:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.058018:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.058023:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.058028:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.058033:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.058037:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.058042:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.058048:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.058053:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.058058:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.058063:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.058068:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.058073:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.058077:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.058081:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.058086:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.058090:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.058094:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.058099:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.058103:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.058108:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.058118:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.058131:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.058136:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1787780081.059799:0:15857:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787780081.059813:0:15857:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:3.0:1787780081.059819:0:15857:0:(genops.c:885:class_export_put()) final put ffff9c048124b000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:3.0:1787780081.059823:0:15857:0:(genops.c:844:class_export_destroy()) destroying export ffff9c048124b000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:3.0:1787780081.059828:0:15857:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:3.0:1787780081.059906:0:15857:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c0346bcb000 1 00000020:00000080:3.0:1787780081.059912:0:15857:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc8fc0a51799604f6 00000020:00000080:3.0:1787780081.059919:0:15857:0:(genops.c:885:class_export_put()) final put ffff9c0346bc8800/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1787780081.059933:0:15857:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1787780081.059937:0:15857:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787780081.059941:0:15857:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00000080:0.0:1787780081.059942:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c0346bc8800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00080000:3.0:1787780081.059944:0:15857:0:(genops.c:1558:class_disconnect_exports()) OBD device 23 (ffff9c044313cd28) has no exports 00000020:00000080:1.0:1787780081.114200:0:15857:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787780081.114213:0:15857:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:1.0:1787780081.114219:0:15857:0:(genops.c:885:class_export_put()) final put ffff9c0346bc8000/lustre-OST0001-osd_UUID 00000020:00000080:1.0:1787780081.114232:0:15857:0:(genops.c:844:class_export_destroy()) destroying export ffff9c0346bc8000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1787780081.114244:0:15857:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:2.0:1787780081.116778:0:15857:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9c0346bcf800 00000020:01000000:2.0:1787780081.116812:0:15857:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:2.0:1787780081.116820:0:15857:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787780081.116824:0:15857:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787780081.116829:0:15857:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff9c04431399b8) has no exports 00000020:00000080:2.0:1787780081.117466:0:15857:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787780081.117478:0:15857:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:2.0:1787780081.117483:0:15857:0:(genops.c:885:class_export_put()) final put ffff9c046efbf000/OSS_uuid 00000020:00000080:2.0:1787780081.117487:0:15857:0:(genops.c:844:class_export_destroy()) destroying export ffff9c046efbf000/OSS_uuid for OSS 00000020:01000000:2.0:1787780081.117497:0:15857:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:2.0:1787780081.117629:0:8430:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9c0471761400:8430] 2 exiting: rc = 0 00000100:00100000:0.0:1787780081.118610:0:8428:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9c046eedb200:8428] 1 exiting: rc = 0 00000100:00100000:3.0:1787780081.119554:0:9899:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9c0347c0fe00:9899] 3 exiting: rc = 0 00000100:00100000:2.0:1787780081.120486:0:8427:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9c046eedac00:8427] 0 exiting: rc = 1 00000100:00080000:1.0:1787780081.121467:0:6508:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:2.0:1787780081.124113:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780081.124135:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780081.124143:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780081.124161:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780081.124170:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780081.124178:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780081.124184:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780081.124189:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780081.124195:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780081.124201:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780081.124206:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780081.124212:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780081.124231:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780081.124238:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780081.124244:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780081.124249:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780081.124255:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780081.124260:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780081.124266:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780081.124272:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780081.124277:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780081.124282:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780081.124288:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780081.124293:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780081.124298:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780081.124304:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780081.124310:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780081.124315:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780081.124321:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780081.124327:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780081.124332:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780081.124338:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780081.124343:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780081.124349:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780081.124354:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780081.124369:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780081.124376:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780081.124382:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780081.124388:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780081.124393:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780081.124399:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780081.124405:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780081.124410:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780081.124416:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780081.124421:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780081.124427:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780081.124432:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780081.124445:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780081.124450:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780081.124456:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780081.124461:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780081.124467:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780081.124473:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780081.124479:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780081.124485:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780081.124491:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780081.124496:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780081.124501:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780081.124506:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780081.124511:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780081.124517:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780081.124521:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780081.124533:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780081.124540:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787780081.127645:0:8431:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9c0471760800:8431] 0 exiting: rc = 1 00000100:00100000:2.0:1787780081.127954:0:8432:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9c046eef1a00:8432] 1 exiting: rc = 0 00000100:00100000:3.0:1787780081.131567:0:8529:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff9c04766ab000:8529] 2 exiting: rc = 0 00000100:00100000:2.0:1787780081.134870:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780081.134882:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780081.134889:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780081.134895:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780081.134901:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780081.134906:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780081.134912:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780081.134917:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780081.134923:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780081.134928:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780081.134933:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780081.134938:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780081.134944:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780081.134950:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780081.134955:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780081.134961:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780081.134965:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780081.134983:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780081.134988:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780081.134993:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780081.134998:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780081.135003:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780081.135008:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780081.135014:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780081.135019:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780081.135024:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780081.135030:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780081.135035:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780081.135041:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780081.135047:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780081.135053:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780081.135058:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780081.135063:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780081.135069:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780081.135074:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780081.135080:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780081.135085:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780081.135090:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780081.135095:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780081.135101:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780081.135105:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780081.135111:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780081.135116:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780081.135130:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780081.135136:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780081.135142:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780081.135147:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780081.135152:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780081.135157:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780081.135162:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780081.135168:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780081.135173:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780081.135187:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780081.135192:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780081.135198:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780081.135202:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780081.135207:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780081.135212:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780081.135217:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780081.135222:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780081.135228:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780081.135234:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780081.135239:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780081.135252:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787780081.140892:0:8434:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9c046eedfe00:8434] 1 exiting: rc = 0 00000100:00100000:2.0:1787780081.141128:0:8433:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9c046eedf400:8433] 0 exiting: rc = 1 00000100:00100000:0.0:1787780081.141301:0:8435:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9c046eef1800:8435] 2 exiting: rc = 0 00000100:00100000:1.0:1787780081.142062:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780081.142071:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780081.142077:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780081.142083:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780081.142088:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780081.142094:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780081.142108:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780081.142116:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780081.142130:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780081.142136:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780081.142141:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780081.142146:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780081.142152:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780081.142158:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780081.142163:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780081.142169:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780081.142175:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780081.142181:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780081.142187:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780081.142193:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780081.142199:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780081.142204:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780081.142210:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780081.142227:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780081.142235:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780081.142241:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780081.142247:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780081.142252:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780081.142258:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780081.142264:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780081.142270:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780081.142276:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780081.142293:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780081.142299:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780081.142303:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780081.142309:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780081.142314:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780081.142320:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780081.142326:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780081.142331:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780081.142337:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780081.142343:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780081.142349:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780081.142355:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780081.142370:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780081.142376:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780081.142381:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780081.142400:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780081.142407:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780081.142413:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780081.142419:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780081.142424:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780081.142429:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780081.142436:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780081.142441:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780081.142448:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780081.142463:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780081.142477:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780081.142484:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780081.142490:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780081.142495:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780081.142501:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780081.142507:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787780081.142518:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787780081.155654:0:8437:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9c046eede600:8437] 1 exiting: rc = 0 00000100:00100000:1.0:1787780081.155887:0:8436:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9c046ece6400:8436] 0 exiting: rc = 1 00000100:00100000:3.0:1787780081.156052:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.156061:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.156066:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.156071:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.156077:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.156082:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.156088:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.156094:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.156099:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.156104:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.156109:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.156115:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.156132:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.156138:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.156143:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.156149:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.156169:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.156175:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.156180:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.156186:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.156191:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.156197:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.156202:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.156207:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.156212:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.156217:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.156223:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.156227:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.156232:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.156237:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.156241:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.156246:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.156252:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.156258:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.156262:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.156267:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.156272:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.156277:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.156288:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.156295:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.156301:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.156305:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.156310:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.156315:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.156321:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.156327:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.156332:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.156337:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.156341:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.156346:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.156351:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.156378:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.156385:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.156391:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.156396:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.156401:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.156406:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.156411:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.156417:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.156422:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.156427:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.156432:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.156437:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.156446:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787780081.157432:0:8439:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9c046eede200:8439] 1 exiting: rc = 0 00000100:00100000:1.0:1787780081.157622:0:8438:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9c046eedf800:8438] 0 exiting: rc = 1 00000100:00100000:3.0:1787780081.157788:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.157804:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.157813:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.157818:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.157824:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.157830:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.157922:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.157932:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.157938:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.157946:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.157953:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.157959:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.157966:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.157974:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.157981:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.157988:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.157994:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.158002:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.158024:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.158030:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.158037:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.158043:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.158061:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.158067:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.158072:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.158079:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.158085:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.158090:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.158096:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.158102:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.158131:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.158139:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.158146:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.158153:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.158159:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.158165:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.158171:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.158177:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.158183:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.158189:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.158194:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.158199:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.158219:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.158226:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.158231:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.158236:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.158243:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.158248:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.158253:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.158259:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.158265:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.158271:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.158277:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.158282:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.158304:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.158311:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.158317:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.158330:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.158337:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.158344:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.158351:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.158470:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.158482:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787780081.158499:0:15857:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1787780081.171519:0:15857:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:2.0:1787780102.494337:0:16621:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg331-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1787780112.678100:0:17221:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787780112.678112:0:17221:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:1.0:1787780112.678113:0:17221:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1787780112.678224:0:17221:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9c0447266000 00000020:01000004:1.0:1787780112.678240:0:17221:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:1.0:1787780112.678247:0:17221:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1787780112.678260:0:17221:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9c0445fc4d28) 00000020:00000080:1.0:1787780112.678272:0:17221:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1787780112.715464:0:17221:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:1.0:1787780112.719185:0:17221:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1787780112.719981:0:17221:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:1.0:1787780112.720208:0:17221:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1787780112.720636:0:17221:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:1.0:1787780112.720970:0:17221:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:1.0:1787780112.721191:0:17221:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1787780112.721471:0:17221:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1787780112.721689:0:17221:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:1.0:1787780112.721910:0:17221:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:1.0:1787780112.722102:0:17221:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:1.0:1787780112.722446:0:17221:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:1.0:1787780112.722674:0:17221:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:1.0:1787780112.722882:0:17221:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:1.0:1787780112.723693:0:17221:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:1.0:1787780112.724790:0:17221:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:1.0:1787780112.725100:0:17221:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:1.0:1787780112.725439:0:17221:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:1.0:1787780112.725657:0:17221:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:1.0:1787780112.725884:0:17221:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:1.0:1787780112.726110:0:17221:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:1.0:1787780112.726436:0:17221:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:1.0:1787780112.726670:0:17221:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:1.0:1787780112.726914:0:17221:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:1.0:1787780112.727128:0:17221:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:1.0:1787780112.727444:0:17221:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:1.0:1787780112.727646:0:17221:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:1.0:1787780112.727912:0:17221:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:1.0:1787780112.728107:0:17221:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:1.0:1787780112.728442:0:17221:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:1.0:1787780112.728671:0:17221:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:2.0:1787780112.729059:0:17221:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1787780112.729470:0:17221:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:2.0:1787780112.729711:0:17221:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1787780112.729932:0:17221:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1787780112.730205:0:17221:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1787780112.730471:0:17221:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:2.0:1787780112.730668:0:17221:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1787780112.730959:0:17221:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1787780112.731190:0:17221:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1787780112.731503:0:17221:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1787780112.731729:0:17221:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:2.0:1787780112.731993:0:17221:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1787780112.732289:0:17221:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1787780112.732582:0:17221:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1787780112.732774:0:17221:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:2.0:1787780112.733103:0:17221:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:2.0:1787780112.737611:0:17221:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:2.0:1787780112.738092:0:17221:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:2.0:1787780112.738330:0:17221:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:2.0:1787780112.738828:0:17221:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:2.0:1787780112.739116:0:17221:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:2.0:1787780112.739341:0:17221:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:01000000:2.0:1787780112.740240:0:17221:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1787780112.740455:0:17221:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1787780112.740461:0:17221:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787780112.740473:0:17221:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc8fc0a517996173a 00000020:01000004:2.0:1787780112.740480:0:17221:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:2.0:1787780112.740485:0:17221:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1787780112.740490:0:17221:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9c0447266000 from MGS 00000020:01000004:2.0:1787780112.740494:0:17221:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1787780112.740503:0:17221:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9c0443138000) 00000020:00000080:2.0:1787780112.740513:0:17221:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1787780112.740576:0:17221:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c0447266000 from MGS, refs=2 00080000:01000000:2.0:1787780112.740580:0:17221:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787780112.740585:0:17221:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc8fc0a5179961748 00000100:00100000:2.0:1787780112.740679:0:17221:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1787780112.740793:0:17221:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1787780112.740799:0:17221:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1787780112.741496:0:17221:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1787780112.741504:0:17221:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1787780112.742515:0:17221:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787780112.742663:0:17221:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1787780112.742669:0:17221:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1787780112.743408:0:17221:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1787780112.743416:0:17221:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1787780112.743691:0:17221:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1787780112.743698:0:17221:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1787780112.744532:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787780112.744536:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787780112.744538:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787780112.744789:0:17231:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787780112.744792:0:17231:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787780112.744793:0:17231:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787780112.745476:0:17221:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1787780112.749946:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1787780112.750001:0:17221:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:3.0:1787780112.750759:0:17233:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1787780112.750798:0:17221:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1787780112.750830:0:17221:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787780112.751392:0:17221:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1787780112.751696:0:17221:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787780112.751861:0:17221:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1787780112.751867:0:17221:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1787780112.755568:0:17221:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1787780112.755582:0:17221:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1787780112.758467:0:17221:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1787780112.758481:0:17221:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000100:00080000:1.0:1787780112.759938:0:17238:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:2.0:1787780112.760131:0:17221:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1787780112.760214:0:17221:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.131@tcp' 00000020:01000004:2.0:1787780112.760216:0:17221:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1787780112.760245:0:17221:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.131@tcp (typ=mgc) 00000020:00000080:2.0:1787780112.760257:0:17221:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.131@tcp (ffff9c04431399b8) 00000020:00000080:2.0:1787780112.760278:0:17221:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1787780112.760427:0:17221:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c0347e3a000@MGC192.168.203.131@tcp: add connection 192.168.203.131@tcp at head 00010000:00010000:2.0:1787780112.760575:0:17221:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.131@tcp-0 is initialized 00000040:01000000:2.0:1787780112.760581:0:17221:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.131@tcp ctxt 1 is initialized 10000000:01000000:0.0:1787780112.760980:0:17239:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1787780112.761050:0:17221:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.131@tcp (uuid 8a551391-c6f4-42cf-bfe4-f12cef7d26fb) 00000020:00000080:2.0:1787780112.761065:0:17221:0:(genops.c:1385:class_connect()) connect: client 8a551391-c6f4-42cf-bfe4-f12cef7d26fb, cookie 0xc8fc0a5179961756 00000100:00080000:2.0:1787780112.761074:0:17221:0:(import.c:510:import_select_connection()) MGC192.168.203.131@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787780112.761080:0:17221:0:(import.c:624:import_select_connection()) MGC192.168.203.131@tcp: import ffff9c0347e3a000 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:2.0:1787780112.761111:0:17221:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c0348a0ad00 x1874622881651200/t0(0) o250->MGC192.168.203.131@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787780112.761144:0:17221:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 8a551391-c6f4-42cf-bfe4-f12cef7d26fb->MGS 00000020:01000004:2.0:1787780112.761164:0:17221:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1787780112.761169:0:17221:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1787780112.761179:0:17221:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9c044313cd28) 00000020:00000080:2.0:1787780112.761187:0:17221:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1787780112.762994:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348a0ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:3640:1874622881651200:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1787780112.763063:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780112.763258:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881651200 00000100:00100000:3.0:1787780112.763267:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881651200 00000100:00100000:3.0:1787780112.763298:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787780112.763305:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c044502e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3640:x1874622881651200:12345-0@lo:250:mount.lustre.0 00010000:00080000:3.0:1787780112.763329:0:17234:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 8a551391-c6f4-42cf-bfe4-f12cef7d26fb@0@lo t0 exp 0000000000000000 cur 520 last 0 00000020:00000080:3.0:1787780112.763417:0:17234:0:(genops.c:1385:class_connect()) connect: client 8a551391-c6f4-42cf-bfe4-f12cef7d26fb, cookie 0xc8fc0a5179961764 00000100:00080000:3.0:1787780112.763542:0:17234:0:(import.c:65:import_set_state_nolock()) ffff9c0348850000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787780112.763593:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c044502e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+5:3640:x1874622881651200:12345-0@lo:250:mount.lustre.0 Request processed in 287us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780112.763601:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787780112.763689:0:3640:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.203.131@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1787780112.763698:0:3640:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.131@tcp: connect to target with instance 0 00000100:00080000:0.0:1787780112.763704:0:3640:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.131@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1787780112.763709:0:3640:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1787780112.763712:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9c0347e3a000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1787780112.763714:0:3640:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1787780112.763722:0:3640:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1787780112.763727:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348a0ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:3640:1874622881651200:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1787780112.774261:0:17221:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787780112.774442:0:17221:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1787780112.774448:0:17221:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1787780112.775016:0:17221:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1787780112.775023:0:17221:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1787780112.775646:0:17221:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1787780112.775657:0:17221:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1787780112.776465:0:17221:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787780112.776618:0:17221:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1787780112.776624:0:17221:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1787780112.777117:0:17221:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1787780112.777124:0:17221:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1787780112.816013:0:17221:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787780112.816207:0:17221:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1787780112.816214:0:17221:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1787780112.817302:0:17221:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1787780112.817311:0:17221:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1787780112.819411:0:17221:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787780112.819605:0:17221:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787780112.819610:0:17221:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1787780112.820341:0:17221:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787780112.820349:0:17221:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1787780112.820774:0:17221:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787780112.820960:0:17221:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787780112.820965:0:17221:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1787780112.821398:0:17221:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787780112.821404:0:17221:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1787780112.824951:0:17221:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787780112.825135:0:17221:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787780112.825141:0:17221:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1787780112.825706:0:17221:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787780112.825712:0:17221:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1787780112.848434:0:17221:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787780112.848637:0:17221:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1787780112.848644:0:17221:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1787780112.854686:0:17221:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1787780112.854700:0:17221:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1787780112.856121:0:17221:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1787780112.856133:0:17221:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1787780112.856891:0:17221:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1787780112.856927:0:17221:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:3.0:1787780112.856932:0:17221:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.131@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1787780112.857039:0:17221:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.131@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787780112.857090:0:17221:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.131@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1787780112.857094:0:17221:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787780112.857096:0:17221:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787780112.857097:0:17221:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787780112.857099:0:17221:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787780112.857100:0:17221:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787780112.857101:0:17221:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787780112.857103:0:17221:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787780112.857104:0:17221:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787780112.857106:0:17221:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787780112.857111:0:17221:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787780112.857114:0:17221:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1787780112.857116:0:17221:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787780112.857117:0:17221:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787780112.857118:0:17221:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787780112.857119:0:17221:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787780112.857120:0:17221:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787780112.857121:0:17221:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787780112.857122:0:17221:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787780112.857123:0:17221:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787780112.857124:0:17221:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787780112.857125:0:17221:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787780112.857149:0:17221:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1787780112.857166:0:17221:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347dade00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17221:1874622881651328:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787780112.857231:0:17221:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780112.857275:0:17221:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c04436230c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787780112.859357:0:17237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881651328 00000100:00100000:2.0:1787780112.859369:0:17237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881651328 00000100:00100000:2.0:1787780112.859421:0:17237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787780112.859431:0:17237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c044502f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+5:17221:x1874622881651328:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787780112.859472:0:17237:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1787780112.859489:0:17237:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1787780112.859492:0:17237:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:2.0:1787780112.860465:0:17258:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1787780112.861158:0:17237:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 6 20000000:01000000:1.0:1787780112.862547:0:17259:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1787780112.862553:0:17259:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:1.0:1787780112.862556:0:17259:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1787780112.862559:0:17259:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1787780112.862773:0:17259:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:2.0:1787780112.864233:0:17237:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1787780112.864245:0:17237:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1787780112.867394:0:17237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c044502f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+5:17221:x1874622881651328:12345-0@lo:253:mount.lustre.0 Request processed in 7956us (10154us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780112.867414:0:17237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787780112.867572:0:17221:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347dade00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17221:1874622881651328:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787780112.867587:0:17221:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1787780112.867590:0:17221:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787780112.867591:0:17221:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787780112.867593:0:17221:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787780112.867594:0:17221:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787780112.867595:0:17221:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787780112.867597:0:17221:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787780112.867598:0:17221:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787780112.867600:0:17221:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787780112.867602:0:17221:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787780112.867603:0:17221:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787780112.867620:0:17221:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9c0447266000 from lustre-MDT0000 10000000:01000000:3.0:1787780112.867653:0:17221:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1787780112.867656:0:17221:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1787780112.867661:0:17221:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9c04431399b8 10000000:01000000:3.0:1787780112.867665:0:17221:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787780112.867672:0:17221:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9c04431399b8 from 1 10000000:01000000:3.0:1787780112.867675:0:17221:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787780112.867707:0:17221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c04766dde00/0xc8fc0a517996176b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780112.867729:0:17221:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff9c04766dde00/0xc8fc0a517996176b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780112.867739:0:17221:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff9c04766dde00/0xc8fc0a517996176b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787780112.867758:0:17221:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347dade00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17221:1874622881651456:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787780112.867791:0:17221:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780112.867915:0:17221:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0443623480 going to sleep for 11 seconds 00000100:00100000:2.0:1787780112.873833:0:17236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881651456 00000100:00100000:2.0:1787780112.877073:0:17236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881651456 00000100:00100000:2.0:1787780112.877209:0:17236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787780112.877221:0:17236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c044502c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+5:17221:x1874622881651456:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787780112.877241:0:17236:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787780112.877265:0:17236:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0444c18e00/0xc8fc0a5179961772 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc8fc0a517996176b expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780112.877293:0:17236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0444c18e00/0xc8fc0a5179961772 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc8fc0a517996176b expref: 6 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780112.877305:0:17236:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0444c18e00/0xc8fc0a5179961772 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a517996176b expref: 6 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780112.877314:0:17236:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0444c18e00, rc 0) 00000100:00100000:2.0:1787780112.877465:0:17236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c044502c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+6:17221:x1874622881651456:12345-0@lo:101:mount.lustre.0 Request processed in 246us (9672us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780112.877472:0:17236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787780112.878098:0:17221:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347dade00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17221:1874622881651456:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787780112.878119:0:17221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff9c04766dde00/0xc8fc0a517996176b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a5179961772 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780112.878197:0:17221:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff9c04766dde00/0xc8fc0a517996176b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc8fc0a5179961772 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787780112.878278:0:17221:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347dade00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17221:1874622881651584:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787780112.878316:0:17221:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780112.878354:0:17221:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0443623480 going to sleep for 11 seconds 00000100:00100000:1.0:1787780112.878917:0:17237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881651584 00000100:00100000:1.0:1787780112.878924:0:17237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881651584 00000100:00100000:1.0:1787780112.878980:0:17237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787780112.878990:0:17237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c044502f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+6:17221:x1874622881651584:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787780112.879340:0:17237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c044502f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+6:17221:x1874622881651584:12345-0@lo:501:mount.lustre.0 Request processed in 350us (1023us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787780112.879347:0:17237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787780112.881879:0:17221:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347dade00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17221:1874622881651584:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1787780112.881944:0:17221:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1787780112.882094:0:17221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c04766dde00/0xc8fc0a517996176b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a5179961772 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780112.882105:0:17221:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff9c04766dde00/0xc8fc0a517996176b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a5179961772 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787780112.882130:0:17221:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9c0447266000 10000000:01000000:2.0:1787780112.882137:0:17221:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787780112.882143:0:17221:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9c0447266000 10000000:01000000:2.0:1787780112.882146:0:17221:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1787780112.882149:0:17221:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9c0447266000 from 1 10000000:01000000:2.0:1787780112.882152:0:17221:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1787780112.882197:0:17221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c0444c18c00/0xc8fc0a5179961779 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780112.882205:0:17221:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff9c0444c18c00/0xc8fc0a5179961779 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780112.882215:0:17221:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff9c0444c18c00/0xc8fc0a5179961779 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787780112.882235:0:17221:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348a0bc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17221:1874622881651712:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787780112.882312:0:17221:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787780112.882350:0:17221:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c04778dcc00 going to sleep for 11 seconds 00000100:00100000:3.0:1787780112.882697:0:17236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881651712 00000100:00100000:3.0:1787780112.882704:0:17236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881651712 00000100:00100000:3.0:1787780112.882755:0:17236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787780112.882765:0:17236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c044502d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+6:17221:x1874622881651712:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787780112.882778:0:17236:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787780112.882793:0:17236:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c04766dce00/0xc8fc0a5179961780 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc8fc0a5179961779 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780112.882830:0:17236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c04766dce00/0xc8fc0a5179961780 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc8fc0a5179961779 expref: 7 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780112.882885:0:17236:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c04766dce00/0xc8fc0a5179961780 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a5179961779 expref: 7 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780112.882894:0:17236:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c04766dce00, rc 0) 00000100:00100000:3.0:1787780112.882951:0:17236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c044502d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+7:17221:x1874622881651712:12345-0@lo:101:mount.lustre.0 Request processed in 189us (639us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780112.882959:0:17236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787780112.883109:0:17221:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348a0bc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17221:1874622881651712:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787780112.883122:0:17221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff9c0444c18c00/0xc8fc0a5179961779 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a5179961780 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780112.883132:0:17221:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff9c0444c18c00/0xc8fc0a5179961779 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc8fc0a5179961780 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787780112.883146:0:17221:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1787780112.883153:0:17221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c0444c18c00/0xc8fc0a5179961779 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a5179961780 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780112.883166:0:17221:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff9c0444c18c00/0xc8fc0a5179961779 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a5179961780 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787780112.883174:0:17221:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1787780112.883177:0:17221:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787780112.883182:0:17221:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9c0447266000 10000000:01000000:2.0:1787780112.883184:0:17221:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1787780112.883188:0:17221:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1787780112.883190:0:17221:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1787780112.883213:0:17221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c0444c18400/0xc8fc0a5179961787 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780112.883221:0:17221:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff9c0444c18400/0xc8fc0a5179961787 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780112.883228:0:17221:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff9c0444c18400/0xc8fc0a5179961787 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787780112.883242:0:17221:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348a0bc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17221:1874622881651840:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787780112.883269:0:17221:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780112.883330:0:17237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881651840 00000100:00100000:1.0:1787780112.883335:0:17237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881651840 00000100:00100000:1.0:1787780112.883369:0:17237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787780112.883370:0:17221:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c04778dcc00 going to sleep for 11 seconds 00000100:00100000:1.0:1787780112.883378:0:17237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c044502d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+7:17221:x1874622881651840:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787780112.883386:0:17237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787780112.883397:0:17237:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0347e4a600/0xc8fc0a517996178e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc8fc0a5179961787 expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780112.883411:0:17237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0347e4a600/0xc8fc0a517996178e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc8fc0a5179961787 expref: 8 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780112.883420:0:17237:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0347e4a600/0xc8fc0a517996178e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a5179961787 expref: 8 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780112.883427:0:17237:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0347e4a600, rc 0) 00000100:00100000:1.0:1787780112.883464:0:17237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c044502d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+8:17221:x1874622881651840:12345-0@lo:101:mount.lustre.0 Request processed in 89us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780112.883469:0:17237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787780112.883521:0:17221:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348a0bc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17221:1874622881651840:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787780112.883537:0:17221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff9c0444c18400/0xc8fc0a5179961787 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a517996178e expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780112.883544:0:17221:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff9c0444c18400/0xc8fc0a5179961787 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc8fc0a517996178e expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787780112.883606:0:17221:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348a0bc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17221:1874622881651968:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787780112.883630:0:17221:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787780112.883654:0:17221:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c04778dcc00 going to sleep for 11 seconds 00000100:00100000:1.0:1787780112.883798:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881651968 00000100:00100000:1.0:1787780112.883802:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881651968 00000100:00100000:1.0:1787780112.883893:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787780112.883911:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c044502e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+8:17221:x1874622881651968:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787780112.884046:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c044502e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+9:17221:x1874622881651968:12345-0@lo:501:mount.lustre.0 Request processed in 136us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780112.884054:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787780112.884242:0:17221:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348a0bc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17221:1874622881651968:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787780112.884276:0:17221:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347dad680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17221:1874622881652096:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787780112.884320:0:17221:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780112.884351:0:17221:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0443623a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787780112.884386:0:17236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881652096 00000100:00100000:2.0:1787780112.884391:0:17236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881652096 00000100:00100000:2.0:1787780112.884422:0:17236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787780112.884429:0:17236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0478633850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+9:17221:x1874622881652096:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787780112.885547:0:17236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0478633850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+9:17221:x1874622881652096:12345-0@lo:503:mount.lustre.0 Request processed in 1114us (1223us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780112.885557:0:17236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787780112.887074:0:17221:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347dad680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17221:1874622881652096:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787780112.889585:0:17260:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346cfed00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17260:1874622881652224:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787780112.889664:0:17260:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787780112.889751:0:17260:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0347ec69c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787780112.889792:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881652224 00000100:00100000:1.0:1787780112.889798:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881652224 00000100:00100000:1.0:1787780112.889976:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787780112.889987:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0478632c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+9:17260:x1874622881652224:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787780112.890710:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0478632c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+9:17260:x1874622881652224:12345-0@lo:502:llog_process_th.0 Request processed in 723us (1044us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780112.890719:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787780112.890796:0:17260:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346cfed00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17260:1874622881652224:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787780112.890828:0:17260:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787780112.891036:0:17260:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787780112.891039:0:17260:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1787780112.891167:0:17260:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1787780112.891172:0:17260:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787780112.891188:0:17260:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9c0477a199b8) 00000020:00000080:0.0:1787780112.891204:0:17260:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1787780112.891210:0:17260:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1787780112.891307:0:17260:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:0.0:1787780112.891318:0:17260:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc8fc0a517996179c 00000020:00000080:0.0:1787780112.891515:0:17260:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1787780112.891521:0:17260:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787780112.891525:0:17260:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787780112.891526:0:17260:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1787780112.891529:0:17260:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787780112.891533:0:17260:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787780112.891534:0:17260:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1787780112.891538:0:17260:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787780112.891545:0:17260:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9c0477a1cd28) 00000020:00000080:0.0:1787780112.891554:0:17260:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1787780112.891558:0:17260:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1787780112.891560:0:17260:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1787780112.891563:0:17260:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1787780112.891569:0:17260:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787780112.891609:0:17260:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c0447266000 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1787780112.891621:0:17260:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9c0477a1b370) 00000020:00000080:0.0:1787780112.891628:0:17260:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1787780112.891674:0:17260:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1787780112.891679:0:17260:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc8fc0a51799617b1 00000020:00000080:0.0:1787780112.891763:0:17260:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1787780112.891768:0:17260:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1787780112.891772:0:17260:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xc8fc0a51799617b8 00080000:01000000:0.0:1787780112.891776:0:17260:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:0.0:1787780112.891779:0:17260:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc8fc0a51799617bf 00010000:00010000:2.0:1787780112.956597:0:17260:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1787780112.957074:0:17260:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967528 00000001:00080000:2.0:1787780112.957412:0:17260:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1787780112.957824:0:17260:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9c044313b370) 00000020:00000080:2.0:1787780112.958212:0:17260:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1787780112.958290:0:17260:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:2.0:1787780112.958297:0:17260:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc8fc0a51799617cd 00000020:00000080:2.0:1787780112.962713:0:17260:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1787780112.965248:0:17260:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xc8fc0a51799617d4 00000020:00000080:2.0:1787780112.967402:0:17260:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1787780112.967416:0:17260:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787780112.967425:0:17260:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787780112.967427:0:17260:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1787780112.967430:0:17260:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787780112.967433:0:17260:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:2.0:1787780112.967435:0:17260:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787780112.967436:0:17260:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787780112.967453:0:17260:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787780112.967456:0:17260:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787780112.967458:0:17260:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787780112.967461:0:17260:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787780112.967467:0:17260:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787780112.967468:0:17260:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1787780112.967472:0:17260:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1787780112.967525:0:17260:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1787780112.967542:0:17260:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787780112.967546:0:17260:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787780112.967548:0:17260:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1787780112.967550:0:17260:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787780112.967553:0:17260:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787780112.967554:0:17260:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:2.0:1787780112.967557:0:17260:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787780112.967562:0:17260:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.131@tcp to nid 0x20000c0a8cb83 (192.168.203.131@tcp) 00000020:00000080:2.0:1787780112.967589:0:17260:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787780112.967605:0:17260:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9c0450cecd28) 00000020:00000080:2.0:1787780112.967622:0:17260:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1787780112.967627:0:17260:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787780112.967683:0:17260:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:2.0:1787780112.967689:0:17260:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:2.0:1787780112.967695:0:17260:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc8fc0a51799617e2 00010000:00080000:2.0:1787780112.967737:0:17260:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c04811dd800@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.131@tcp at head 00010000:00010000:2.0:1787780112.971749:0:17260:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:2.0:1787780112.976652:0:17260:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787780112.976668:0:17260:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1787780112.976705:0:17260:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:2.0:1787780112.976725:0:17260:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc8fc0a51799617e9 00000100:00080000:2.0:1787780112.976735:0:17260:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787780112.976742:0:17260:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9c04811dd800 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:2.0:1787780112.976777:0:17260:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c0348a092c0 x1874622881652352/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787780112.976879:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348a092c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1874622881652352:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787780112.976952:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780112.977104:0:17247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881652352 00000100:00100000:1.0:1787780112.977111:0:17247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881652352 00000100:00100000:1.0:1787780112.977156:0:17247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787780112.977163:0:17247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346cfed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3640:x1874622881652352:12345-0@lo:38:llog_process_th.0 00010000:00020000:1.0:1787780112.977177:0:17247:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:2.0:1787780112.980245:0:17260:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:2.0:1787780112.980344:0:17260:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787780112.980351:0:17260:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787780112.980353:0:17260:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:2.0:1787780112.980357:0:17260:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787780112.980360:0:17260:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #20 00000020:01000000:2.0:1787780112.980362:0:17260:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787780112.980363:0:17260:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787780112.980365:0:17260:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787780112.980368:0:17260:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787780112.980369:0:17260:0:(obd_config.c:1563:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787780112.980372:0:17260:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787780112.980377:0:17260:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1787780112.980380:0:17260:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787780112.980382:0:17260:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1787780112.980385:0:17260:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787780112.980389:0:17260:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.131@tcp to nid 0x20000c0a8cb83 (192.168.203.131@tcp) 00000020:01000000:2.0:1787780112.980416:0:17260:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1787780112.980419:0:17260:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787780112.980434:0:17260:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9c0450ce99b8) 00000020:00000080:2.0:1787780112.980451:0:17260:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:2.0:1787780112.980457:0:17260:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787780112.980532:0:17260:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1787780112.980538:0:17260:0:(osd_handler.c:8925:osd_obd_connect()) connect #6 00000020:00000080:2.0:1787780112.980543:0:17260:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc8fc0a51799617f7 00010000:00080000:2.0:1787780112.980573:0:17260:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c047787a000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.131@tcp at head 00010000:00010000:2.0:1787780112.980800:0:17260:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000040:01000000:2.0:1787780112.981612:0:17260:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1787780112.981797:0:17260:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1787780112.991243:0:17260:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787780112.991582:0:17260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:3.0:1787780113.003452:0:17260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000100:00100000:0.0:1787780113.009269:0:17247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346cfed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3640:x1874622881652352:12345-0@lo:38:llog_process_th.0 Request processed in 32094us (32306us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787780113.009288:0:17247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000040:00080000:2.0:1787780113.009874:0:17266:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1787780113.009880:0:17266:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1787780113.010607:0:17260:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787780113.010620:0:17260:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1787780113.010662:0:17260:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1787780113.010680:0:17260:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc8fc0a51799617fe 00000100:00080000:0.0:1787780113.010688:0:17260:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787780113.010694:0:17260:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9c047787a000 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:0.0:1787780113.010725:0:17260:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c0346cff0c0 x1874622881652480/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787780113.010740:0:17260:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1787780113.010796:0:17260:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787780113.010800:0:17260:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787780113.010802:0:17260:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1787780113.010804:0:17260:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787780113.010807:0:17260:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:0.0:1787780113.010809:0:17260:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787780113.010810:0:17260:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787780113.010812:0:17260:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787780113.010814:0:17260:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787780113.010816:0:17260:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:0.0:1787780113.010818:0:17260:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787780113.010822:0:17260:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1787780113.010825:0:17260:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787780113.010826:0:17260:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1787780113.010829:0:17260:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787780113.010833:0:17260:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.131@tcp to nid 0x20000c0a8cb83 (192.168.203.131@tcp) 00000020:01000000:0.0:1787780113.010883:0:17260:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1787780113.010886:0:17260:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787780113.010907:0:17260:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9c0477a18000) 00000020:00000080:0.0:1787780113.010917:0:17260:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:0.0:1787780113.010921:0:17260:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787780113.010982:0:17260:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1787780113.010988:0:17260:0:(osd_handler.c:8925:osd_obd_connect()) connect #7 00000020:00000080:0.0:1787780113.010998:0:17260:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc8fc0a517996180c 00010000:00080000:0.0:1787780113.011024:0:17260:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c044963b000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.131@tcp at head 00010000:00010000:0.0:1787780113.011223:0:17260:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:0.0:1787780113.011282:0:17260:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1787780113.011295:0:17260:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00080000:2.0:1787780113.012016:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1787780113.012022:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787780113.012079:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348a08f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:3644:1874622881652608:0@lo:400:kworker.0 00000100:00100000:2.0:1787780113.012152:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787780113.012233:0:17236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881652608 00000100:00100000:2.0:1787780113.012239:0:17236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881652608 00000100:00100000:2.0:1787780113.012278:0:17236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787780113.012288:0:17236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0478633c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+9:3644:x1874622881652608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787780113.012332:0:17236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0478633c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+9:3644:x1874622881652608:12345-0@lo:400:kworker.0 Request processed in 47us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780113.012338:0:17236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787780113.012378:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348a08f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:3644:1874622881652608:0@lo:400:kworker.0 00000100:00100000:1.0:1787780113.012768:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346cff0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1874622881652480:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1787780113.012802:0:3640:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874622881652480 offset 0 length 520: 4 00000100:00080000:1.0:1787780113.012829:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9c04811dd800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787780113.012834:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787780113.012858:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348a092c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1874622881652352:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1787780113.014755:0:17260:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787780113.015333:0:17260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:0.0:1787780113.015478:0:17260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:3.0:1787780113.015937:0:17268:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787780113.015941:0:17268:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1787780113.016712:0:17260:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787780113.016725:0:17260:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1787780113.016759:0:17260:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1787780113.016779:0:17260:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc8fc0a5179961813 00000100:00080000:0.0:1787780113.016789:0:17260:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787780113.016794:0:17260:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9c044963b000 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:0.0:1787780113.016826:0:17260:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c0346cffc00 x1874622881652736/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787780113.016879:0:17260:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1787780113.016935:0:17260:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787780113.016940:0:17260:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787780113.016941:0:17260:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1787780113.016945:0:17260:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787780113.016949:0:17260:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787780113.016950:0:17260:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787780113.016952:0:17260:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787780113.016954:0:17260:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787780113.016956:0:17260:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787780113.016959:0:17260:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787780113.016960:0:17260:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:0.0:1787780113.016963:0:17260:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787780113.016965:0:17260:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787780113.016966:0:17260:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787780113.016970:0:17260:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1787780113.017001:0:17260:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346cfde00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17260:1874622881652864:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787780113.017094:0:17260:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787780113.017132:0:17260:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c04583cde40 going to sleep for 11 seconds 00000100:00100000:1.0:1787780113.017216:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881652864 00000100:00100000:1.0:1787780113.017224:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881652864 00000100:00100000:1.0:1787780113.017268:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787780113.017278:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0478632850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+9:17260:x1874622881652864:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787780113.017380:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0478632850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+9:17260:x1874622881652864:12345-0@lo:502:llog_process_th.0 Request processed in 103us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780113.017388:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:2.0:1787780113.017402:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1787780113.017407:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1787780113.017410:0:8:0:(import.c:65:import_set_state_nolock()) ffff9c04811dd800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787780113.017414:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 520 00000100:00080000:2.0:1787780113.017417:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787780113.017421:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9c04811dd800 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:2.0:1787780113.017438:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c0348a08f00 x1874622881652992/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787780113.017440:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346cffc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1874622881652736:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1787780113.017465:0:3640:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874622881652736 offset 0 length 520: 4 00000100:00100000:1.0:1787780113.017488:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348a08f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1874622881652992:0@lo:38:kworker.0 00000100:00100000:0.0:1787780113.017521:0:17260:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346cfde00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17260:1874622881652864:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787780113.017525:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:0.0:1787780113.017546:0:17260:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787780113.017550:0:17260:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787780113.017552:0:17260:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787780113.017555:0:17260:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000100:00100000:3.0:1787780113.017641:0:17248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881652992 00000100:00100000:3.0:1787780113.017646:0:17248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881652992 00000100:00100000:3.0:1787780113.017675:0:17248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787780113.017680:0:17248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03488e0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3640:x1874622881652992:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1787780113.017692:0:17248:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787780113.017727:0:17248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03488e0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3640:x1874622881652992:12345-0@lo:38:kworker.0 Request processed in 45us (201us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787780113.017742:0:17248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1787780113.017790:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9c04811dd800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787780113.017795:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787780113.017799:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348a08f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1874622881652992:0@lo:38:kworker.0 00000020:01000000:2.0:1787780113.023466:0:17221:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:2.0:1787780113.023505:0:17221:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1787780113.023530:0:17221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c0444c18400/0xc8fc0a5179961787 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a517996178e expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780113.023560:0:17221:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff9c0444c18400/0xc8fc0a5179961787 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a517996178e expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787780113.023570:0:17221:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c0447266000 from 1 10000000:01000000:2.0:1787780113.023572:0:17221:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787780113.023609:0:17221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c0444c18200/0xc8fc0a517996181a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780113.023616:0:17221:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff9c0444c18200/0xc8fc0a517996181a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780113.023627:0:17221:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff9c0444c18200/0xc8fc0a517996181a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787780113.023651:0:17221:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348a09a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17221:1874622881653120:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787780113.023714:0:17221:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787780113.023760:0:17221:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0347c50a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787780113.023831:0:17237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881653120 00000100:00100000:3.0:1787780113.023869:0:17237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881653120 00000100:00100000:3.0:1787780113.023933:0:17237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787780113.023942:0:17237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0478633450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+9:17221:x1874622881653120:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787780113.023954:0:17237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787780113.023967:0:17237:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c04766dc800/0xc8fc0a5179961821 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc8fc0a517996181a expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780113.023989:0:17237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c04766dc800/0xc8fc0a5179961821 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc8fc0a517996181a expref: 10 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780113.023999:0:17237:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c04766dc800/0xc8fc0a5179961821 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a517996181a expref: 10 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780113.024008:0:17237:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c04766dc800, rc 0) 00000100:00100000:3.0:1787780113.024044:0:17237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0478633450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+10:17221:x1874622881653120:12345-0@lo:101:mount.lustre.0 Request processed in 104us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780113.024051:0:17237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787780113.024299:0:17221:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348a09a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17221:1874622881653120:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787780113.024313:0:17221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff9c0444c18200/0xc8fc0a517996181a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a5179961821 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780113.024322:0:17221:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff9c0444c18200/0xc8fc0a517996181a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc8fc0a5179961821 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787780113.030463:0:17221:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348a09a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17221:1874622881653248:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1787780113.030531:0:17221:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780113.030572:0:17221:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0443623d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787780113.030685:0:17236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881653248 00000100:00100000:1.0:1787780113.030694:0:17236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881653248 00000100:00100000:1.0:1787780113.030751:0:17236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787780113.030760:0:17236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0478630850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+10:17221:x1874622881653248:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1787780113.030780:0:17236:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1787780113.030785:0:17236:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1787780113.030889:0:17236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0478630850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+10:17221:x1874622881653248:12345-0@lo:256:mount.lustre.0 Request processed in 129us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780113.030905:0:17236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787780113.030997:0:17221:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348a09a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17221:1874622881653248:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1787780113.032508:0:17221:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787780113.032561:0:17221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c0444c18200/0xc8fc0a517996181a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a5179961821 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780113.032588:0:17221:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff9c0444c18200/0xc8fc0a517996181a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a5179961821 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787780113.032597:0:17221:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c0447266000 from 1 10000000:01000000:3.0:1787780113.032600:0:17221:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787780113.032633:0:17221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c04766dca00/0xc8fc0a5179961828 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780113.032641:0:17221:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff9c04766dca00/0xc8fc0a5179961828 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780113.032652:0:17221:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff9c04766dca00/0xc8fc0a5179961828 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787780113.032672:0:17221:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347dad680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17221:1874622881653376:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787780113.032720:0:17221:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780113.032760:0:17221:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0443623d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787780113.032885:0:17237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881653376 00000100:00100000:2.0:1787780113.032891:0:17237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881653376 00000100:00100000:2.0:1787780113.032962:0:17237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787780113.032972:0:17237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0478633050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+10:17221:x1874622881653376:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787780113.032991:0:17237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787780113.033004:0:17237:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0444c19c00/0xc8fc0a517996182f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc8fc0a5179961828 expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780113.033025:0:17237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0444c19c00/0xc8fc0a517996182f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc8fc0a5179961828 expref: 11 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780113.033034:0:17237:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0444c19c00/0xc8fc0a517996182f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a5179961828 expref: 11 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780113.033041:0:17237:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0444c19c00, rc 0) 00000100:00100000:2.0:1787780113.033077:0:17237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0478633050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+11:17221:x1874622881653376:12345-0@lo:101:mount.lustre.0 Request processed in 107us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780113.033084:0:17237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787780113.033323:0:17221:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347dad680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17221:1874622881653376:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787780113.033339:0:17221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff9c04766dca00/0xc8fc0a5179961828 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a517996182f expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780113.033347:0:17221:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff9c04766dca00/0xc8fc0a5179961828 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc8fc0a517996182f expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787780113.033405:0:17221:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347dad680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17221:1874622881653504:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787780113.033429:0:17221:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780113.033455:0:17221:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0443623d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787780113.033634:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881653504 00000100:00100000:2.0:1787780113.033639:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881653504 00000100:00100000:2.0:1787780113.033676:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787780113.033683:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0478631050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+11:17221:x1874622881653504:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787780113.033815:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0478631050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+11:17221:x1874622881653504:12345-0@lo:501:mount.lustre.0 Request processed in 131us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780113.033822:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787780113.034004:0:17221:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347dad680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17221:1874622881653504:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787780113.034034:0:17221:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c03488e30c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17221:1874622881653632:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787780113.034075:0:17221:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780113.034102:0:17221:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c047782b000 going to sleep for 11 seconds 00000100:00100000:3.0:1787780113.034137:0:17236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881653632 00000100:00100000:3.0:1787780113.034141:0:17236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881653632 00000100:00100000:3.0:1787780113.034254:0:17236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787780113.034261:0:17236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0478631850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+11:17221:x1874622881653632:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787780113.034356:0:17236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0478631850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+11:17221:x1874622881653632:12345-0@lo:503:mount.lustre.0 Request processed in 94us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780113.034362:0:17236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787780113.034683:0:17221:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c03488e30c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17221:1874622881653632:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787780113.035421:0:17270:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347dac780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17270:1874622881653760:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787780113.035467:0:17270:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780113.035503:0:17270:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0443623600 going to sleep for 11 seconds 00000100:00100000:2.0:1787780113.035679:0:17237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881653760 00000100:00100000:2.0:1787780113.035685:0:17237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881653760 00000100:00100000:2.0:1787780113.035728:0:17237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787780113.035736:0:17237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0478632450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+11:17270:x1874622881653760:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787780113.036188:0:17237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0478632450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+11:17270:x1874622881653760:12345-0@lo:502:llog_process_th.0 Request processed in 452us (719us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780113.036206:0:17237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787780113.036261:0:17270:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347dac780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17270:1874622881653760:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787780113.036287:0:17270:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787780113.036299:0:17270:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787780113.036302:0:17270:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787780113.036309:0:17270:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c0447266000 00000020:00000080:3.0:1787780113.036311:0:17270:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787780113.036319:0:17270:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787780113.036322:0:17270:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787780113.036324:0:17270:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1787780113.036326:0:17270:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787780113.036328:0:17270:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787780113.036329:0:17270:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787780113.036332:0:17270:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c0447266000 00000020:00000080:3.0:1787780113.036334:0:17270:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787780113.036394:0:17270:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787780113.036398:0:17270:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787780113.036399:0:17270:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1787780113.036402:0:17270:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787780113.036406:0:17270:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787780113.036407:0:17270:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787780113.036417:0:17270:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c0447266000 00000020:00000080:3.0:1787780113.036419:0:17270:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787780113.036441:0:17270:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787780113.036443:0:17270:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787780113.036444:0:17270:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787780113.036446:0:17270:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787780113.036448:0:17270:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787780113.036449:0:17270:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1787780113.036452:0:17270:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c0447266000 00000020:00000080:3.0:1787780113.036454:0:17270:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787780113.036484:0:17270:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347dac780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17270:1874622881653888:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787780113.036515:0:17270:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780113.036547:0:17270:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0443623600 going to sleep for 11 seconds 00000100:00100000:1.0:1787780113.036599:0:17236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881653888 00000100:00100000:1.0:1787780113.036603:0:17236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881653888 00000100:00100000:1.0:1787780113.036637:0:17236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787780113.036644:0:17236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0478630050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+11:17270:x1874622881653888:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787780113.036735:0:17236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0478630050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+11:17270:x1874622881653888:12345-0@lo:502:llog_process_th.0 Request processed in 91us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780113.036743:0:17236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787780113.036820:0:17270:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347dac780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17270:1874622881653888:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787780113.036859:0:17270:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787780113.036864:0:17270:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787780113.036865:0:17270:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1787780113.036869:0:17270:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1787780113.037933:0:17221:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1787780113.037960:0:17221:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787780113.037986:0:17221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c04766dca00/0xc8fc0a5179961828 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a517996182f expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780113.037998:0:17221:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff9c04766dca00/0xc8fc0a5179961828 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a517996182f expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787780113.038045:0:17221:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787780113.038049:0:17221:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9c0447266000 10000000:01000000:1.0:1787780113.038052:0:17221:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9c0447266000 10000000:01000000:1.0:1787780113.038056:0:17221:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787780113.038063:0:17221:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c0447266000 from 1 10000000:01000000:1.0:1787780113.038066:0:17221:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787780113.038094:0:17221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c0347e4a400/0xc8fc0a5179961836 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780113.038103:0:17221:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff9c0347e4a400/0xc8fc0a5179961836 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780113.038113:0:17221:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff9c0347e4a400/0xc8fc0a5179961836 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787780113.038130:0:17221:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c03488e30c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17221:1874622881654016:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787780113.038242:0:17221:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780113.038276:0:17221:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c047782b900 going to sleep for 11 seconds 00000100:00100000:2.0:1787780113.038633:0:17237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881654016 00000100:00100000:2.0:1787780113.038639:0:17237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881654016 00000100:00100000:2.0:1787780113.038680:0:17237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787780113.038689:0:17237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0478631c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+11:17221:x1874622881654016:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787780113.038701:0:17237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787780113.038714:0:17237:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0444c18000/0xc8fc0a517996183d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc8fc0a5179961836 expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780113.038737:0:17237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0444c18000/0xc8fc0a517996183d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc8fc0a5179961836 expref: 12 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780113.038747:0:17237:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0444c18000/0xc8fc0a517996183d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a5179961836 expref: 12 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780113.038756:0:17237:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0444c18000, rc 0) 00000100:00100000:2.0:1787780113.038803:0:17237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0478631c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+12:17221:x1874622881654016:12345-0@lo:101:mount.lustre.0 Request processed in 115us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780113.038809:0:17237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787780113.038903:0:17221:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c03488e30c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17221:1874622881654016:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787780113.038916:0:17221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff9c0347e4a400/0xc8fc0a5179961836 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a517996183d expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780113.038925:0:17221:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff9c0347e4a400/0xc8fc0a5179961836 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc8fc0a517996183d expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787780113.038980:0:17221:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347dac780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17221:1874622881654144:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787780113.039009:0:17221:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780113.039037:0:17221:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0443623600 going to sleep for 11 seconds 00000100:00100000:1.0:1787780113.039090:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881654144 00000100:00100000:1.0:1787780113.039095:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881654144 00000100:00100000:1.0:1787780113.039127:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787780113.039135:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0478630c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+12:17221:x1874622881654144:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787780113.039355:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0478630c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+12:17221:x1874622881654144:12345-0@lo:501:mount.lustre.0 Request processed in 221us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780113.039362:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787780113.039420:0:17221:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347dac780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17221:1874622881654144:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787780113.039449:0:17221:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347dac780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17221:1874622881654272:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787780113.039481:0:17221:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780113.039506:0:17221:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0443623600 going to sleep for 11 seconds 00000100:00100000:1.0:1787780113.039547:0:17237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881654272 00000100:00100000:1.0:1787780113.039551:0:17237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881654272 00000100:00100000:1.0:1787780113.040116:0:17237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787780113.040125:0:17237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0478631450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+12:17221:x1874622881654272:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787780113.040224:0:17237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0478631450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+12:17221:x1874622881654272:12345-0@lo:503:mount.lustre.0 Request processed in 100us (741us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780113.040232:0:17237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787780113.044945:0:17221:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347dac780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17221:1874622881654272:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787780113.045692:0:17273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346cfde00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17273:1874622881654400:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787780113.045772:0:17273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787780113.046326:0:17273:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0477835300 going to sleep for 11 seconds 00000100:00100000:1.0:1787780113.048445:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881654400 00000100:00100000:1.0:1787780113.048457:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881654400 00000100:00100000:1.0:1787780113.048507:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787780113.048517:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0478630450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+12:17273:x1874622881654400:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787780113.048712:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0478630450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+12:17273:x1874622881654400:12345-0@lo:502:llog_process_th.0 Request processed in 196us (2940us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780113.048721:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787780113.049387:0:17273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346cfde00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17273:1874622881654400:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1787780113.049570:0:17273:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1787780113.049586:0:17273:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9c04716e3370) 00000020:00000080:0.0:1787780113.049607:0:17273:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:0.0:1787780113.049719:0:17273:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c0447266000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1787780113.049723:0:17273:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c0447266000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1787780113.049726:0:17273:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c0447266000 4 00010000:00080000:0.0:1787780113.049775:0:17273:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c04811d8000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.131@tcp at head 00010000:00010000:0.0:1787780113.052674:0:17273:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:0.0:1787780113.052985:0:17273:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1787780113.053027:0:17273:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787780113.053039:0:17273:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xc8fc0a517996184b 00000100:00080000:0.0:1787780113.053049:0:17273:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787780113.053055:0:17273:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9c04811d8000 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:0.0:1787780113.053090:0:17273:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c0346cfde00 x1874622881654528/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787780113.053119:0:17273:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1787780113.053268:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346cfde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874622881654528:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787780113.053333:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780113.053373:0:17242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881654528 00000100:00100000:3.0:1787780113.053380:0:17242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881654528 00000100:00100000:3.0:1787780113.053420:0:17242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787780113.053428:0:17242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03488e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3640:x1874622881654528:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787780113.053478:0:17242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03488e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3640:x1874622881654528:12345-0@lo:38:llog_process_th.0 Request processed in 49us (144us total) trans 0 rc -11/-11 00000100:00100000:3.0:1787780113.053484:0:17242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787780113.053495:0:3640:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787780113.053502:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9c04811d8000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787780113.053506:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1787780113.053509:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346cfde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874622881654528:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787780113.053908:0:17273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346cfde00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17273:1874622881654656:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787780113.053959:0:17273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787780113.053985:0:17273:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0477835480 going to sleep for 11 seconds 00000100:00100000:1.0:1787780113.060972:0:17237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881654656 00000100:00100000:1.0:1787780113.060990:0:17237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881654656 00000100:00100000:1.0:1787780113.061056:0:17237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787780113.061066:0:17237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0478632050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+12:17273:x1874622881654656:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787780113.063128:0:17237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0478632050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+12:17273:x1874622881654656:12345-0@lo:502:llog_process_th.0 Request processed in 2056us (9160us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780113.063143:0:17237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787780113.066287:0:17273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346cfde00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17273:1874622881654656:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787780113.066359:0:17273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346cfde00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17273:1874622881654784:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787780113.066423:0:17273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787780113.066460:0:17273:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0477835480 going to sleep for 11 seconds 00000100:00100000:2.0:1787780113.067278:0:17236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881654784 00000100:00100000:2.0:1787780113.067285:0:17236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881654784 00000100:00100000:2.0:1787780113.067337:0:17236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787780113.067346:0:17236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0478636c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+12:17273:x1874622881654784:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787780113.067475:0:17236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0478636c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+12:17273:x1874622881654784:12345-0@lo:502:llog_process_th.0 Request processed in 130us (1051us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780113.067483:0:17236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787780113.068100:0:17273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346cfde00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17273:1874622881654784:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1787780113.068129:0:17273:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1787780113.068702:0:17221:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1787780113.068724:0:17221:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787780113.068741:0:17221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c0347e4a400/0xc8fc0a5179961836 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a517996183d expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780113.068752:0:17221:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff9c0347e4a400/0xc8fc0a5179961836 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a517996183d expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787780113.068795:0:17221:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787780113.068797:0:17221:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787780113.068799:0:17221:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787780113.068800:0:17221:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787780113.068801:0:17221:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787780113.068802:0:17221:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787780113.068804:0:17221:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787780113.068805:0:17221:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787780113.068807:0:17221:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787780113.068808:0:17221:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787780113.068812:0:17221:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:1.0:1787780113.068815:0:17221:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787780113.068816:0:17221:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787780113.068817:0:17221:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787780113.068818:0:17221:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787780113.068819:0:17221:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787780113.068820:0:17221:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787780113.068821:0:17221:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787780113.068822:0:17221:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787780113.068823:0:17221:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787780113.068824:0:17221:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787780113.068867:0:17221:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1787780113.068881:0:17221:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c03488e2d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17221:1874622881654912:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787780113.068946:0:17221:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780113.068974:0:17221:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0451537f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787780113.069000:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881654912 00000100:00100000:1.0:1787780113.069005:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881654912 00000100:00100000:1.0:1787780113.069040:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787780113.069047:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0478637c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+12:17221:x1874622881654912:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787780113.069069:0:17234:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1787780113.069082:0:17234:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1787780113.078054:0:17234:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787780113.078077:0:17234:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1787780113.078253:0:17258:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787780113.078259:0:17258:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787780113.078281:0:17258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c0481372600/0xc8fc0a5179961852 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780113.078300:0:17258:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c04766dc800/0xc8fc0a5179961821 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a517996181a expref: 12 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780113.078308:0:17258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c0481372600/0xc8fc0a5179961852 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780113.078345:0:17258:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c04766dc800/0xc8fc0a5179961821 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc8fc0a517996181a expref: 12 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780113.078359:0:17258:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c04766dc800/0xc8fc0a5179961821 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc8fc0a517996181a expref: 12 pid: 17237 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787780113.078372:0:17258:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346cfde00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17258:1874622881655040:0@lo:104: 00000100:00100000:0.0:1787780113.078429:0:17258:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787780113.078478:0:17258:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0477835e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787780113.081132:0:17225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881655040 00000100:00100000:3.0:1787780113.081147:0:17225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881655040 00000100:00100000:3.0:1787780113.081202:0:17225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787780113.081211:0:17225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346cfc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+3:17258:x1874622881655040:12345-0@lo:104: 00010000:00010000:3.0:1787780113.081227:0:17225:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff9c0444c18200/0xc8fc0a517996181a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc8fc0a5179961821 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787780113.081249:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0478637c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+12:17221:x1874622881654912:12345-0@lo:253:mount.lustre.0 Request processed in 12200us (12311us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780113.081259:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:3.0:1787780113.081277:0:17225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787780113.081282:0:17225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346cfc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+3:17258:x1874622881655040:12345-0@lo:104: Request processed in 74us (2854us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780113.081288:0:17225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787780113.081312:0:17258:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346cfde00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17258:1874622881655040:0@lo:104: 00000100:00100000:1.0:1787780113.081312:0:17221:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c03488e2d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17221:1874622881654912:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787780113.081324:0:17221:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1787780113.081327:0:17221:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787780113.081328:0:17221:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787780113.081329:0:17221:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787780113.081331:0:17221:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787780113.081332:0:17221:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00010000:00010000:3.0:1787780113.081333:0:17258:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c0481372600/0xc8fc0a5179961852 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787780113.081333:0:17221:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787780113.081334:0:17221:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787780113.081336:0:17221:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787780113.081337:0:17221:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787780113.081339:0:17221:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787780113.081348:0:17221:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:3.0:1787780113.082119:0:17231:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787780113.082127:0:17231:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff9c0444c18200/0xc8fc0a517996181a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc8fc0a5179961821 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780113.082136:0:17231:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0444c18200 already unused, calling callback (ffffffffc139ac20) 10000000:00010000:3.0:1787780113.082141:0:17231:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff9c0444c18200/0xc8fc0a517996181a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc8fc0a5179961821 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780113.082150:0:17231:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff9c0444c18200/0xc8fc0a517996181a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc8fc0a5179961821 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787780113.082158:0:17231:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff9c0444c18200/0xc8fc0a517996181a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc8fc0a5179961821 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787780113.082164:0:17231:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787780113.082210:0:17231:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff9c0444c18200/0xc8fc0a517996181a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a5179961821 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780113.082217:0:17231:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787780113.082235:0:17231:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff9c0444c18200/0xc8fc0a517996181a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a5179961821 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780113.082242:0:17231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff9c0444c18200/0xc8fc0a517996181a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a5179961821 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780113.082258:0:17231:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787780113.082260:0:17231:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787780113.082262:0:17231:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787780113.082343:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347dac780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:3641:1874622881655168:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787780113.082396:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787780113.085289:0:17227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881655168 00000100:00100000:0.0:1787780113.085299:0:17227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881655168 00010000:00010000:0.0:1787780113.085330:0:17227:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c04766dc800/0xc8fc0a5179961821 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc8fc0a517996181a expref: 12 pid: 17237 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787780113.085363:0:17227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787780113.085376:0:17227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0348a0b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+12:3641:x1874622881655168:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787780113.085389:0:17227:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787780113.085394:0:17227:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c04766dc800/0xc8fc0a5179961821 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc8fc0a517996181a expref: 12 pid: 17237 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780113.085405:0:17227:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c04766dc800/0xc8fc0a5179961821 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc8fc0a517996181a expref: 12 pid: 17237 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780113.085422:0:17227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c04766dc800/0xc8fc0a5179961821 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc8fc0a517996181a expref: 12 pid: 17237 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780113.085436:0:17227:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c0481372600/0xc8fc0a5179961852 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780113.085444:0:17227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0481372600/0xc8fc0a5179961852 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787780113.085458:0:17227:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.007200326s 00010000:00010000:0.0:1787780113.085462:0:17227:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c0481372600/0xc8fc0a5179961852 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780113.085469:0:17227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c0481372600/0xc8fc0a5179961852 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780113.085475:0:17227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c0481372600/0xc8fc0a5179961852 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780113.085489:0:17227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c0481372600/0xc8fc0a5179961852 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780113.085494:0:17227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0481372600 already unused, calling callback (ffffffffc0d97420) 00010000:00010000:0.0:1787780113.085498:0:17227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c0481372600/0xc8fc0a5179961852 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780113.085505:0:17227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c0481372600/0xc8fc0a5179961852 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780113.085521:0:17227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c0481372600/0xc8fc0a5179961852 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780113.085530:0:17227:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787780113.085592:0:17227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0348a0b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+11:3641:x1874622881655168:12345-0@lo:103:ldlm_bl.0 Request processed in 222us (3196us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780113.085600:0:17227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1787780113.085764:0:17258:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c0481372600/0xc8fc0a5179961852 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780113.085778:0:17258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c0481372600/0xc8fc0a5179961852 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780113.085783:0:17258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c0481372600/0xc8fc0a5179961852 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787780113.087037:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347dac780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:3641:1874622881655168:0@lo:103:ldlm_bl.0 00000020:00080000:1.0:1787780113.105427:0:17221:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:2.0:1787780113.106004:0:17221:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1787780113.106096:0:17282:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:1.0:1787780113.106100:0:17282:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:1.0:1787780113.106368:0:17283:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1787780113.106413:0:17221:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:3.0:1787780113.106824:0:17283:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00080000:1.0:1787780113.106935:0:17284:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff9c03488e2d00 x1874622881655296/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787780113.106962:0:17284:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c04411ca0c0 going to sleep for 0 seconds 00000040:00080000:3.0:1787780113.108814:0:17283:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1787780113.108918:0:17283:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:01000000:2.0:1787780113.109555:0:17221:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1787780113.109592:0:17221:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1787780113.110073:0:17221:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1787780113.110082:0:17221:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1787780113.110117:0:17221:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787780113.112560:0:17221:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1787780113.113152:0:17221:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1787780113.113190:0:17221:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:2.0:1787780113.115579:0:17221:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x35:0x0] (8/32) registered 00000001:00000004:2.0:1787780113.118691:0:17221:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:2.0:1787780113.121491:0:17221:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1787780113.121528:0:17221:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb66b81577988 00100000:10000000:2.0:1787780113.121535:0:17221:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1787780113.126501:0:17221:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787780113.126522:0:17221:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.131@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787780113.126543:0:17221:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1787780113.126561:0:17221:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:1.0:1787780113.128539:0:17221:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787780113.128731:0:17221:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787780113.760705:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787780114.076730:0:17278:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787780114.140932:0:17284:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c04411ca0c0 going to sleep for 0 seconds 10000000:01000000:2.0:1787780114.332109:0:17239:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787780114.332117:0:17239:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c0447266000 from 7 10000000:01000000:2.0:1787780114.332124:0:17239:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787780114.332172:0:17239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c0444c18600/0xc8fc0a5179961859 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780114.332270:0:17239:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff9c0444c18600/0xc8fc0a5179961859 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780114.332298:0:17239:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff9c0444c18600/0xc8fc0a5179961859 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787780114.332323:0:17239:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348a09680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17239:1874622881655424:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787780114.332392:0:17239:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787780114.332577:0:17239:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0346b50240 going to sleep for 11 seconds 00000100:00100000:1.0:1787780114.336908:0:17237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881655424 00000100:00100000:1.0:1787780114.336923:0:17237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881655424 00000100:00100000:1.0:1787780114.337396:0:17237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787780114.337413:0:17237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0478636850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+11:17239:x1874622881655424:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787780114.337440:0:17237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787780114.337461:0:17237:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0347e4bc00/0xc8fc0a5179961860 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc8fc0a5179961859 expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780114.337488:0:17237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0347e4bc00/0xc8fc0a5179961860 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc8fc0a5179961859 expref: 12 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780114.337499:0:17237:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0347e4bc00/0xc8fc0a5179961860 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a5179961859 expref: 12 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780114.337508:0:17237:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0347e4bc00, rc 0) 00000100:00100000:1.0:1787780114.337591:0:17237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0478636850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+12:17239:x1874622881655424:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 184us (5199us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780114.337659:0:17239:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348a09680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17239:1874622881655424:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787780114.337679:0:17239:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff9c0444c18600/0xc8fc0a5179961859 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a5179961860 expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780114.337688:0:17239:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff9c0444c18600/0xc8fc0a5179961859 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc8fc0a5179961860 expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787780114.337759:0:17239:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347daf0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17239:1874622881655552:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1787780114.337800:0:17239:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780114.337862:0:17239:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c04779aed80 going to sleep for 11 seconds 00000100:00100000:0.0:1787780114.338457:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881655552 00000100:00100000:0.0:1787780114.338465:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881655552 00000100:00100000:1.0:1787780114.345775:0:17237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787780114.347154:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787780114.347327:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0478637450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+12:17239:x1874622881655552:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787780114.347356:0:17234:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787780114.347379:0:17234:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787780114.347382:0:17234:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:0.0:1787780114.347586:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0478637450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+12:17239:x1874622881655552:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 420us (9784us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780114.347594:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787780114.347698:0:17239:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347daf0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17239:1874622881655552:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1787780114.347753:0:17239:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787780114.347763:0:17239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c0444c18600/0xc8fc0a5179961859 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a5179961860 expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780114.347773:0:17239:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff9c0444c18600/0xc8fc0a5179961859 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a5179961860 expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780114.779938:0:17231:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787780115.109266:0:17278:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787780115.163966:0:17284:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c04411ca0c0 going to sleep for 0 seconds 00010000:00010000:2.0:1787780115.804169:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787780116.189959:0:17284:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c04411ca0c0 going to sleep for 0 seconds 00010000:00010000:3.0:1787780116.827948:0:17231:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787780117.218177:0:17284:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c04411ca0c0 going to sleep for 0 seconds 00000001:02000400:3.0:1787780117.475007:0:17525:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg331-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1787780117.853609:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787780118.237301:0:17284:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c04411ca0c0 going to sleep for 0 seconds 00000100:00080000:0.0:1787780118.299967:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1787780118.299974:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1787780118.299977:0:8:0:(import.c:65:import_set_state_nolock()) ffff9c04811dd800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787780118.299984:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 521 00000100:00080000:0.0:1787780118.299990:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1787780118.299996:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9c04811dd800 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:0.0:1787780118.300019:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c0346cfda40 x1874622881655808/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787780118.300036:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787780118.300039:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787780118.300042:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787780118.300045:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787780118.300047:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1787780118.300050:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787780118.300052:0:8:0:(import.c:65:import_set_state_nolock()) ffff9c04811d8000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787780118.300056:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9c04811d8000 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:0.0:1787780118.300067:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c0346cfc780 x1874622881655936/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787780118.300088:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787780118.300102:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346cfe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:3641:1874622881655680:0@lo:400:kworker.0 00000100:00100000:0.0:1787780118.300164:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787780118.300221:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346cfda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1874622881655808:0@lo:38:kworker.0 00000100:00100000:0.0:1787780118.300247:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787780118.300273:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346cfc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874622881655936:0@lo:38:kworker.0 00000100:00100000:0.0:1787780118.300300:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787780118.300330:0:17237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881655680 00000100:00100000:0.0:1787780118.300336:0:17237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881655680 00000100:00100000:0.0:1787780118.300379:0:17237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787780118.300389:0:17237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0478634850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+12:3641:x1874622881655680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787780118.300434:0:17237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0478634850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+12:3641:x1874622881655680:12345-0@lo:400:kworker.0 Request processed in 47us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780118.300440:0:17237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787780118.300483:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881655936 00000100:00100000:0.0:1787780118.300487:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881655936 00000100:00100000:0.0:1787780118.300503:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787780118.300507:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346cff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3640:x1874622881655936:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1787780118.300528:0:17244:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 526 last 0 00000020:00000080:0.0:1787780118.300561:0:17244:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xc8fc0a5179961867 00000004:00100000:0.0:1787780118.300574:0:17244:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787780118.300712:0:17244:0:(import.c:65:import_set_state_nolock()) ffff9c044963a800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787780118.300750:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346cff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874622881655936:12345-0@lo:38:kworker.0 Request processed in 241us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780118.300757:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787780118.300792:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9c0346cfc780 x1874622881655936/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787780128 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787780118.300807:0:3640:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1787780118.300813:0:3640:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1787780118.300817:0:3640:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787780118.300819:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9c04811d8000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787780118.300831:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346cfc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874622881655936:0@lo:38:kworker.0 00000100:00100000:0.0:1787780118.300891:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346cfe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:3641:1874622881655680:0@lo:400:kworker.0 00000100:00100000:3.0:1787780118.301662:0:17248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881655808 00000100:00100000:3.0:1787780118.301669:0:17248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881655808 00000100:00100000:3.0:1787780118.301703:0:17248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787780118.301709:0:17248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346cfe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3640:x1874622881655808:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1787780118.301722:0:17248:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787780118.319199:0:17248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346cfe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3640:x1874622881655808:12345-0@lo:38:kworker.0 Request processed in 17481us (18943us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787780118.319213:0:17248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1787780118.319269:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9c04811dd800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787780118.319275:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787780118.319280:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346cfda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1874622881655808:0@lo:38:kworker.0 00000020:00000004:0.0:1787780118.342678:0:17579:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787780118.344415:0:17579:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787780118.887229:0:17231:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787780119.155436:0:17629:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787780119.155609:0:17629:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1787780119.259945:0:17284:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c04411ca0c0 going to sleep for 0 seconds 00010000:00010000:0.0:1787780119.900061:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787780120.285522:0:17284:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c04411ca0c0 going to sleep for 0 seconds 00010000:00010000:0.0:1787780120.924416:0:17231:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787780121.310286:0:17284:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c04411ca0c0 going to sleep for 0 seconds 00010000:00010000:3.0:1787780121.955358:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787780122.331903:0:17284:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c04411ca0c0 going to sleep for 0 seconds 00010000:00010000:1.0:1787780122.972327:0:17231:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787780123.355960:0:17284:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c04411ca0c0 going to sleep for 0 seconds 00000100:00080000:2.0:1787780123.422959:0:2253:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1787780123.422966:0:2253:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1787780123.422970:0:2253:0:(import.c:65:import_set_state_nolock()) ffff9c04811dd800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787780123.422978:0:2253:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 526 00000100:00080000:2.0:1787780123.422984:0:2253:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1787780123.422990:0:2253:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9c04811dd800 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:2.0:1787780123.423012:0:2253:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c0348a09e00 x1874622881656192/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787780123.423025:0:2253:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787780123.423028:0:2253:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787780123.423030:0:2253:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787780123.423033:0:2253:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787780123.423061:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348a083c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:3643:1874622881656064:0@lo:400:kworker.0 00000100:00100000:2.0:1787780123.423126:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787780123.423183:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787780123.423190:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348a08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1874622881656320:0@lo:400:kworker.0 00000100:00100000:2.0:1787780123.423236:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787780123.423281:0:17243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881656320 00000100:00100000:2.0:1787780123.423288:0:17243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881656320 00000100:00100000:3.0:1787780123.423312:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881656064 00000100:00100000:3.0:1787780123.423316:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881656064 00000100:00100000:2.0:1787780123.423326:0:17243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787780123.423334:0:17243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0348a0a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1874622881656320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787780123.423342:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787780123.423347:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0478637050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+12:3643:x1874622881656064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787780123.423413:0:3640:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787780113/real 1787780113] req@ffff9c0346cffc00 x1874622881652736/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787780123 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787780123.423434:0:3640:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c0346cffc00 x1874622881652736/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787780123 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787780123.423443:0:3640:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787780113/real 1787780113] req@ffff9c0346cff0c0 x1874622881652480/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787780123 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787780123.423454:0:3640:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c0346cff0c0 x1874622881652480/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787780123 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787780123.423466:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348a09e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1874622881656192:0@lo:38:kworker.0 00000100:00100000:0.0:1787780123.423492:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787780123.423511:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9c044963b000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787780123.423522:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787780123.423525:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346cffc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1874622881652736:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1787780123.423531:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9c047787a000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787780123.423535:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787780123.423544:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346cff0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1874622881652480:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1787780123.423572:0:17247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881656192 00000100:00100000:0.0:1787780123.423576:0:17247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881656192 00000100:00100000:0.0:1787780123.423597:0:17247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787780123.423603:0:17247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346cfe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3640:x1874622881656192:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1787780123.423617:0:17247:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787780123.424060:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0478637050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+12:3643:x1874622881656064:12345-0@lo:400:kworker.0 Request processed in 710us (931us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780123.424077:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787780123.424286:0:17243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0348a0a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1874622881656320:12345-0@lo:400:kworker.0 Request processed in 46us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780123.424299:0:17243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1787780123.424325:0:2253:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787780123.424329:0:2253:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1787780123.424331:0:2253:0:(import.c:65:import_set_state_nolock()) ffff9c047787a000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787780123.424336:0:2253:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 521 00000100:00080000:2.0:1787780123.424339:0:2253:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787780123.424343:0:2253:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9c047787a000 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:2.0:1787780123.424362:0:2253:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c0348a0b840 x1874622881656448/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787780123.424387:0:2253:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787780123.424391:0:2253:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787780123.424392:0:2253:0:(import.c:65:import_set_state_nolock()) ffff9c044963b000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787780123.424395:0:2253:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 521 00000100:00080000:2.0:1787780123.424398:0:2253:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787780123.424401:0:2253:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9c044963b000 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:2.0:1787780123.424412:0:2253:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c0348a08780 x1874622881656576/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00080000:2.0:1787780123.424450:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9c0348a08000 x1874622881656320/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787780139 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787780123.424468:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348a08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1874622881656320:0@lo:400:kworker.0 00000100:00100000:2.0:1787780123.424480:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348a083c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:3643:1874622881656064:0@lo:400:kworker.0 00000100:00100000:3.0:1787780123.424627:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348a0b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1874622881656448:0@lo:8:kworker.0 00000400:00000100:3.0:1787780123.424662:0:3640:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874622881656448 offset 0 length 520: 4 00000100:00100000:3.0:1787780123.424702:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348a08780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1874622881656576:0@lo:8:kworker.0 00000400:00000100:3.0:1787780123.424723:0:3640:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874622881656576 offset 0 length 520: 4 00000100:00100000:0.0:1787780123.437147:0:17247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346cfe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3640:x1874622881656192:12345-0@lo:38:kworker.0 Request processed in 13535us (13645us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787780123.437161:0:17247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1787780123.442584:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9c04811dd800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787780123.442596:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787780123.442601:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348a09e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1874622881656192:0@lo:38:kworker.0 00010000:00010000:1.0:1787780123.997068:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787780124.380912:0:17284:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c04411ca0c0 going to sleep for 0 seconds 00010000:00010000:1.0:1787780125.026823:0:17231:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787780125.028154:0:17973:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787780125.028158:0:17973:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:3.0:1787780125.028225:0:17973:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1787780125.028339:0:17973:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9c0477821800 00000020:01000004:3.0:1787780125.028355:0:17973:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:3.0:1787780125.028366:0:17973:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1787780125.028380:0:17973:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff9c04766219b8) 00000020:00000080:3.0:1787780125.028396:0:17973:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1787780125.163248:0:17973:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:1.0:1787780125.166651:0:17973:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1787780125.168101:0:17973:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:1.0:1787780125.168641:0:17973:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:1.0:1787780125.168957:0:17973:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:1.0:1787780125.169146:0:17973:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:1.0:1787780125.169383:0:17973:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:1.0:1787780125.169556:0:17973:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:1.0:1787780125.169731:0:17973:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:1.0:1787780125.170146:0:17973:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:1.0:1787780125.170440:0:17973:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:1.0:1787780125.170779:0:17973:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:1.0:1787780125.171135:0:17973:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:1.0:1787780125.171436:0:17973:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:1.0:1787780125.171649:0:17973:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:1.0:1787780125.172408:0:17973:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:1.0:1787780125.172724:0:17973:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:1.0:1787780125.173330:0:17973:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:1.0:1787780125.173973:0:17973:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:1.0:1787780125.174471:0:17973:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:1.0:1787780125.174761:0:17973:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:1.0:1787780125.175115:0:17973:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:1.0:1787780125.175553:0:17973:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:1.0:1787780125.176021:0:17973:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:1.0:1787780125.176503:0:17973:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:1.0:1787780125.176788:0:17973:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:1.0:1787780125.177392:0:17973:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:1.0:1787780125.177656:0:17973:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:1.0:1787780125.178127:0:17973:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:1.0:1787780125.178488:0:17973:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:1.0:1787780125.178920:0:17973:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:1.0:1787780125.179145:0:17973:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:1.0:1787780125.179434:0:17973:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:1.0:1787780125.179621:0:17973:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:1.0:1787780125.181538:0:17973:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1787780125.182110:0:17973:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:1.0:1787780125.182401:0:17973:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:1.0:1787780125.182709:0:17973:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:1.0:1787780125.183450:0:17973:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:1.0:1787780125.184288:0:17973:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:1.0:1787780125.185066:0:17973:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:1.0:1787780125.186058:0:17973:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1787780125.186927:0:17973:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:1.0:1787780125.187731:0:17973:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:1.0:1787780125.188580:0:17973:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:1.0:1787780125.189071:0:17973:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:01000000:1.0:1787780125.191902:0:17973:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1787780125.192133:0:17973:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:1.0:1787780125.192144:0:17973:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:1.0:1787780125.192155:0:17973:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xc8fc0a5179961875 00000020:01000004:1.0:1787780125.192173:0:17973:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:1.0:1787780125.192193:0:17973:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.131@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1787780125.192196:0:17973:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.131@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1787780125.192202:0:17973:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:1.0:1787780125.192226:0:17973:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:1.0:1787780125.192230:0:17973:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.131@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:2.0:1787780125.198359:0:17973:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.131@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787780125.198401:0:17973:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.131@tcp, index=0001, flags=0x20001 00000020:01000004:2.0:1787780125.198405:0:17973:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787780125.198407:0:17973:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1787780125.198408:0:17973:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787780125.198410:0:17973:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787780125.198411:0:17973:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787780125.198413:0:17973:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787780125.198414:0:17973:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787780125.198416:0:17973:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787780125.198417:0:17973:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787780125.198421:0:17973:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:2.0:1787780125.198423:0:17973:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787780125.198424:0:17973:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1787780125.198425:0:17973:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787780125.198426:0:17973:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787780125.198427:0:17973:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787780125.198428:0:17973:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787780125.198429:0:17973:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787780125.198430:0:17973:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787780125.198431:0:17973:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787780125.198457:0:17973:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1787780125.198475:0:17973:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348a083c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17973:1874622881656704:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787780125.198538:0:17973:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787780125.198749:0:17973:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c04778359c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787780125.199144:0:17236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881656704 00000100:00100000:0.0:1787780125.199152:0:17236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881656704 00000100:00100000:0.0:1787780125.199298:0:17236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787780125.199308:0:17236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0478635050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+12:17973:x1874622881656704:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787780125.199341:0:17236:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1787780125.199344:0:17236:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:0.0:1787780125.199352:0:17236:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:0.0:1787780125.199633:0:17236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0478635050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+12:17973:x1874622881656704:12345-0@lo:253:mount.lustre.0 Request processed in 326us (1094us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780125.199641:0:17236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787780125.199712:0:17973:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348a083c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17973:1874622881656704:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787780125.199731:0:17973:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1787780125.199734:0:17973:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787780125.199736:0:17973:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1787780125.199737:0:17973:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787780125.199739:0:17973:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787780125.199740:0:17973:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787780125.199741:0:17973:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787780125.199743:0:17973:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787780125.199744:0:17973:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787780125.199745:0:17973:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787780125.199760:0:17973:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9c0477821800 from lustre-MDT0001 10000000:01000000:2.0:1787780125.199785:0:17973:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:2.0:1787780125.199789:0:17973:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1787780125.199803:0:17973:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9c04431399b8 local copy 00010000:00010000:2.0:1787780125.199821:0:17973:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c04766dde00/0xc8fc0a517996176b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a5179961772 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787780125.199942:0:17973:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348a083c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17973:1874622881656832:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787780125.199972:0:17973:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787780125.200482:0:17973:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0477835a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787780125.200718:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881656832 00000100:00100000:3.0:1787780125.200725:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881656832 00000100:00100000:3.0:1787780125.200757:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787780125.200765:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0478635850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+12:17973:x1874622881656832:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787780125.200879:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0478635850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+12:17973:x1874622881656832:12345-0@lo:501:mount.lustre.0 Request processed in 114us (905us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787780125.200886:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787780125.201017:0:17973:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348a083c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17973:1874622881656832:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1787780125.201031:0:17973:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.131@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1787780125.201061:0:17973:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.131@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1787780125.201068:0:17973:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c04766dde00/0xc8fc0a517996176b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a5179961772 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780125.201077:0:17973:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff9c04766dde00/0xc8fc0a517996176b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a5179961772 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787780125.201100:0:17973:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9c0477821800 10000000:01000000:2.0:1787780125.201112:0:17973:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787780125.201117:0:17973:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9c04431399b8 10000000:01000000:2.0:1787780125.201119:0:17973:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1787780125.201123:0:17973:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9c04431399b8 from 1 10000000:01000000:2.0:1787780125.201126:0:17973:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1787780125.201151:0:17973:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c0444c18a00/0xc8fc0a517996187c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780125.201170:0:17973:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff9c0444c18a00/0xc8fc0a517996187c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780125.201179:0:17973:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff9c0444c18a00/0xc8fc0a517996187c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787780125.201193:0:17973:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348a083c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17973:1874622881656960:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787780125.201219:0:17973:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787780125.201232:0:17973:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0477835a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787780125.201379:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881656960 00000100:00100000:3.0:1787780125.201384:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881656960 00000100:00100000:3.0:1787780125.201404:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787780125.201409:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0478636450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+12:17973:x1874622881656960:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787780125.201418:0:17234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787780125.201436:0:17234:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c04766dd600/0xc8fc0a5179961883 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc8fc0a517996187c expref: -99 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780125.201457:0:17234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c04766dd600/0xc8fc0a5179961883 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc8fc0a517996187c expref: 13 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780125.201467:0:17234:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c04766dd600/0xc8fc0a5179961883 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a517996187c expref: 13 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780125.201475:0:17234:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c04766dd600, rc 0) 00000100:00100000:3.0:1787780125.201594:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0478636450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+13:17973:x1874622881656960:12345-0@lo:101:mount.lustre.0 Request processed in 184us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780125.201602:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787780125.201944:0:17973:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348a083c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17973:1874622881656960:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787780125.201958:0:17973:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff9c0444c18a00/0xc8fc0a517996187c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a5179961883 expref: -99 pid: 17973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780125.201968:0:17973:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff9c0444c18a00/0xc8fc0a517996187c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc8fc0a5179961883 expref: -99 pid: 17973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787780125.201983:0:17973:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1787780125.202035:0:17973:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c0444c18a00/0xc8fc0a517996187c lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a5179961883 expref: -99 pid: 17973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780125.202044:0:17973:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff9c0444c18a00/0xc8fc0a517996187c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a5179961883 expref: -99 pid: 17973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787780125.202074:0:17973:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9c0477821800 10000000:01000000:2.0:1787780125.202078:0:17973:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1787780125.202082:0:17973:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9c0477821800 from 1 10000000:01000000:2.0:1787780125.202085:0:17973:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1787780125.202102:0:17973:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c0444c19600/0xc8fc0a517996188a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780125.202110:0:17973:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff9c0444c19600/0xc8fc0a517996188a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780125.202117:0:17973:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff9c0444c19600/0xc8fc0a517996188a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787780125.202130:0:17973:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348a083c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17973:1874622881657088:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787780125.202168:0:17973:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787780125.202194:0:17973:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0477835a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787780125.202242:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881657088 00000100:00100000:3.0:1787780125.202247:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881657088 00000100:00100000:3.0:1787780125.202278:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787780125.202284:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0478634050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+13:17973:x1874622881657088:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787780125.202293:0:17234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787780125.202301:0:17234:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c04766ddc00/0xc8fc0a5179961891 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc8fc0a517996188a expref: -99 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780125.202316:0:17234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c04766ddc00/0xc8fc0a5179961891 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc8fc0a517996188a expref: 14 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780125.202325:0:17234:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c04766ddc00/0xc8fc0a5179961891 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a517996188a expref: 14 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780125.202333:0:17234:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c04766ddc00, rc 0) 00000100:00100000:3.0:1787780125.202369:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0478634050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+14:17973:x1874622881657088:12345-0@lo:101:mount.lustre.0 Request processed in 85us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780125.202385:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787780125.202455:0:17973:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348a083c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17973:1874622881657088:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787780125.202466:0:17973:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff9c0444c19600/0xc8fc0a517996188a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a5179961891 expref: -99 pid: 17973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780125.202475:0:17973:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff9c0444c19600/0xc8fc0a517996188a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc8fc0a5179961891 expref: -99 pid: 17973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787780125.202485:0:17973:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1787780125.203004:0:17973:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c0444c19600/0xc8fc0a517996188a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a5179961891 expref: -99 pid: 17973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780125.203013:0:17973:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff9c0444c19600/0xc8fc0a517996188a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a5179961891 expref: -99 pid: 17973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787780125.203019:0:17973:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1787780125.203138:0:17973:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787780125.203145:0:17973:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9c0477821800 10000000:01000000:0.0:1787780125.203149:0:17973:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1787780125.203152:0:17973:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:0.0:1787780125.203155:0:17973:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1787780125.203228:0:17973:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c0481372600/0xc8fc0a5179961898 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780125.203238:0:17973:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff9c0481372600/0xc8fc0a5179961898 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780125.203254:0:17973:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff9c0481372600/0xc8fc0a5179961898 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787780125.203271:0:17973:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346cfd2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17973:1874622881657216:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787780125.203303:0:17973:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787780125.203369:0:17973:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c046ef9c840 going to sleep for 11 seconds 00000100:00100000:3.0:1787780125.203413:0:17237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881657216 00000100:00100000:3.0:1787780125.203418:0:17237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881657216 00000100:00100000:3.0:1787780125.203489:0:17237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787780125.203497:0:17237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0478635c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+14:17973:x1874622881657216:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787780125.203506:0:17237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787780125.203516:0:17237:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c04766dd200/0xc8fc0a517996189f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc8fc0a5179961898 expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780125.203532:0:17237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c04766dd200/0xc8fc0a517996189f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc8fc0a5179961898 expref: 15 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780125.203542:0:17237:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c04766dd200/0xc8fc0a517996189f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a5179961898 expref: 15 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780125.203549:0:17237:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c04766dd200, rc 0) 00000100:00100000:3.0:1787780125.203588:0:17237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0478635c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+15:17973:x1874622881657216:12345-0@lo:101:mount.lustre.0 Request processed in 92us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780125.203595:0:17237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787780125.203651:0:17973:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346cfd2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17973:1874622881657216:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787780125.203663:0:17973:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff9c0481372600/0xc8fc0a5179961898 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a517996189f expref: -99 pid: 17973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780125.203671:0:17973:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff9c0481372600/0xc8fc0a5179961898 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc8fc0a517996189f expref: -99 pid: 17973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787780125.205005:0:17973:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000040:00080000:2.0:1787780125.205909:0:17973:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787780125.209402:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1787780125.209457:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:2.0:1787780125.209472:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:2.0:1787780125.209498:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:2.0:1787780125.209510:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 00000040:00080000:2.0:1787780125.209521:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 00000040:00080000:2.0:1787780125.209534:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 00000040:00080000:2.0:1787780125.209547:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:2.0:1787780125.209558:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:2.0:1787780125.209569:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 00000040:00080000:2.0:1787780125.209581:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 00000040:00080000:2.0:1787780125.209592:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 00000040:00080000:2.0:1787780125.209603:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 00000040:00080000:2.0:1787780125.209614:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:2.0:1787780125.209627:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:2.0:1787780125.209639:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 00000040:00080000:2.0:1787780125.209652:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:2.0:1787780125.209666:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:2.0:1787780125.209678:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 00000040:00080000:2.0:1787780125.209691:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:2.0:1787780125.209703:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:2.0:1787780125.209715:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:2.0:1787780125.209728:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:2.0:1787780125.209757:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 00000040:00080000:2.0:1787780125.209762:0:17973:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 24 count 25 00000100:00100000:2.0:1787780125.211397:0:17973:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348a08000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17973:1874622881657344:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787780125.211466:0:17973:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787780125.211514:0:17973:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0477835900 going to sleep for 11 seconds 00000100:00100000:0.0:1787780125.211595:0:17236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881657344 00000100:00100000:0.0:1787780125.211602:0:17236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881657344 00000100:00100000:0.0:1787780125.211657:0:17236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787780125.211667:0:17236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0478634c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+15:17973:x1874622881657344:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787780125.211834:0:17236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0478634c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+15:17973:x1874622881657344:12345-0@lo:501:mount.lustre.0 Request processed in 168us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780125.211868:0:17236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787780125.212365:0:17973:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348a08000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17973:1874622881657344:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787780125.212403:0:17973:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348a08000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17973:1874622881657472:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787780125.212452:0:17973:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787780125.212481:0:17973:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0477835900 going to sleep for 11 seconds 00000100:00100000:0.0:1787780125.212535:0:17237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881657472 00000100:00100000:0.0:1787780125.212540:0:17237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881657472 00000100:00100000:0.0:1787780125.212576:0:17237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787780125.212584:0:17237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0478635450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+15:17973:x1874622881657472:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787780125.213475:0:17237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0478635450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+15:17973:x1874622881657472:12345-0@lo:503:mount.lustre.0 Request processed in 889us (1021us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780125.213485:0:17237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787780125.213580:0:17973:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348a08000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17973:1874622881657472:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787780125.214272:0:17973:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787780125.214349:0:17973:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348a08000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17973:1874622881657600:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787780125.214400:0:17973:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787780125.214521:0:17973:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0477835b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787780125.214665:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881657600 00000100:00100000:1.0:1787780125.214671:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881657600 00000100:00100000:0.0:1787780125.214885:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787780125.214895:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0478634450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+15:17973:x1874622881657600:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787780125.215573:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0478634450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+15:17973:x1874622881657600:12345-0@lo:502:mount.lustre.0 Request processed in 677us (1171us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780125.215582:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787780125.215688:0:17973:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348a08000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17973:1874622881657600:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787780125.216373:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1787780125.216407:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 136 off8552 00000040:00080000:3.0:1787780125.216423:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 176 off8728 00000040:00080000:3.0:1787780125.216439:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8952 00000040:00080000:3.0:1787780125.216452:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9176 00000040:00080000:3.0:1787780125.216465:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9296 00000040:00080000:3.0:1787780125.216478:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 112 off9408 00000040:00080000:3.0:1787780125.216491:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 160 off9568 00000040:00080000:3.0:1787780125.216515:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9792 00000040:00080000:3.0:1787780125.216526:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off10016 00000040:00080000:3.0:1787780125.216538:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 88 off10104 00000040:00080000:3.0:1787780125.216552:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 144 off10248 00000040:00080000:3.0:1787780125.216567:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 152 off10400 00000040:00080000:3.0:1787780125.216578:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 168 off10568 00000040:00080000:3.0:1787780125.216600:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 224 off10792 00000040:00080000:3.0:1787780125.216613:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 224 off11016 00000040:00080000:3.0:1787780125.216624:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 80 off11096 00000040:00080000:3.0:1787780125.216636:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11320 00000040:00080000:3.0:1787780125.216650:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 224 off11544 00000040:00080000:3.0:1787780125.216682:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 160 off11704 00000040:00080000:3.0:1787780125.216700:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11928 00000040:00080000:3.0:1787780125.216714:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 224 off12152 00000040:00080000:3.0:1787780125.216728:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 80 off12232 00000040:00080000:3.0:1787780125.216742:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 224 off12456 00000040:00080000:3.0:1787780125.216755:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 224 off12680 00000040:00080000:3.0:1787780125.216767:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 88 off12768 00000040:00080000:3.0:1787780125.216780:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 144 off12912 00000040:00080000:3.0:1787780125.216956:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 152 off13064 00000040:00080000:3.0:1787780125.216980:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 136 off13200 00000040:00080000:3.0:1787780125.216993:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13424 00000040:00080000:3.0:1787780125.217006:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 224 off13648 00000040:00080000:3.0:1787780125.217018:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 80 off13728 00000040:00080000:3.0:1787780125.217030:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 224 off13952 00000040:00080000:3.0:1787780125.217043:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 224 off14176 00000040:00080000:3.0:1787780125.217054:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 88 off14264 00000040:00080000:3.0:1787780125.217079:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 144 off14408 00000040:00080000:3.0:1787780125.217095:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 152 off14560 00000040:00080000:3.0:1787780125.217108:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 136 off14696 00000040:00080000:3.0:1787780125.217121:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14920 00000040:00080000:3.0:1787780125.217135:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 224 off15144 00000040:00080000:3.0:1787780125.217150:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 80 off15224 00000040:00080000:3.0:1787780125.217253:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 224 off15448 00000040:00080000:3.0:1787780125.217270:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 224 off15672 00000040:00080000:3.0:1787780125.217284:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 120 off15792 00000100:00100000:3.0:1787780125.217326:0:17973:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347daed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17973:1874622881657728:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787780125.217390:0:17973:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780125.217734:0:17973:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0477ba0840 going to sleep for 11 seconds 00000100:00100000:2.0:1787780125.217934:0:17236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881657728 00000100:00100000:2.0:1787780125.217941:0:17236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881657728 00000100:00100000:2.0:1787780125.217982:0:17236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787780125.217990:0:17236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0478636050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+15:17973:x1874622881657728:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787780125.218275:0:17236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0478636050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+15:17973:x1874622881657728:12345-0@lo:502:mount.lustre.0 Request processed in 284us (884us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780125.218283:0:17236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787780125.218363:0:17973:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347daed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17973:1874622881657728:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787780125.218411:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off16016 00000040:00080000:3.0:1787780125.218422:0:17973:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:0.0:1787780125.219405:0:17977:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787780125.219417:0:17977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787780125.219419:0:17977:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1787780125.219424:0:17977:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:0.0:1787780125.219427:0:17977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787780125.219439:0:17977:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff9c04716e0000) 00000020:00000080:0.0:1787780125.219459:0:17977:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:0.0:1787780125.219464:0:17977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1787780125.219546:0:17977:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787780125.219554:0:17977:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xc8fc0a51799618ad 00000020:00000080:0.0:1787780125.219775:0:17977:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:0.0:1787780125.219780:0:17977:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787780125.219784:0:17977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787780125.219785:0:17977:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1787780125.219788:0:17977:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787780125.219791:0:17977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787780125.219803:0:17977:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:0.0:1787780125.219807:0:17977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787780125.219823:0:17977:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff9c04716e4d28) 00000020:00000080:0.0:1787780125.219834:0:17977:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:0.0:1787780125.219870:0:17977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1787780125.219872:0:17977:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:0.0:1787780125.219875:0:17977:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:0.0:1787780125.219880:0:17977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787780125.219936:0:17977:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c0477821800 from lustre-MDT0001, refs=2 00000020:00000080:0.0:1787780125.219949:0:17977:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff9c04716e19b8) 00000020:00000080:0.0:1787780125.219959:0:17977:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:0.0:1787780125.220025:0:17977:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1787780125.220031:0:17977:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xc8fc0a51799618c2 00000020:00000080:0.0:1787780125.220379:0:17977:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:0.0:1787780125.220387:0:17977:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1787780125.220391:0:17977:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xc8fc0a51799618c9 00080000:01000000:0.0:1787780125.220397:0:17977:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:0.0:1787780125.220407:0:17977:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xc8fc0a51799618d0 00010000:00010000:2.0:1787780125.306115:0:17977:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:2.0:1787780125.306710:0:17977:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 4294967301 00000001:00080000:2.0:1787780125.307087:0:17977:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1787780125.307967:0:17977:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:3.0:1787780125.307977:0:17977:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787780125.307982:0:17977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787780125.307984:0:17977:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:3.0:1787780125.307988:0:17977:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787780125.307993:0:17977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787780125.307994:0:17977:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:3.0:1787780125.307997:0:17977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787780125.308002:0:17977:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.131@tcp to nid 0x20000c0a8cb83 (192.168.203.131@tcp) 00000020:00000080:3.0:1787780125.308027:0:17977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787780125.308040:0:17977:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff9c0476620000) 00000020:00000080:3.0:1787780125.308147:0:17977:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:3.0:1787780125.308155:0:17977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787780125.308214:0:17977:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:3.0:1787780125.308220:0:17977:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:3.0:1787780125.308225:0:17977:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xc8fc0a51799618de 00010000:00080000:3.0:1787780125.308261:0:17977:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c04429f7000@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.131@tcp at head 00010000:00010000:3.0:1787780125.310928:0:17977:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:0.0:1787780125.313549:0:17977:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1787780125.313562:0:17977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1787780125.313597:0:17977:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:0.0:1787780125.313620:0:17977:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xc8fc0a51799618e5 00000100:00080000:0.0:1787780125.313631:0:17977:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787780125.313637:0:17977:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9c04429f7000 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:0.0:1787780125.313672:0:17977:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c0346cfcf00 x1874622881657856/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787780125.313700:0:17977:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:0.0:1787780125.313757:0:17977:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787780125.313760:0:17977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787780125.313762:0:17977:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:0.0:1787780125.313765:0:17977:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787780125.313768:0:17977:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1787780125.313769:0:17977:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787780125.313771:0:17977:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787780125.313773:0:17977:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787780125.313775:0:17977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787780125.313776:0:17977:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:0.0:1787780125.313778:0:17977:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787780125.313782:0:17977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787780125.313784:0:17977:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:0.0:1787780125.313787:0:17977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1787780125.313824:0:17977:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1787780125.313853:0:17977:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787780125.313857:0:17977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787780125.313859:0:17977:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:0.0:1787780125.313862:0:17977:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787780125.313864:0:17977:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #18 00000020:01000000:0.0:1787780125.313865:0:17977:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787780125.313867:0:17977:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787780125.313882:0:17977:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787780125.313885:0:17977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787780125.313887:0:17977:0:(obd_config.c:1563:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:0.0:1787780125.313890:0:17977:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787780125.313894:0:17977:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1787780125.313897:0:17977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787780125.313898:0:17977:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1787780125.313901:0:17977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787780125.313905:0:17977:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.131@tcp to nid 0x20000c0a8cb83 (192.168.203.131@tcp) 00000020:01000000:0.0:1787780125.313927:0:17977:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1787780125.313930:0:17977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787780125.313943:0:17977:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9c04515699b8) 00000020:00000080:0.0:1787780125.313955:0:17977:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:0.0:1787780125.313959:0:17977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787780125.314031:0:17977:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:0.0:1787780125.314038:0:17977:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:0.0:1787780125.314043:0:17977:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xc8fc0a51799618f3 00010000:00080000:0.0:1787780125.314245:0:17977:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c0345e54800@lustre-OST0000-osc-MDT0001: add connection 192.168.203.131@tcp at head 00010000:00010000:0.0:1787780125.314446:0:17977:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00080000:3.0:1787780125.314904:0:2253:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1787780125.314910:0:2253:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1787780125.314913:0:2253:0:(import.c:65:import_set_state_nolock()) ffff9c04811dd800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787780125.314927:0:2253:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 531 00000100:00080000:3.0:1787780125.314931:0:2253:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1787780125.314937:0:2253:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9c04811dd800 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:3.0:1787780125.314959:0:2253:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c0347daed00 x1874622881657984/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787780125.314972:0:2253:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787780125.314975:0:2253:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787780125.314978:0:2253:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787780125.314981:0:2253:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787780125.315023:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787780125.315035:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347dacf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1874622881658112:0@lo:400:kworker.0 00000100:00100000:3.0:1787780125.315109:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780125.315166:0:17242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881658112 00000100:00100000:3.0:1787780125.315172:0:17242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881658112 00000100:00100000:3.0:1787780125.315211:0:17242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787780125.315219:0:17242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347daf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1874622881658112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787780125.315268:0:17242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347daf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1874622881658112:12345-0@lo:400:kworker.0 Request processed in 49us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780125.315274:0:17242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787780125.315312:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9c0347dacf00 x1874622881658112/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787780141 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787780125.315325:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347dacf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1874622881658112:0@lo:400:kworker.0 00000040:01000000:0.0:1787780125.317275:0:17977:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1787780125.317469:0:17977:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000100:00100000:2.0:1787780125.317690:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346cfcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1874622881657856:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787780125.317863:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787780125.317907:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347daed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1874622881657984:0@lo:38:kworker.0 00000100:00100000:2.0:1787780125.317930:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787780125.317978:0:17247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881657856 00000100:00100000:2.0:1787780125.317985:0:17247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881657856 00000100:00100000:2.0:1787780125.318005:0:17247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881657984 00000100:00100000:2.0:1787780125.318007:0:17247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881657984 00000100:00100000:2.0:1787780125.318017:0:17247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787780125.318023:0:17247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0348a0a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3640:x1874622881657856:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1787780125.318382:0:17247:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 533 last 0 00000020:00000080:2.0:1787780125.318427:0:17247:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xc8fc0a51799618fa 00000004:00100000:2.0:1787780125.318447:0:17247:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1787780125.318452:0:17247:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000040:00080000:0.0:1787780125.320640:0:17977:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787780125.322565:0:17977:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:2.0:1787780125.322771:0:17977:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 64 off8256 00000040:00080000:2.0:1787780125.324805:0:17982:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1787780125.324822:0:17982:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1787780125.326605:0:17977:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1787780125.326619:0:17977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1787780125.326660:0:17977:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1787780125.326681:0:17977:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xc8fc0a5179961901 00000100:00080000:0.0:1787780125.326693:0:17977:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787780125.326699:0:17977:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9c0345e54800 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:0.0:1787780125.326817:0:17977:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c0346cfcb40 x1874622881658240/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787780125.326871:0:17977:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1787780125.326956:0:17977:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787780125.326960:0:17977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787780125.326962:0:17977:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1787780125.326964:0:17977:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787780125.326967:0:17977:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:0.0:1787780125.326969:0:17977:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787780125.326970:0:17977:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787780125.326985:0:17977:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787780125.326988:0:17977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787780125.326989:0:17977:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:0.0:1787780125.326991:0:17977:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787780125.326995:0:17977:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1787780125.326998:0:17977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787780125.327000:0:17977:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1787780125.327002:0:17977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787780125.327014:0:17977:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.131@tcp to nid 0x20000c0a8cb83 (192.168.203.131@tcp) 00000020:01000000:0.0:1787780125.327037:0:17977:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1787780125.327039:0:17977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000100:00080000:2.0:1787780125.327323:0:17247:0:(import.c:65:import_set_state_nolock()) ffff9c0476478800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787780125.327445:0:17247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0348a0a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3640:x1874622881657856:12345-0@lo:38:llog_process_th.0 Request processed in 9406us (9593us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780125.327456:0:17247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787780125.327480:0:17247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787780125.327486:0:17247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0348a08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3640:x1874622881657984:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1787780125.327522:0:17247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0348a08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3640:x1874622881657984:12345-0@lo:38:kworker.0 Request processed in 35us (9591us total) trans 0 rc -11/-11 00000100:00100000:2.0:1787780125.327528:0:17247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000020:00000080:0.0:1787780125.327594:0:17977:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9c045156cd28) 00000020:00000080:0.0:1787780125.327607:0:17977:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:0.0:1787780125.327613:0:17977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787780125.327684:0:17977:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:0.0:1787780125.327690:0:17977:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:0.0:1787780125.327695:0:17977:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xc8fc0a517996190f 00000100:00100000:3.0:1787780125.327864:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346cfcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1874622881658240:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1787780125.327915:0:3640:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874622881658240 offset 0 length 520: 4 00000100:00100000:3.0:1787780125.327982:0:3640:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787780125.327990:0:3640:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 2 00000100:00080000:3.0:1787780125.327997:0:3640:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1787780125.328002:0:3640:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787780125.328004:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9c04429f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787780125.328016:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346cfcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1874622881657856:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787780125.328026:0:3640:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787780125.328030:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9c04811dd800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787780125.328033:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1787780125.328036:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347daed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1874622881657984:0@lo:38:kworker.0 00000100:00080000:3.0:1787780125.328128:0:2253:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787780125.328132:0:2253:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787780125.328135:0:2253:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787780125.328137:0:2253:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00080000:0.0:1787780125.328204:0:17977:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c0446172800@lustre-OST0001-osc-MDT0001: add connection 192.168.203.131@tcp at head 00010000:00010000:0.0:1787780125.328403:0:17977:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:0.0:1787780125.328460:0:17977:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1787780125.328472:0:17977:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00100000:3.0:1787780125.329188:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348a083c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874622881658368:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787780125.329231:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787780125.329305:0:17248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881658368 00000100:00100000:2.0:1787780125.329312:0:17248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881658368 00000100:00100000:2.0:1787780125.329350:0:17248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787780125.329358:0:17248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347daed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3642:x1874622881658368:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787780125.329383:0:17248:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1787780125.329422:0:17248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347daed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3642:x1874622881658368:12345-0@lo:41:osp-pre-0-1.0 Request processed in 64us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780125.329429:0:17248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787780125.329493:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348a083c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874622881658368:0@lo:41:osp-pre-0-1.0 00000040:00080000:0.0:1787780125.331483:0:17977:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787780125.331676:0:17977:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:0.0:1787780125.331936:0:17977:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:2.0:1787780125.341585:0:17278:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1787780125.341888:0:17984:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787780125.341893:0:17984:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1787780125.343190:0:17977:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1787780125.343202:0:17977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1787780125.343240:0:17977:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1787780125.343258:0:17977:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xc8fc0a5179961916 00000100:00080000:3.0:1787780125.343267:0:17977:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787780125.343272:0:17977:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9c0446172800 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:3.0:1787780125.343302:0:17977:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c0347dacf00 x1874622881658496/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787780125.343333:0:17977:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1787780125.343383:0:17977:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787780125.343387:0:17977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787780125.343389:0:17977:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1787780125.343391:0:17977:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787780125.343395:0:17977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787780125.343396:0:17977:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787780125.343399:0:17977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787780125.343401:0:17977:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787780125.343403:0:17977:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787780125.343405:0:17977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787780125.343406:0:17977:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:3.0:1787780125.343408:0:17977:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787780125.343410:0:17977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787780125.343411:0:17977:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787780125.343415:0:17977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1787780125.343436:0:17977:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787780125.343438:0:17977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787780125.343439:0:17977:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787780125.343442:0:17977:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000100:00100000:3.0:1787780125.343544:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347dacf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1874622881658496:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1787780125.343594:0:3640:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874622881658496 offset 0 length 520: 4 00000100:00080000:3.0:1787780125.343643:0:2253:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787780125.343648:0:2253:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787780125.343651:0:2253:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787780125.343654:0:2253:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:2.0:1787780125.344882:0:17973:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:2.0:1787780125.344924:0:17973:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1787780125.344948:0:17973:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c0481372600/0xc8fc0a5179961898 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a517996189f expref: -99 pid: 17973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780125.344980:0:17973:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff9c0481372600/0xc8fc0a5179961898 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a517996189f expref: -99 pid: 17973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787780125.344988:0:17973:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c0477821800 from 1 10000000:01000000:2.0:1787780125.344991:0:17973:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787780125.345022:0:17973:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c0444c18800/0xc8fc0a517996191d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780125.345030:0:17973:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff9c0444c18800/0xc8fc0a517996191d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780125.345041:0:17973:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff9c0444c18800/0xc8fc0a517996191d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787780125.345072:0:17973:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348a09e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17973:1874622881658624:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787780125.345133:0:17973:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787780125.345171:0:17973:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0477835240 going to sleep for 11 seconds 00000100:00100000:1.0:1787780125.345332:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881658624 00000100:00100000:1.0:1787780125.345339:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881658624 00000100:00100000:1.0:1787780125.345376:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787780125.345384:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0478637850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+15:17973:x1874622881658624:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787780125.345396:0:17234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787780125.345408:0:17234:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0347e4a000/0xc8fc0a5179961924 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc8fc0a517996191d expref: -99 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780125.345431:0:17234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0347e4a000/0xc8fc0a5179961924 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc8fc0a517996191d expref: 16 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780125.345455:0:17234:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0347e4a000/0xc8fc0a5179961924 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a517996191d expref: 16 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780125.345463:0:17234:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0347e4a000, rc 0) 00000100:00100000:1.0:1787780125.345501:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0478637850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+16:17973:x1874622881658624:12345-0@lo:101:mount.lustre.0 Request processed in 117us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780125.345509:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787780125.347908:0:17973:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348a09e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17973:1874622881658624:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787780125.347936:0:17973:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff9c0444c18800/0xc8fc0a517996191d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a5179961924 expref: -99 pid: 17973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780125.347948:0:17973:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff9c0444c18800/0xc8fc0a517996191d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc8fc0a5179961924 expref: -99 pid: 17973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787780125.348530:0:17973:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348a09e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17973:1874622881658752:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1787780125.348589:0:17973:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787780125.348628:0:17973:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0477835240 going to sleep for 11 seconds 00000100:00100000:1.0:1787780125.348928:0:17237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881658752 00000100:00100000:1.0:1787780125.348935:0:17237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881658752 00000100:00100000:1.0:1787780125.348981:0:17237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787780125.348989:0:17237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046f20f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+16:17973:x1874622881658752:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1787780125.349008:0:17237:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1787780125.349023:0:17237:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1787780125.349026:0:17237:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:1.0:1787780125.349117:0:17237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046f20f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+16:17973:x1874622881658752:12345-0@lo:256:mount.lustre.0 Request processed in 129us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780125.349125:0:17237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787780125.349253:0:17973:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348a09e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17973:1874622881658752:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1787780125.349822:0:17973:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787780125.349866:0:17973:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c0444c18800/0xc8fc0a517996191d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a5179961924 expref: -99 pid: 17973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780125.349877:0:17973:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff9c0444c18800/0xc8fc0a517996191d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a5179961924 expref: -99 pid: 17973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787780125.349885:0:17973:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c0477821800 from 1 10000000:01000000:3.0:1787780125.349888:0:17973:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787780125.349913:0:17973:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c04766dc800/0xc8fc0a517996192b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780125.349921:0:17973:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff9c04766dc800/0xc8fc0a517996192b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780125.349930:0:17973:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff9c04766dc800/0xc8fc0a517996192b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787780125.349945:0:17973:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347dada40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17973:1874622881658880:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787780125.349976:0:17973:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780125.350002:0:17973:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0477ba0780 going to sleep for 11 seconds 00000100:00100000:3.0:1787780125.350020:0:17236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881658880 00000100:00100000:3.0:1787780125.350023:0:17236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881658880 00000100:00100000:3.0:1787780125.350767:0:17236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787780125.350782:0:17236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046f20e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+16:17973:x1874622881658880:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787780125.350795:0:17236:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787780125.350817:0:17236:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c04766dd000/0xc8fc0a5179961932 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc8fc0a517996192b expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780125.350865:0:17236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c04766dd000/0xc8fc0a5179961932 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc8fc0a517996192b expref: 17 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780125.350886:0:17236:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c04766dd000/0xc8fc0a5179961932 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a517996192b expref: 17 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780125.350894:0:17236:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c04766dd000, rc 0) 00000100:00100000:3.0:1787780125.350938:0:17236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046f20e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+17:17973:x1874622881658880:12345-0@lo:101:mount.lustre.0 Request processed in 161us (961us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780125.351003:0:17973:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347dada40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17973:1874622881658880:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787780125.351016:0:17973:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff9c04766dc800/0xc8fc0a517996192b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a5179961932 expref: -99 pid: 17973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780125.351024:0:17973:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff9c04766dc800/0xc8fc0a517996192b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc8fc0a5179961932 expref: -99 pid: 17973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787780125.351161:0:17973:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787780125.351207:0:17973:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c03488e30c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17973:1874622881659008:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787780125.351242:0:17973:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780125.351259:0:17973:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0449b62000 going to sleep for 11 seconds 00000100:00100000:2.0:1787780125.354003:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881659008 00000100:00100000:2.0:1787780125.354016:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881659008 00000100:00100000:2.0:1787780125.354057:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787780125.354066:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046f20c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+18:17973:x1874622881659008:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787780125.354268:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046f20c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+18:17973:x1874622881659008:12345-0@lo:501:mount.lustre.0 Request processed in 202us (3025us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780125.354276:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787780125.356128:0:17236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787780125.362216:0:17973:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c03488e30c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17973:1874622881659008:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787780125.362278:0:17973:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c03488e30c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17973:1874622881659136:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787780125.362934:0:17973:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780125.362975:0:17973:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0449b62000 going to sleep for 11 seconds 00000100:00100000:3.0:1787780125.364219:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881659136 00000100:00100000:3.0:1787780125.364233:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881659136 00000100:00100000:3.0:1787780125.364289:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787780125.364298:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046f20d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+17:17973:x1874622881659136:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787780125.364459:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046f20d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+17:17973:x1874622881659136:12345-0@lo:503:mount.lustre.0 Request processed in 162us (1526us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780125.364467:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787780125.364830:0:17973:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c03488e30c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17973:1874622881659136:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787780125.365305:0:17973:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787780125.365369:0:17973:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348a08b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17973:1874622881659264:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787780125.365459:0:17973:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787780125.365491:0:17973:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0477835c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787780125.365503:0:17237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881659264 00000100:00100000:3.0:1787780125.365508:0:17237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881659264 00000100:00100000:3.0:1787780125.365542:0:17237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787780125.365550:0:17237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046f20cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+17:17973:x1874622881659264:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787780125.365648:0:17237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046f20cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+17:17973:x1874622881659264:12345-0@lo:502:mount.lustre.0 Request processed in 98us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780125.365656:0:17237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787780125.365733:0:17973:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348a08b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17973:1874622881659264:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787780125.365998:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1787780125.366024:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 112 off8528 00000040:00080000:0.0:1787780125.366039:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 224 off8752 00000040:00080000:0.0:1787780125.366052:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8976 00000040:00080000:0.0:1787780125.366065:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 112 off9088 00000040:00080000:0.0:1787780125.366077:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 224 off9312 00000040:00080000:0.0:1787780125.366090:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9536 00000040:00080000:0.0:1787780125.366103:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 128 off9664 00000040:00080000:0.0:1787780125.366116:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1787780125.366148:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off10112 00000040:00080000:0.0:1787780125.366163:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 128 off10240 00000100:00100000:0.0:1787780125.366185:0:17973:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346cfcf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17973:1874622881659392:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787780125.366221:0:17973:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787780125.366255:0:17973:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0346be29c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787780125.366312:0:17236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881659392 00000100:00100000:2.0:1787780125.366317:0:17236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881659392 00000100:00100000:2.0:1787780125.366352:0:17236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787780125.366359:0:17236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046f20dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+17:17973:x1874622881659392:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787780125.366438:0:17236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046f20dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+17:17973:x1874622881659392:12345-0@lo:502:mount.lustre.0 Request processed in 79us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780125.366445:0:17236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787780125.366526:0:17973:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346cfcf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17973:1874622881659392:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787780125.366561:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10464 00000040:00080000:0.0:1787780125.366569:0:17973:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1787780125.367028:0:17986:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787780125.367036:0:17986:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787780125.367038:0:17986:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787780125.367045:0:17986:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c0477821800 00000020:00000080:3.0:1787780125.367048:0:17986:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787780125.367061:0:17986:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787780125.367064:0:17986:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787780125.367066:0:17986:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1787780125.367068:0:17986:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787780125.367070:0:17986:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787780125.367071:0:17986:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787780125.367075:0:17986:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c0477821800 00000020:00000080:3.0:1787780125.367076:0:17986:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787780125.367129:0:17986:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787780125.367132:0:17986:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787780125.367133:0:17986:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1787780125.367136:0:17986:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787780125.367139:0:17986:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787780125.367140:0:17986:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787780125.367143:0:17986:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c0477821800 00000020:00000080:3.0:1787780125.367145:0:17986:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787780125.367160:0:17986:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787780125.367162:0:17986:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787780125.367163:0:17986:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787780125.367165:0:17986:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787780125.367167:0:17986:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787780125.367168:0:17986:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1787780125.367171:0:17986:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c0477821800 00000020:00000080:3.0:1787780125.367173:0:17986:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787780125.367190:0:17986:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787780125.367192:0:17986:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787780125.367193:0:17986:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1787780125.367195:0:17986:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000020:01000000:2.0:1787780125.367330:0:17973:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1787780125.367354:0:17973:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787780125.367374:0:17973:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c04766dc800/0xc8fc0a517996192b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a5179961932 expref: -99 pid: 17973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780125.367384:0:17973:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff9c04766dc800/0xc8fc0a517996192b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a5179961932 expref: -99 pid: 17973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787780125.367428:0:17973:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787780125.367432:0:17973:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9c0477821800 10000000:01000000:2.0:1787780125.367440:0:17973:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9c0477821800 10000000:01000000:2.0:1787780125.367444:0:17973:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787780125.367450:0:17973:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c0477821800 from 1 10000000:01000000:2.0:1787780125.367452:0:17973:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787780125.367479:0:17973:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c0444c19400/0xc8fc0a5179961939 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780125.367486:0:17973:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff9c0444c19400/0xc8fc0a5179961939 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780125.367496:0:17973:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff9c0444c19400/0xc8fc0a5179961939 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787780125.367511:0:17973:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348a09680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17973:1874622881659520:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787780125.367551:0:17973:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787780125.367583:0:17973:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c04500bf780 going to sleep for 11 seconds 00000100:00100000:3.0:1787780125.367666:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881659520 00000100:00100000:3.0:1787780125.367672:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881659520 00000100:00100000:3.0:1787780125.367708:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787780125.367717:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046f20c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+17:17973:x1874622881659520:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787780125.367728:0:17234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787780125.367747:0:17234:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c04766dd800/0xc8fc0a5179961940 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc8fc0a5179961939 expref: -99 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780125.367767:0:17234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c04766dd800/0xc8fc0a5179961940 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc8fc0a5179961939 expref: 18 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780125.367778:0:17234:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c04766dd800/0xc8fc0a5179961940 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a5179961939 expref: 18 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780125.367789:0:17234:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c04766dd800, rc 0) 00000100:00100000:3.0:1787780125.367954:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046f20c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+18:17973:x1874622881659520:12345-0@lo:101:mount.lustre.0 Request processed in 238us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780125.367962:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787780125.368016:0:17973:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348a09680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17973:1874622881659520:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787780125.368030:0:17973:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff9c0444c19400/0xc8fc0a5179961939 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a5179961940 expref: -99 pid: 17973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780125.368039:0:17973:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff9c0444c19400/0xc8fc0a5179961939 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xc8fc0a5179961940 expref: -99 pid: 17973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787780125.371182:0:17973:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:3.0:1787780125.371470:0:17973:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787780125.371642:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:3.0:1787780125.371666:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 120 off8536 00000040:00080000:3.0:1787780125.371679:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 168 off8704 00000040:00080000:3.0:1787780125.371691:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8928 00000040:00080000:3.0:1787780125.371703:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9152 00000040:00080000:3.0:1787780125.371718:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 120 off9272 00000040:00080000:3.0:1787780125.371731:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 168 off9440 00000040:00080000:3.0:1787780125.371743:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9664 00000040:00080000:3.0:1787780125.371756:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 224 off9888 00000040:00080000:3.0:1787780125.371770:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 120 off10008 00000040:00080000:3.0:1787780125.371782:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10232 00000040:00080000:3.0:1787780125.371796:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 224 off10456 00000040:00080000:3.0:1787780125.374103:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 88 off10544 00000040:00080000:3.0:1787780125.374169:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].14, 128 off10672 00000040:00080000:3.0:1787780125.374185:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].15, 144 off10816 00000040:00080000:3.0:1787780125.374201:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].16, 160 off10976 00000040:00080000:3.0:1787780125.374229:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].17, 224 off11200 00000040:00080000:3.0:1787780125.374253:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].18, 224 off11424 00000040:00080000:3.0:1787780125.374267:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].19, 80 off11504 00000040:00080000:3.0:1787780125.374280:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].20, 224 off11728 00000040:00080000:3.0:1787780125.374293:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].21, 224 off11952 00000040:00080000:3.0:1787780125.374305:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].22, 88 off12040 00000040:00080000:3.0:1787780125.374318:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].23, 128 off12168 00000040:00080000:3.0:1787780125.374331:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].24, 144 off12312 00000040:00080000:3.0:1787780125.374343:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].25, 160 off12472 00000040:00080000:3.0:1787780125.374355:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].26, 224 off12696 00000040:00080000:3.0:1787780125.374369:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].27, 224 off12920 00000040:00080000:3.0:1787780125.374380:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].28, 80 off13000 00000040:00080000:3.0:1787780125.374405:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].29, 224 off13224 00000040:00080000:3.0:1787780125.374411:0:17973:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:3.0:1787780125.374512:0:17973:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347daf0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17973:1874622881659648:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787780125.374574:0:17973:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780125.374663:0:17973:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0477ba09c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787780125.391424:0:17237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881659648 00000100:00100000:1.0:1787780125.391438:0:17237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881659648 00000100:00100000:2.0:1787780125.391823:0:17236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787780125.391833:0:17236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046f20e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+18:17973:x1874622881659648:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787780125.392013:0:17236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046f20e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+18:17973:x1874622881659648:12345-0@lo:501:mount.lustre.0 Request processed in 182us (17440us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780125.392021:0:17236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787780125.392441:0:17973:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347daf0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17973:1874622881659648:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787780125.392490:0:17973:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347daf0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17973:1874622881659776:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787780125.392539:0:17973:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780125.392567:0:17973:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0477ba09c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787780125.392598:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881659776 00000100:00100000:3.0:1787780125.392603:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881659776 00000100:00100000:3.0:1787780125.392631:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787780125.392636:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046f20d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+18:17973:x1874622881659776:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787780125.392883:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046f20d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+18:17973:x1874622881659776:12345-0@lo:503:mount.lustre.0 Request processed in 245us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780125.392890:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787780125.392932:0:17973:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347daf0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17973:1874622881659776:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787780125.393648:0:17973:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787780125.393881:0:17973:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347daf0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17973:1874622881659904:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787780125.393928:0:17973:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780125.393950:0:17973:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0477ba09c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787780125.397483:0:17237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881659904 00000100:00100000:3.0:1787780125.397495:0:17237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881659904 00000100:00100000:3.0:1787780125.397555:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787780125.397565:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046f20d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+18:17973:x1874622881659904:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787780125.397816:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046f20d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+18:17973:x1874622881659904:12345-0@lo:502:mount.lustre.0 Request processed in 242us (3876us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780125.397824:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787780125.397916:0:17973:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347daf0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17973:1874622881659904:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787780125.398498:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:3.0:1787780125.398535:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 120 off8536 00000040:00080000:3.0:1787780125.398551:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 168 off8704 00000040:00080000:3.0:1787780125.398565:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8928 00000040:00080000:3.0:1787780125.398579:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9152 00000040:00080000:3.0:1787780125.398592:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 120 off9272 00000040:00080000:3.0:1787780125.398607:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 168 off9440 00000040:00080000:3.0:1787780125.398623:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9664 00000040:00080000:3.0:1787780125.398641:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 224 off9888 00000040:00080000:3.0:1787780125.398657:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 120 off10008 00000040:00080000:3.0:1787780125.398672:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10232 00000040:00080000:3.0:1787780125.398688:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 224 off10456 00000040:00080000:3.0:1787780125.398704:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 88 off10544 00000040:00080000:3.0:1787780125.398938:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].14, 128 off10672 00000040:00080000:3.0:1787780125.398960:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].15, 144 off10816 00000040:00080000:3.0:1787780125.398976:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].16, 160 off10976 00000040:00080000:3.0:1787780125.399014:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].17, 224 off11200 00000040:00080000:3.0:1787780125.399034:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].18, 224 off11424 00000040:00080000:3.0:1787780125.399116:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].19, 80 off11504 00000040:00080000:3.0:1787780125.399134:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].20, 224 off11728 00000040:00080000:3.0:1787780125.399149:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].21, 224 off11952 00000040:00080000:3.0:1787780125.399165:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].22, 88 off12040 00000040:00080000:3.0:1787780125.399181:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].23, 128 off12168 00000040:00080000:3.0:1787780125.399201:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].24, 144 off12312 00000040:00080000:3.0:1787780125.399219:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].25, 160 off12472 00000040:00080000:3.0:1787780125.399252:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].26, 224 off12696 00000040:00080000:3.0:1787780125.399267:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].27, 224 off12920 00000040:00080000:3.0:1787780125.399282:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].28, 80 off13000 00000040:00080000:3.0:1787780125.399297:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].29, 224 off13224 00000040:00080000:3.0:1787780125.399312:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].30, 224 off13448 00000040:00080000:3.0:1787780125.399327:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].31, 88 off13536 00000040:00080000:3.0:1787780125.399343:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].32, 128 off13664 00000040:00080000:3.0:1787780125.399373:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].33, 144 off13808 00000040:00080000:3.0:1787780125.399392:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].34, 128 off13936 00000040:00080000:3.0:1787780125.399406:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].35, 224 off14160 00000040:00080000:3.0:1787780125.399424:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].36, 224 off14384 00000040:00080000:3.0:1787780125.399441:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].37, 80 off14464 00000040:00080000:3.0:1787780125.399457:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].38, 224 off14688 00000040:00080000:3.0:1787780125.399475:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].39, 224 off14912 00000040:00080000:3.0:1787780125.399494:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].40, 88 off15000 00000040:00080000:3.0:1787780125.399513:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].41, 128 off15128 00000040:00080000:3.0:1787780125.399532:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].42, 144 off15272 00000040:00080000:3.0:1787780125.399550:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].43, 128 off15400 00000040:00080000:3.0:1787780125.399568:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].44, 224 off15624 00000040:00080000:3.0:1787780125.399585:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].45, 224 off15848 00000040:00080000:3.0:1787780125.399602:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].46, 80 off15928 00000040:00080000:3.0:1787780125.399619:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].47, 224 off16152 00000040:00080000:3.0:1787780125.399637:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].48, 232 off16384 00000100:00100000:3.0:1787780125.399703:0:17973:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347daf0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17973:1874622881660032:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787780125.399948:0:17973:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780125.399996:0:17973:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0477ba0180 going to sleep for 11 seconds 00000100:00100000:2.0:1787780125.399999:0:17236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881660032 00000100:00100000:2.0:1787780125.400006:0:17236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881660032 00000100:00100000:2.0:1787780125.400082:0:17236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787780125.400092:0:17236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046f20f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+18:17973:x1874622881660032:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787780125.400312:0:17236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046f20f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+18:17973:x1874622881660032:12345-0@lo:502:mount.lustre.0 Request processed in 220us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780125.400319:0:17236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787780125.400392:0:17973:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347daf0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17973:1874622881660032:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787780125.400576:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].49, 224 off16608 00000040:00080000:1.0:1787780125.400602:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].50, 120 off16728 00000100:00100000:1.0:1787780125.400627:0:17973:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c03488e30c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17973:1874622881660160:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787780125.400665:0:17973:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780125.400757:0:17973:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0449b62c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787780125.400797:0:17237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881660160 00000100:00100000:2.0:1787780125.400802:0:17237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881660160 00000100:00100000:2.0:1787780125.400900:0:17237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787780125.400908:0:17237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046f20c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+18:17973:x1874622881660160:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787780125.400986:0:17237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046f20c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+18:17973:x1874622881660160:12345-0@lo:502:mount.lustre.0 Request processed in 78us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780125.400992:0:17237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787780125.401078:0:17973:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c03488e30c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17973:1874622881660160:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787780125.401123:0:17973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].51, 224 off16952 00000040:00080000:3.0:1787780125.401132:0:17973:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1787780125.403380:0:17992:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:2.0:1787780125.403397:0:17992:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff9c0450ceb370) 00000020:00000080:2.0:1787780125.403418:0:17992:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:2.0:1787780125.403502:0:17992:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c0477821800 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1787780125.403506:0:17992:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c0477821800 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1787780125.403508:0:17992:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c0477821800 3 00010000:00080000:2.0:1787780125.403652:0:17992:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c04429f2800@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.131@tcp at head 00000100:00100000:3.0:1787780125.405188:0:17284:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c04411ca0c0 going to sleep for 0 seconds 00010000:00010000:2.0:1787780125.407481:0:17992:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:2.0:1787780125.408017:0:17992:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:2.0:1787780125.408059:0:17992:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787780125.408074:0:17992:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xc8fc0a517996194e 00000100:00080000:2.0:1787780125.408083:0:17992:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787780125.408090:0:17992:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9c04429f2800 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:2.0:1787780125.408121:0:17992:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c0348a0b480 x1874622881660288/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787780125.408146:0:17992:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787780125.408307:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348a0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874622881660288:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787780125.408373:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787780125.408431:0:2253:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787780125.408435:0:2253:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787780125.408438:0:2253:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787780125.408441:0:2253:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787780125.408761:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881660288 00000100:00100000:2.0:1787780125.408767:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881660288 00000100:00100000:2.0:1787780125.408893:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787780125.408901:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347dae1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3640:x1874622881660288:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1787780125.408924:0:17244:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 533 last 0 00000020:00000080:2.0:1787780125.408966:0:17244:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xc8fc0a5179961955 00000004:00100000:2.0:1787780125.408980:0:17244:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787780125.409008:0:17244:0:(import.c:65:import_set_state_nolock()) ffff9c0341d3c000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787780125.409062:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347dae1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1874622881660288:12345-0@lo:38:llog_process_th.0 Request processed in 160us (689us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780125.409069:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1787780125.409464:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9c0348a0b480 x1874622881660288/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787780135 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787780125.409476:0:3640:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787780125.409484:0:3640:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 2 00000100:00080000:3.0:1787780125.409492:0:3640:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1787780125.409497:0:3640:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787780125.409499:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9c04429f2800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787780125.409505:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348a0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874622881660288:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1787780125.410092:0:17992:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000020:01000000:3.0:1787780125.410139:0:17973:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1787780125.410170:0:17973:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787780125.410187:0:17973:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c0444c19400/0xc8fc0a5179961939 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a5179961940 expref: -99 pid: 17973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780125.410208:0:17973:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff9c0444c19400/0xc8fc0a5179961939 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a5179961940 expref: -99 pid: 17973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787780125.410252:0:17973:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787780125.410255:0:17973:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1787780125.410256:0:17973:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787780125.410257:0:17973:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787780125.410259:0:17973:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787780125.410260:0:17973:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787780125.410261:0:17973:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787780125.410263:0:17973:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787780125.410264:0:17973:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787780125.410268:0:17973:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:3.0:1787780125.410270:0:17973:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787780125.410271:0:17973:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1787780125.410273:0:17973:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787780125.410274:0:17973:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787780125.410274:0:17973:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787780125.410276:0:17973:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787780125.410277:0:17973:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787780125.410277:0:17973:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787780125.410279:0:17973:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787780125.410298:0:17973:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1787780125.410314:0:17973:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347dac780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17973:1874622881660416:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787780125.410367:0:17973:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780125.410396:0:17973:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0477ba0cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787780125.410417:0:17236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881660416 00000100:00100000:3.0:1787780125.410422:0:17236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881660416 00000100:00100000:3.0:1787780125.410459:0:17236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787780125.410466:0:17236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046f20f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+18:17973:x1874622881660416:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787780125.410489:0:17236:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1787780125.410500:0:17236:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:3.0:1787780125.413866:0:17222:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:0.0:1787780125.413952:0:17236:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787780125.413967:0:17236:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:3.0:1787780125.415080:0:17258:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787780125.415088:0:17258:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787780125.415111:0:17258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c04766dcc00/0xc8fc0a517996195c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780125.415131:0:17258:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c0347e4bc00/0xc8fc0a5179961860 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a5179961859 expref: 18 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780125.415139:0:17258:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c0347e4a000/0xc8fc0a5179961924 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a517996191d expref: 18 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780125.415145:0:17258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c04766dcc00/0xc8fc0a517996195c lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780125.415190:0:17258:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c0347e4a000/0xc8fc0a5179961924 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc8fc0a517996191d expref: 18 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780125.415205:0:17258:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c0347e4a000/0xc8fc0a5179961924 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc8fc0a517996191d expref: 18 pid: 17234 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787780125.415219:0:17258:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347dad680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17258:1874622881660544:0@lo:104: 00000100:00100000:3.0:1787780125.415284:0:17258:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787780125.415331:0:17258:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c0347e4bc00/0xc8fc0a5179961860 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc8fc0a5179961859 expref: 18 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780125.415341:0:17258:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c0347e4bc00/0xc8fc0a5179961860 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc8fc0a5179961859 expref: 18 pid: 17237 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787780125.415351:0:17258:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347dafc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17258:1874622881660672:0@lo:104: 00000100:00100000:3.0:1787780125.415373:0:17258:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780125.415400:0:17258:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0477ba09c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787780125.415434:0:17226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881660544 00000100:00100000:3.0:1787780125.415441:0:17226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881660544 00000100:00100000:3.0:1787780125.415473:0:17226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881660672 00000100:00100000:3.0:1787780125.415476:0:17226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881660672 00000100:00100000:3.0:1787780125.415489:0:17226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787780125.415498:0:17226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347dade00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+4:17258:x1874622881660544:12345-0@lo:104: 00010000:00010000:3.0:1787780125.415509:0:17226:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff9c0444c18800/0xc8fc0a517996191d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc8fc0a5179961924 expref: -99 pid: 17973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787780125.416414:0:17236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046f20f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+18:17973:x1874622881660416:12345-0@lo:253:mount.lustre.0 Request processed in 5943us (6042us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780125.416427:0:17236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00010000:3.0:1787780125.416574:0:17226:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787780125.416582:0:17226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347dade00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+4:17258:x1874622881660544:12345-0@lo:104: Request processed in 1084us (1297us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780125.416590:0:17226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787780125.416609:0:17226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787780125.416617:0:17226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347dad2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+3:17258:x1874622881660672:12345-0@lo:104: 00010000:00010000:3.0:1787780125.416628:0:17226:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff9c0444c18600/0xc8fc0a5179961859 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc8fc0a5179961860 expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780125.416663:0:17226:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787780125.416668:0:17226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347dad2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+3:17258:x1874622881660672:12345-0@lo:104: Request processed in 54us (1295us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780125.416674:0:17226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787780125.416714:0:17973:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347dac780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17973:1874622881660416:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787780125.416726:0:17973:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1787780125.416729:0:17973:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787780125.416731:0:17973:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1787780125.416732:0:17973:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787780125.416733:0:17973:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787780125.416741:0:17973:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787780125.416743:0:17973:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787780125.416744:0:17973:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787780125.416746:0:17973:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787780125.416747:0:17973:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787780125.416763:0:17973:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:1.0:1787780125.420056:0:17230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787780125.420072:0:17230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff9c0444c18800/0xc8fc0a517996191d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc8fc0a5179961924 expref: -99 pid: 17973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780125.420083:0:17230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0444c18800 already unused, calling callback (ffffffffc139ac20) 10000000:00010000:1.0:1787780125.420088:0:17230:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff9c0444c18800/0xc8fc0a517996191d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc8fc0a5179961924 expref: -99 pid: 17973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780125.420099:0:17230:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff9c0444c18800/0xc8fc0a517996191d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc8fc0a5179961924 expref: -99 pid: 17973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787780125.420107:0:17230:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff9c0444c18800/0xc8fc0a517996191d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc8fc0a5179961924 expref: -99 pid: 17973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787780125.420113:0:17230:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787780125.420173:0:17230:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff9c0444c18800/0xc8fc0a517996191d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a5179961924 expref: -99 pid: 17973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780125.420179:0:17230:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787780125.420201:0:17230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff9c0444c18800/0xc8fc0a517996191d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a5179961924 expref: -99 pid: 17973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780125.420208:0:17230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff9c0444c18800/0xc8fc0a517996191d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a5179961924 expref: -99 pid: 17973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780125.420225:0:17230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787780125.420229:0:17230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff9c0444c18600/0xc8fc0a5179961859 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc8fc0a5179961860 expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780125.420235:0:17230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0444c18600 already unused, calling callback (ffffffffc139ac20) 10000000:00010000:1.0:1787780125.420237:0:17230:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff9c0444c18600/0xc8fc0a5179961859 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc8fc0a5179961860 expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780125.420259:0:17230:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff9c0444c18600/0xc8fc0a5179961859 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc8fc0a5179961860 expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787780125.420265:0:17230:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff9c0444c18600/0xc8fc0a5179961859 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc8fc0a5179961860 expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787780125.420271:0:17230:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787780125.420285:0:17230:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff9c0444c18600/0xc8fc0a5179961859 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a5179961860 expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780125.420291:0:17230:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787780125.420298:0:17230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff9c0444c18600/0xc8fc0a5179961859 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a5179961860 expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780125.420304:0:17230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff9c0444c18600/0xc8fc0a5179961859 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a5179961860 expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780125.420319:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787780125.420321:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787780125.420323:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787780125.420341:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c03488e1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:3643:1874622881660800:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787780125.420404:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780125.420442:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787780125.420448:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c03488e3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:3643:1874622881660928:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787780125.420469:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780125.420509:0:17227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881660800 00000100:00100000:1.0:1787780125.420515:0:17227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881660800 00010000:00010000:1.0:1787780125.420557:0:17227:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c0347e4a000/0xc8fc0a5179961924 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc8fc0a517996191d expref: 18 pid: 17234 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787780125.420594:0:17227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881660928 00000100:00100000:1.0:1787780125.420597:0:17227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881660928 00010000:00010000:1.0:1787780125.420610:0:17227:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c0347e4bc00/0xc8fc0a5179961860 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc8fc0a5179961859 expref: 19 pid: 17237 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787780125.420625:0:17227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787780125.420631:0:17227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03488e12c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+19:3643:x1874622881660800:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787780125.420643:0:17227:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787780125.420647:0:17227:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c0347e4a000/0xc8fc0a5179961924 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc8fc0a517996191d expref: 19 pid: 17234 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780125.420658:0:17227:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c0347e4a000/0xc8fc0a5179961924 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc8fc0a517996191d expref: 19 pid: 17234 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780125.420675:0:17227:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787780125.420707:0:17227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03488e12c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+19:3643:x1874622881660800:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780125.420714:0:17227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787780125.420731:0:17227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787780125.420737:0:17227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03488e3c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+18:3643:x1874622881660928:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787780125.420744:0:17227:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787780125.420748:0:17227:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c0347e4bc00/0xc8fc0a5179961860 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc8fc0a5179961859 expref: 18 pid: 17237 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780125.420756:0:17227:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c0347e4bc00/0xc8fc0a5179961860 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc8fc0a5179961859 expref: 18 pid: 17237 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780125.420767:0:17227:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c04766dcc00/0xc8fc0a517996195c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780125.420781:0:17227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c04766dcc00/0xc8fc0a517996195c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787780125.421186:0:17227:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.007200326s 00010000:00010000:1.0:1787780125.421192:0:17227:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c04766dcc00/0xc8fc0a517996195c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780125.421200:0:17227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c04766dcc00/0xc8fc0a517996195c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780125.421208:0:17227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c04766dcc00/0xc8fc0a517996195c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780125.421215:0:17227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c04766dcc00/0xc8fc0a517996195c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780125.421220:0:17227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c04766dcc00 already unused, calling callback (ffffffffc0d97420) 00010000:00010000:1.0:1787780125.421224:0:17227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c04766dcc00/0xc8fc0a517996195c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780125.421232:0:17227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c04766dcc00/0xc8fc0a517996195c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780125.421243:0:17227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c04766dcc00/0xc8fc0a517996195c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780125.421253:0:17227:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787780125.421280:0:17227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03488e3c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+18:3643:x1874622881660928:12345-0@lo:103:ldlm_bl.0 Request processed in 543us (809us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780125.421287:0:17227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787780125.421337:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c03488e3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:3643:1874622881660928:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787780125.421347:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c03488e1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:3643:1874622881660800:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787780125.424499:0:17231:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787780125.425994:0:17258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c0347e4a000/0xc8fc0a5179961924 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc8fc0a517996191d expref: 17 pid: 17234 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787780125.426012:0:17258:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347dad680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17258:1874622881660544:0@lo:104: 00010000:00010000:3.0:1787780125.426024:0:17258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c0347e4bc00/0xc8fc0a5179961860 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc8fc0a5179961859 expref: 16 pid: 17237 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787780125.426032:0:17258:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347dafc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17258:1874622881660672:0@lo:104: 00010000:00010000:3.0:1787780125.426067:0:17258:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c04766dcc00/0xc8fc0a517996195c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780125.426077:0:17258:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c04766dcc00/0xc8fc0a517996195c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780125.426083:0:17258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c04766dcc00/0xc8fc0a517996195c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780125.426090:0:17258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c04766dcc00/0xc8fc0a517996195c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:01000000:2.0:1787780125.438998:0:17973:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000040:01000000:2.0:1787780125.441509:0:17998:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:2.0:1787780125.442137:0:17998:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787780125.444325:0:17998:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1787780125.444402:0:17998:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000020:00080000:1.0:1787780125.444480:0:17997:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:1.0:1787780125.444485:0:17997:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:0.0:1787780125.444870:0:17973:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:1.0:1787780125.452825:0:17999:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c03488e1680 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17999:1874622881661056:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1787780125.452940:0:17999:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787780125.452981:0:17248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881661056 00000100:00100000:2.0:1787780125.452991:0:17248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881661056 00000100:00100000:1.0:1787780125.452993:0:17999:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0449b62840 going to sleep for 11 seconds 00000100:00100000:2.0:1787780125.453173:0:17248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787780125.453187:0:17248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03488e3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17999:x1874622881661056:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1787780125.453278:0:17248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03488e3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17999:x1874622881661056:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 94us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780125.453286:0:17248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000040:01000000:2.0:1787780125.453346:0:17973:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:2.0:1787780125.453389:0:17973:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1787780125.453827:0:17973:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000100:00100000:3.0:1787780125.454174:0:17999:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c03488e1680 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17999:1874622881661056:0@lo:1000:lod0001_rec0000.0 00000040:01000000:3.0:1787780125.454209:0:17999:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1787780125.454249:0:17999:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347dafc00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17999:1874622881661184:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1787780125.454302:0:17999:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780125.454351:0:17248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881661184 00000100:00100000:3.0:1787780125.454357:0:17248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881661184 00000100:00100000:3.0:1787780125.454388:0:17248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787780125.454396:0:17248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347dad680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17999:x1874622881661184:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1787780125.454509:0:17248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347dad680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17999:x1874622881661184:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 113us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780125.454517:0:17248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787780125.454538:0:17999:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0346cc5c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787780125.454550:0:17999:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347dafc00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17999:1874622881661184:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1787780125.454624:0:17999:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347dafc00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17999:1874622881661312:0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1787780125.454651:0:17999:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780125.454685:0:17253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881661312 00000100:00100000:3.0:1787780125.454689:0:17253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881661312 00000100:00100000:3.0:1787780125.454721:0:17253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787780125.454728:0:17253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347dac780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17999:x1874622881661312:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1787780125.454760:0:17253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347dac780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17999:x1874622881661312:12345-0@lo:900:lod0001_rec0000.0 Request processed in 33us (109us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780125.454767:0:17253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787780125.454782:0:17999:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0346cc5a80 going to sleep for 11 seconds 00010000:00080000:3.0:1787780125.454796:0:17999:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9c0347dafc00 x1874622881661312/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787780141 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787780125.454819:0:17999:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347dafc00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17999:1874622881661312:0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1787780125.454873:0:17999:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347dafc00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17999:1874622881661440:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1787780125.454900:0:17999:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780125.454918:0:17248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881661440 00000100:00100000:3.0:1787780125.454927:0:17248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881661440 00000100:00100000:3.0:1787780125.454945:0:17248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787780125.454950:0:17248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347daf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17999:x1874622881661440:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1787780125.455002:0:17248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347daf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17999:x1874622881661440:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 51us (101us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780125.455008:0:17248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787780125.455023:0:17999:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0346cc5c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787780125.455035:0:17999:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347dafc00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17999:1874622881661440:0@lo:1000:lod0001_rec0000.0 00000040:00080000:3.0:1787780125.455136:0:17999:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:2.0:1787780125.456276:0:17973:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:2.0:1787780125.456370:0:17973:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787780125.463212:0:17973:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1787780125.463802:0:17973:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:00080000:3.0:1787780125.465393:0:17999:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1787780125.465482:0:17999:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1787780125.465487:0:17999:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000040:01000000:2.0:1787780125.465753:0:17973:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:2.0:1787780125.465964:0:17973:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1787780125.466524:0:17973:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x2f:0x0] (8/32) registered 00000001:00000004:3.0:1787780125.469339:0:17973:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:3.0:1787780125.482577:0:17973:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1787780125.482620:0:17973:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffb66b81c73988 00100000:10000000:3.0:1787780125.482630:0:17973:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:3.0:1787780125.483471:0:17973:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787780125.483499:0:17973:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.131@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787780125.483514:0:17973:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1787780125.483544:0:17973:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:3.0:1787780125.484543:0:17973:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787780125.485152:0:17973:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787780126.043990:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787780126.428207:0:17284:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c04411ca0c0 going to sleep for 0 seconds 00000040:00080000:0.0:1787780126.445043:0:17994:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:0.0:1787780126.558307:0:17239:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787780126.558316:0:17239:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c0477821800 from 8 10000000:01000000:0.0:1787780126.558323:0:17239:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787780126.558372:0:17239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c0481373200/0xc8fc0a5179961963 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780126.558384:0:17239:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff9c0481373200/0xc8fc0a5179961963 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780126.558413:0:17239:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff9c0481373200/0xc8fc0a5179961963 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787780126.558437:0:17239:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346cfcf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17239:1874622881661568:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787780126.558516:0:17239:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787780126.558565:0:17239:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0341cb9b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787780126.558629:0:17237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881661568 00000100:00100000:2.0:1787780126.558642:0:17237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881661568 00000100:00100000:2.0:1787780126.558700:0:17237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787780126.558709:0:17237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046f20e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+16:17239:x1874622881661568:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787780126.558721:0:17237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787780126.558734:0:17237:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0444c19000/0xc8fc0a517996196a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc8fc0a5179961963 expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780126.558756:0:17237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0444c19000/0xc8fc0a517996196a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc8fc0a5179961963 expref: 17 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780126.558766:0:17237:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0444c19000/0xc8fc0a517996196a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a5179961963 expref: 17 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780126.558775:0:17237:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0444c19000, rc 0) 00000100:00100000:2.0:1787780126.558857:0:17237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046f20e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+17:17239:x1874622881661568:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780126.558864:0:17237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787780126.558907:0:17239:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346cfcf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17239:1874622881661568:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787780126.558921:0:17239:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff9c0481373200/0xc8fc0a5179961963 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a517996196a expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780126.558929:0:17239:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff9c0481373200/0xc8fc0a5179961963 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc8fc0a517996196a expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787780126.558981:0:17239:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348a09a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17239:1874622881661696:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787780126.559011:0:17239:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787780126.559027:0:17239:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0346be2f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787780126.559053:0:17236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881661696 00000100:00100000:2.0:1787780126.559063:0:17236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881661696 00000100:00100000:2.0:1787780126.559089:0:17236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787780126.559095:0:17236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046f20fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+17:17239:x1874622881661696:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787780126.559110:0:17236:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787780126.559125:0:17236:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787780126.559128:0:17236:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:2.0:1787780126.559216:0:17236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046f20fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+17:17239:x1874622881661696:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 120us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780126.559223:0:17236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787780126.559251:0:17239:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348a09a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17239:1874622881661696:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1787780126.559295:0:17239:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787780126.559302:0:17239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c0481373200/0xc8fc0a5179961963 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a517996196a expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780126.559311:0:17239:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff9c0481373200/0xc8fc0a5179961963 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a517996196a expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787780126.559320:0:17239:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787780126.559322:0:17239:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c0447266000 from 8 10000000:01000000:2.0:1787780126.559325:0:17239:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787780126.559340:0:17239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c0444c18600/0xc8fc0a5179961971 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780126.559347:0:17239:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff9c0444c18600/0xc8fc0a5179961971 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780126.559356:0:17239:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff9c0444c18600/0xc8fc0a5179961971 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787780126.559369:0:17239:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348a09a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17239:1874622881661824:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787780126.559399:0:17239:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787780126.559412:0:17239:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0346be2f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787780126.559423:0:17236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881661824 00000100:00100000:2.0:1787780126.559426:0:17236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881661824 00000100:00100000:2.0:1787780126.559446:0:17236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787780126.559452:0:17236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046f20ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+17:17239:x1874622881661824:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787780126.559458:0:17236:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787780126.559466:0:17236:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0444c18800/0xc8fc0a5179961978 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc8fc0a5179961971 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780126.559480:0:17236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0444c18800/0xc8fc0a5179961978 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc8fc0a5179961971 expref: 18 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780126.559488:0:17236:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0444c18800/0xc8fc0a5179961978 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a5179961971 expref: 18 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780126.559495:0:17236:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0444c18800, rc 0) 00000100:00100000:2.0:1787780126.559521:0:17236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046f20ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+18:17239:x1874622881661824:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 69us (122us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780126.559527:0:17236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787780126.559555:0:17239:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348a09a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17239:1874622881661824:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787780126.559565:0:17239:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff9c0444c18600/0xc8fc0a5179961971 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a5179961978 expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780126.559573:0:17239:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff9c0444c18600/0xc8fc0a5179961971 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc8fc0a5179961978 expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787780126.559610:0:17239:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348a09a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17239:1874622881661952:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787780126.559639:0:17239:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787780126.559652:0:17239:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0346be2f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787780126.559663:0:17236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881661952 00000100:00100000:2.0:1787780126.559666:0:17236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881661952 00000100:00100000:2.0:1787780126.559686:0:17236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787780126.559691:0:17236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0468599450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+18:17239:x1874622881661952:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787780126.559701:0:17236:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787780126.559711:0:17236:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787780126.559714:0:17236:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:2.0:1787780126.559769:0:17236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0468599450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+18:17239:x1874622881661952:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 77us (128us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780126.559776:0:17236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787780126.559816:0:17239:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348a09a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17239:1874622881661952:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1787780126.559862:0:17239:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787780126.559868:0:17239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c0444c18600/0xc8fc0a5179961971 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a5179961978 expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780126.559875:0:17239:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff9c0444c18600/0xc8fc0a5179961971 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a5179961978 expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780127.068021:0:17231:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787780127.452492:0:17994:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787780127.453274:0:17284:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c04411ca0c0 going to sleep for 0 seconds 00010000:00010000:2.0:1787780128.095257:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787780128.477272:0:17284:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c04411ca0c0 going to sleep for 0 seconds 00010000:00010000:3.0:1787780129.116216:0:17231:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787780129.501788:0:17284:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c04411ca0c0 going to sleep for 0 seconds 00000001:02000400:3.0:1787780129.874486:0:18242:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg331-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1787780130.146016:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787780130.523978:0:17284:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c04411ca0c0 going to sleep for 0 seconds 00000100:00080000:3.0:1787780130.588972:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1787780130.588990:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1787780130.588994:0:8:0:(import.c:65:import_set_state_nolock()) ffff9c04811dd800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787780130.589006:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9c04811dd800 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:3.0:1787780130.589040:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c0347dacb40 x1874622881662208/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787780130.589061:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787780130.589065:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787780130.589067:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787780130.589071:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787780130.589101:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787780130.589104:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787780130.589107:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787780130.589109:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787780130.589138:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347dacb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1874622881662208:0@lo:38:kworker.0 00000100:00100000:3.0:1787780130.589201:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780130.589270:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347dafc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881662464:0@lo:400:kworker.0 00000100:00100000:3.0:1787780130.589294:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780130.589313:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787780130.589318:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347dac3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874622881662592:0@lo:400:kworker.0 00000100:00100000:3.0:1787780130.589340:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780130.589371:0:17248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881662208 00000100:00100000:3.0:1787780130.589377:0:17248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881662208 00000100:00100000:3.0:1787780130.589399:0:17248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881662464 00000100:00100000:3.0:1787780130.589408:0:17248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881662464 00000100:00100000:3.0:1787780130.589436:0:17248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787780130.589442:0:17248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347daf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3640:x1874622881662208:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1787780130.589470:0:17248:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 538 last 0 00000020:00000080:3.0:1787780130.589503:0:17248:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc8fc0a517996197f 00000004:00100000:3.0:1787780130.589519:0:17248:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1787780130.589525:0:17248:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:3.0:1787780130.589612:0:17243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881662592 00000100:00100000:3.0:1787780130.589616:0:17243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881662592 00000100:00100000:3.0:1787780130.589645:0:17243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787780130.589652:0:17243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346da5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1874622881662592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787780130.589700:0:17243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346da5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1874622881662592:12345-0@lo:400:kworker.0 Request processed in 48us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780130.589707:0:17243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1787780130.589744:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c0347dac3c0 x1874622881662592/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787780146 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787780130.589757:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347dac3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874622881662592:0@lo:400:kworker.0 00000100:00100000:1.0:1787780130.589874:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347dac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:3641:1874622881662080:0@lo:400:kworker.0 00000100:00100000:1.0:1787780130.589911:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780130.589940:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787780130.589946:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347dae580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874622881662336:0@lo:400:kworker.0 00000100:00100000:1.0:1787780130.589967:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787780130.590085:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348a09a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881662720:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787780130.590111:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780130.590963:0:17236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881662080 00000100:00100000:3.0:1787780130.590969:0:17236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881662080 00000100:00100000:3.0:1787780130.591061:0:17236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787780130.591070:0:17236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046859b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+18:3641:x1874622881662080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787780130.591128:0:17236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046859b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+18:3641:x1874622881662080:12345-0@lo:400:kworker.0 Request processed in 58us (1216us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780130.591135:0:17236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787780130.591209:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347dac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:3641:1874622881662080:0@lo:400:kworker.0 00000100:00100000:3.0:1787780130.591502:0:17242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881662336 00000100:00100000:3.0:1787780130.591506:0:17242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881662336 00000100:00100000:3.0:1787780130.591585:0:17242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787780130.591592:0:17242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03488e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874622881662336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787780130.591637:0:17242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03488e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874622881662336:12345-0@lo:400:kworker.0 Request processed in 46us (1669us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780130.591644:0:17242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1787780130.591700:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c0347dae580 x1874622881662336/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787780146 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787780130.591712:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347dae580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874622881662336:0@lo:400:kworker.0 00000100:00100000:3.0:1787780130.591815:0:17247:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:3.0:1787780130.591823:0:17247:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:3.0:1787780130.592243:0:17247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881662720 00000100:00100000:3.0:1787780130.592248:0:17247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881662720 00000100:00100000:0.0:1787780130.592363:0:18276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787780130.592372:0:18276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347dada40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3643:x1874622881662464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787780130.592456:0:18276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347dada40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3643:x1874622881662464:12345-0@lo:400:kworker.0 Request processed in 85us (3160us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780130.592463:0:18276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787780130.592480:0:18276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787780130.592487:0:18276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0348a08f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881662720:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787780130.592508:0:18276:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1787780130.592707:0:18276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0348a08f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881662720:12345-0@lo:41:osp-pre-0-1.0 Request processed in 220us (2594us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780130.592714:0:18276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787780130.592767:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348a09a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881662720:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787780130.592916:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347dafc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881662464:0@lo:400:kworker.0 00000100:00080000:3.0:1787780130.605433:0:17248:0:(import.c:65:import_set_state_nolock()) ffff9c0448fdf800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787780130.605532:0:17248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347daf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3640:x1874622881662208:12345-0@lo:38:kworker.0 Request processed in 16086us (16328us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780130.605544:0:17248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:0.0:1787780130.605638:0:3640:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1787780130.605647:0:3640:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1787780130.605653:0:3640:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1787780130.605656:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9c04811dd800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:0.0:1787780130.605674:0:3640:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000f7a980c7): req@ffff9c03488e2d00 x1874622881655296/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787780130.605694:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347dacb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1874622881662208:0@lo:38:kworker.0 00000100:00100000:0.0:1787780130.605949:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346da4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881662848:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787780130.605988:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780130.606151:0:17284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780130.606176:0:17284:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c04411ca0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787780130.606231:0:17247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881662848 00000100:00100000:3.0:1787780130.606237:0:17247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881662848 00000100:00100000:3.0:1787780130.606287:0:17247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881655296 00000100:00100000:3.0:1787780130.606291:0:17247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881655296 00000100:00100000:3.0:1787780130.606309:0:17247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787780130.606317:0:17247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346cfd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:3642:x1874622881662848:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787780130.606343:0:17247:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787780130.606384:0:17247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346cfd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:3642:x1874622881662848:12345-0@lo:41:osp-pre-1-0.0 Request processed in 68us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780130.606390:0:17247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787780130.606405:0:17247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787780130.606411:0:17247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03488e0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17284:x1874622881655296:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1787780130.606469:0:17247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03488e0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17284:x1874622881655296:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 57us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780130.606483:0:17247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787780130.606510:0:17284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c03488e2d00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17284:1874622881655296:0@lo:1000:lod0000_rec0001.0 00000040:01000000:3.0:1787780130.606543:0:17284:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1787780130.606576:0:17284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346da6940 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17284:1874622881662976:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1787780130.606605:0:17284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780130.606628:0:17284:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c04786449c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787780130.606654:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346da4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881662848:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787780130.606687:0:17247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881662976 00000100:00100000:3.0:1787780130.606690:0:17247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881662976 00000100:00100000:3.0:1787780130.606705:0:17247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787780130.606711:0:17247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346da6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17284:x1874622881662976:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1787780130.606815:0:17247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346da6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17284:x1874622881662976:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 103us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780130.606820:0:17247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787780130.606872:0:17284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346da6940 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17284:1874622881662976:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1787780130.606935:0:17284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346da6940 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17284:1874622881663104:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1787780130.606958:0:17284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780130.606973:0:17284:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c04786449c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787780130.606984:0:17247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881663104 00000100:00100000:3.0:1787780130.606987:0:17247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881663104 00000100:00100000:3.0:1787780130.607003:0:17247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787780130.607008:0:17247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346da4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17284:x1874622881663104:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1787780130.609864:0:17247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346da4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17284:x1874622881663104:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 2850us (2900us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780130.609895:0:17247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787780130.613894:0:17284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346da6940 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17284:1874622881663104:0@lo:1000:lod0000_rec0001.0 00000040:00080000:0.0:1787780130.613976:0:17284:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787780130.617309:0:17284:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1787780130.617397:0:17284:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 17, retries 0 00000004:00080000:0.0:1787780130.617403:0:17284:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000020:00000004:0.0:1787780130.805481:0:18296:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787780130.806551:0:18296:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787780131.171612:0:17231:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787780131.710831:0:18346:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787780131.711218:0:18346:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787780132.188638:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787780132.619653:0:18394:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc1b02a390 20000000:00000080:1.0:1787780132.619672:0:18394:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9c046f2cb000 uarg=0000000000000000 20000000:01000000:1.0:1787780132.619718:0:18394:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1787780132.619729:0:18394:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1787780132.619733:0:18394:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1787780132.625532:0:18395:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:1.0:1787780132.627065:0:18394:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:1.0:1787780132.637206:0:18394:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787780132.637230:0:18394:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c0347e4b600/0xc8fc0a5179961986 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780132.637249:0:18394:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c0444c19c00/0xc8fc0a517996182f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a5179961828 expref: 17 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780132.637257:0:18394:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c04766dd000/0xc8fc0a5179961932 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a517996192b expref: 17 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780132.637265:0:18394:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c0347e4b600/0xc8fc0a5179961986 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780132.637304:0:18394:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c04766dd000/0xc8fc0a5179961932 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc8fc0a517996192b expref: 17 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780132.637317:0:18394:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c04766dd000/0xc8fc0a5179961932 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc8fc0a517996192b expref: 17 pid: 17236 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787780132.637331:0:18394:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c03488e2940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18394:1874622881663232:0@lo:104: 00000100:00100000:1.0:1787780132.637392:0:18394:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787780132.637446:0:18394:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c0444c19c00/0xc8fc0a517996182f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc8fc0a5179961828 expref: 17 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780132.637454:0:18394:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c0444c19c00/0xc8fc0a517996182f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc8fc0a5179961828 expref: 17 pid: 17237 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787780132.637471:0:18394:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c03488e2d00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18394:1874622881663360:0@lo:104: 00000100:00100000:0.0:1787780132.637479:0:17225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881663232 00000100:00100000:0.0:1787780132.637488:0:17225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881663232 00000100:00100000:1.0:1787780132.637511:0:18394:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787780132.637526:0:17225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881663360 00000100:00100000:1.0:1787780132.637529:0:18394:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c04436230c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787780132.637530:0:17225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881663360 00000100:00100000:0.0:1787780132.637548:0:17225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787780132.637557:0:17225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03488e03c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+4:18394:x1874622881663232:12345-0@lo:104: 00010000:00010000:0.0:1787780132.637580:0:17225:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff9c04766dc800/0xc8fc0a517996192b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc8fc0a5179961932 expref: -99 pid: 17973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780132.638404:0:17225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787780132.638413:0:17225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03488e03c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+4:18394:x1874622881663232:12345-0@lo:104: Request processed in 856us (1020us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780132.638422:0:17225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1787780132.638428:0:17231:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787780132.638442:0:17231:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff9c04766dc800/0xc8fc0a517996192b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc8fc0a5179961932 expref: -99 pid: 17973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787780132.638447:0:17225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1787780132.638456:0:17231:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c04766dc800 already unused, calling callback (ffffffffc139ac20) 00000100:00100000:0.0:1787780132.638460:0:17225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03488e1680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+3:18394:x1874622881663360:12345-0@lo:104: 00010000:00010000:0.0:1787780132.638471:0:17225:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff9c04766dca00/0xc8fc0a5179961828 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc8fc0a517996182f expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787780132.638521:0:17231:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff9c04766dc800/0xc8fc0a517996192b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc8fc0a5179961932 expref: -99 pid: 17973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780132.638521:0:17225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:3.0:1787780132.638531:0:17231:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff9c04766dc800/0xc8fc0a517996192b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc8fc0a5179961932 expref: -99 pid: 17973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787780132.638539:0:17225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03488e1680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+3:18394:x1874622881663360:12345-0@lo:104: Request processed in 79us (1025us total) trans 0 rc 0/0 10000000:00010000:3.0:1787780132.638543:0:17231:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff9c04766dc800/0xc8fc0a517996192b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc8fc0a5179961932 expref: -99 pid: 17973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787780132.638549:0:17225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 10000000:01000000:3.0:1787780132.638556:0:17231:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787780132.638658:0:17230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787780132.638727:0:17231:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff9c04766dc800/0xc8fc0a517996192b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a5179961932 expref: -99 pid: 17973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780132.638735:0:17231:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1787780132.638786:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346da61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:3643:1874622881663488:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787780132.638830:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787780132.638947:0:17228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881663488 00000100:00100000:0.0:1787780132.638953:0:17228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881663488 00010000:00010000:0.0:1787780132.638973:0:17228:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c04766dd000/0xc8fc0a5179961932 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc8fc0a517996192b expref: 18 pid: 17236 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787780132.638997:0:17228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787780132.639003:0:17228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0348a092c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+18:3643:x1874622881663488:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787780132.639014:0:17228:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787780132.639019:0:17228:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c04766dd000/0xc8fc0a5179961932 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc8fc0a517996192b expref: 18 pid: 17236 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780132.639030:0:17228:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c04766dd000/0xc8fc0a5179961932 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc8fc0a517996192b expref: 18 pid: 17236 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780132.639045:0:17228:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787780132.639321:0:18394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c04766dd000/0xc8fc0a5179961932 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc8fc0a517996192b expref: 18 pid: 17236 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787780132.639333:0:18394:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c03488e2940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18394:1874622881663232:0@lo:104: 00000100:00100000:1.0:1787780132.639343:0:18394:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c03488e2d00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18394:1874622881663360:0@lo:104: 00010000:00010000:1.0:1787780132.639364:0:18394:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c0347e4b600/0xc8fc0a5179961986 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780132.640303:0:17231:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff9c04766dc800/0xc8fc0a517996192b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a5179961932 expref: -99 pid: 17973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780132.640315:0:17231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff9c04766dc800/0xc8fc0a517996192b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a5179961932 expref: -99 pid: 17973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780132.640342:0:17231:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787780132.640344:0:17231:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787780132.640346:0:17231:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787780132.643014:0:18397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787780132.643030:0:17230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff9c04766dca00/0xc8fc0a5179961828 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc8fc0a517996182f expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780132.643043:0:17230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c04766dca00 already unused, calling callback (ffffffffc139ac20) 10000000:00010000:1.0:1787780132.643048:0:17230:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff9c04766dca00/0xc8fc0a5179961828 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc8fc0a517996182f expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780132.643060:0:17230:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff9c04766dca00/0xc8fc0a5179961828 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc8fc0a517996182f expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787780132.643068:0:17230:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff9c04766dca00/0xc8fc0a5179961828 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc8fc0a517996182f expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787780132.643074:0:17230:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787780132.643122:0:17230:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff9c04766dca00/0xc8fc0a5179961828 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a517996182f expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780132.643129:0:17230:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787780132.649732:0:17230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff9c04766dca00/0xc8fc0a5179961828 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a517996182f expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780132.649785:0:17230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff9c04766dca00/0xc8fc0a5179961828 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a517996182f expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787780132.649855:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c03488e2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:3644:1874622881663616:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787780132.649936:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780132.650017:0:17227:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1787780132.650026:0:17227:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:1.0:1787780132.650048:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787780132.650050:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787780132.650052:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787780132.650056:0:18397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787780132.650058:0:18397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787780132.650262:0:17228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0348a092c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+17:3643:x1874622881663488:12345-0@lo:103:ldlm_bl.0 Request processed in 11257us (11431us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780132.650273:0:17228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787780132.650372:0:17228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881663616 00000100:00100000:0.0:1787780132.650379:0:17228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881663616 00010000:00010000:0.0:1787780132.650410:0:17228:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c0444c19c00/0xc8fc0a517996182f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc8fc0a5179961828 expref: 17 pid: 17237 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787780132.650446:0:17229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787780132.650455:0:17229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03488e2940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+17:3644:x1874622881663616:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787780132.650468:0:17229:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787780132.650481:0:17229:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c0444c19c00/0xc8fc0a517996182f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc8fc0a5179961828 expref: 17 pid: 17237 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780132.650494:0:17229:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c0444c19c00/0xc8fc0a517996182f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc8fc0a5179961828 expref: 17 pid: 17237 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780132.650510:0:17229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c0444c19c00/0xc8fc0a517996182f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc8fc0a5179961828 expref: 17 pid: 17237 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780132.650524:0:17229:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c0347e4b600/0xc8fc0a5179961986 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780132.650533:0:17229:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0347e4b600/0xc8fc0a5179961986 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780132.650548:0:17229:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c0347e4b600/0xc8fc0a5179961986 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780132.650556:0:17229:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c0347e4b600/0xc8fc0a5179961986 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780132.650563:0:17229:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c0347e4b600/0xc8fc0a5179961986 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780132.650570:0:17229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c0347e4b600/0xc8fc0a5179961986 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780132.650576:0:17229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0347e4b600 already unused, calling callback (ffffffffc0d97420) 00010000:00010000:0.0:1787780132.650580:0:17229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c0347e4b600/0xc8fc0a5179961986 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780132.650589:0:17229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c0347e4b600/0xc8fc0a5179961986 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780132.650609:0:17229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c0347e4b600/0xc8fc0a5179961986 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780132.650619:0:17229:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787780132.650654:0:17229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03488e2940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+16:3644:x1874622881663616:12345-0@lo:103:ldlm_bl.0 Request processed in 200us (717us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780132.650661:0:17229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787780132.650698:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c03488e2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:3644:1874622881663616:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787780132.650794:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346da61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:3643:1874622881663488:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787780132.650797:0:18394:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c0347e4b600/0xc8fc0a5179961986 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780132.650808:0:18394:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c0347e4b600/0xc8fc0a5179961986 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780132.650815:0:18394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c0347e4b600/0xc8fc0a5179961986 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780133.218156:0:17231:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787780134.235956:0:17239:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787780134.235964:0:17239:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c0477821800 from 13 10000000:01000000:2.0:1787780134.235969:0:17239:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787780134.236021:0:17239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c0444c19200/0xc8fc0a517996198d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780134.236033:0:17239:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff9c0444c19200/0xc8fc0a517996198d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780134.236044:0:17239:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff9c0444c19200/0xc8fc0a517996198d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787780134.236068:0:17239:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348a0bc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17239:1874622881663744:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787780134.236137:0:17239:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787780134.236171:0:17239:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0346be2f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787780134.236273:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881663744 00000100:00100000:0.0:1787780134.236280:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881663744 00000100:00100000:0.0:1787780134.236322:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787780134.236330:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046859a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+16:17239:x1874622881663744:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787780134.236342:0:17234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787780134.236355:0:17234:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0481373a00/0xc8fc0a5179961994 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc8fc0a517996198d expref: -99 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780134.236375:0:17234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0481373a00/0xc8fc0a5179961994 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc8fc0a517996198d expref: 17 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780134.236385:0:17234:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0481373a00/0xc8fc0a5179961994 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a517996198d expref: 17 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780134.236394:0:17234:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0481373a00, rc 0) 00000100:00100000:0.0:1787780134.236431:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046859a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+17:17239:x1874622881663744:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 102us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780134.236437:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787780134.236758:0:17239:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348a0bc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17239:1874622881663744:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787780134.236773:0:17239:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff9c0444c19200/0xc8fc0a517996198d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a5179961994 expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780134.236783:0:17239:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff9c0444c19200/0xc8fc0a517996198d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc8fc0a5179961994 expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787780134.236868:0:17239:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346da43c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17239:1874622881663872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787780134.236892:0:17239:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780134.236916:0:17239:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0449c3ac00 going to sleep for 11 seconds 00010000:00010000:1.0:1787780134.236998:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787780134.237070:0:17236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881663872 00000100:00100000:2.0:1787780134.237075:0:17236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881663872 00000100:00100000:2.0:1787780134.237105:0:17236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787780134.237111:0:17236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0468599050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+17:17239:x1874622881663872:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787780134.237210:0:17236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0468599050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+17:17239:x1874622881663872:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 99us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780134.237217:0:17236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787780134.237348:0:17239:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346da43c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17239:1874622881663872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787780134.237392:0:17239:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346da43c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17239:1874622881664000:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787780134.237424:0:17239:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780134.237442:0:17239:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0449c3ac00 going to sleep for 11 seconds 00000100:00100000:1.0:1787780134.237487:0:17237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881664000 00000100:00100000:1.0:1787780134.237491:0:17237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881664000 00000100:00100000:1.0:1787780134.237517:0:17237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787780134.237523:0:17237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0468598850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+17:17239:x1874622881664000:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787780134.237601:0:17237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0468598850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+17:17239:x1874622881664000:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 79us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780134.237613:0:17237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787780134.237793:0:17239:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346da43c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17239:1874622881664000:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787780134.238976:0:18465:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1787780134.239388:0:17239:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1787780134.239411:0:17239:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787780134.239422:0:17239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c0444c19200/0xc8fc0a517996198d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a5179961994 expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780134.239433:0:17239:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff9c0444c19200/0xc8fc0a517996198d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a5179961994 expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787780134.239459:0:17239:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787780134.239462:0:17239:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c0447266000 from 13 10000000:01000000:3.0:1787780134.239466:0:17239:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787780134.239493:0:17239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c04766dc200/0xc8fc0a517996199b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780134.239502:0:17239:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff9c04766dc200/0xc8fc0a517996199b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780134.239512:0:17239:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff9c04766dc200/0xc8fc0a517996199b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787780134.239531:0:17239:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346da43c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17239:1874622881664128:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787780134.239982:0:17239:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780134.240132:0:17239:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c04411ca0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787780134.240277:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881664128 00000100:00100000:0.0:1787780134.240291:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881664128 00000100:00100000:0.0:1787780134.240383:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787780134.240391:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046859a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+17:17239:x1874622881664128:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787780134.240404:0:17234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787780134.240417:0:17234:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0481373e00/0xc8fc0a51799619a2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc8fc0a517996199b expref: -99 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780134.240438:0:17234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0481373e00/0xc8fc0a51799619a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc8fc0a517996199b expref: 18 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780134.240449:0:17234:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0481373e00/0xc8fc0a51799619a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a517996199b expref: 18 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780134.240457:0:17234:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0481373e00, rc 0) 00000100:00100000:0.0:1787780134.240504:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046859a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+18:17239:x1874622881664128:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780134.240511:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787780134.240592:0:17239:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346da43c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17239:1874622881664128:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787780134.240607:0:17239:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff9c04766dc200/0xc8fc0a517996199b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a51799619a2 expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780134.240616:0:17239:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff9c04766dc200/0xc8fc0a517996199b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc8fc0a51799619a2 expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787780134.240671:0:17239:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346da43c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17239:1874622881664256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787780134.240695:0:17239:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780134.240917:0:17239:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c04411ca0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787780134.241022:0:17237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881664256 00000100:00100000:1.0:1787780134.241026:0:17237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881664256 00000100:00100000:1.0:1787780134.241050:0:17237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787780134.241057:0:17237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0468598450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+18:17239:x1874622881664256:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787780134.241169:0:17237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0468598450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+18:17239:x1874622881664256:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 112us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780134.241176:0:17237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787780134.241348:0:17239:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346da43c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17239:1874622881664256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787780134.241377:0:17239:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346da43c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17239:1874622881664384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787780134.241426:0:17239:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780134.241452:0:17239:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c04411ca0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787780134.241625:0:17237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881664384 00000100:00100000:1.0:1787780134.241630:0:17237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881664384 00000100:00100000:1.0:1787780134.241648:0:17237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787780134.241653:0:17237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0468598050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+18:17239:x1874622881664384:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787780134.241729:0:17237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0468598050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+18:17239:x1874622881664384:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 75us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780134.241736:0:17237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787780134.241829:0:17239:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346da43c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17239:1874622881664384:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787780134.243031:0:18466:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1787780134.243249:0:17239:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1787780134.243271:0:17239:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787780134.243282:0:17239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c04766dc200/0xc8fc0a517996199b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a51799619a2 expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780134.243292:0:17239:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff9c04766dc200/0xc8fc0a517996199b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a51799619a2 expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780135.260065:0:18397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787780135.581195:0:17278:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787780135.708054:0:3640:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787780125/real 1787780125] req@ffff9c0347dacf00 x1874622881658496/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787780135 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787780135.708084:0:3640:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c0347dacf00 x1874622881658496/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787780135 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787780135.708094:0:3640:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787780125/real 1787780125] req@ffff9c0346cfcb40 x1874622881658240/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787780135 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787780135.708105:0:3640:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c0346cfcb40 x1874622881658240/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787780135 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787780135.708122:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9c0446172800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787780135.708131:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787780135.708135:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347dacf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1874622881658496:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1787780135.708140:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9c0345e54800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787780135.708144:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787780135.708147:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346cfcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1874622881658240:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1787780135.708176:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787780135.708187:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346da4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881664512:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787780135.708246:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787780135.708398:0:2253:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787780135.708402:0:2253:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787780135.708412:0:2253:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787780135.708415:0:2253:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787780135.708444:0:2253:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787780135.708447:0:2253:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1787780135.708450:0:2253:0:(import.c:65:import_set_state_nolock()) ffff9c0345e54800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787780135.708455:0:2253:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 533 00000100:00080000:1.0:1787780135.708460:0:2253:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787780135.708465:0:2253:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9c0345e54800 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:1.0:1787780135.708484:0:2253:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c03488e30c0 x1874622881665024/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787780135.708498:0:2253:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787780135.708501:0:2253:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787780135.708503:0:2253:0:(import.c:65:import_set_state_nolock()) ffff9c0446172800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787780135.708506:0:2253:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 533 00000100:00080000:1.0:1787780135.708509:0:2253:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787780135.708512:0:2253:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9c0446172800 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:1.0:1787780135.708522:0:2253:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c03488e1e00 x1874622881665152/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787780135.708555:0:17248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881664512 00000100:00100000:1.0:1787780135.708561:0:17248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881664512 00000100:00100000:1.0:1787780135.708609:0:17248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787780135.708618:0:17248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346da4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3642:x1874622881664512:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787780135.708651:0:17248:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787780135.708695:0:17248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346da4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3642:x1874622881664512:12345-0@lo:41:osp-pre-1-0.0 Request processed in 78us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780135.708708:0:17248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787780135.708747:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c03488e1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881664896:0@lo:400:kworker.0 00000100:00100000:1.0:1787780135.708776:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780135.708795:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787780135.708801:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c03488e2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874622881664768:0@lo:400:kworker.0 00000100:00100000:1.0:1787780135.708827:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780135.708897:0:17247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881664896 00000100:00100000:1.0:1787780135.708900:0:17247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881664896 00000100:00100000:1.0:1787780135.708920:0:17247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787780135.708926:0:17247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03488e2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881664896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787780135.708958:0:17247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03488e2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881664896:12345-0@lo:400:kworker.0 Request processed in 32us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780135.708965:0:17247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787780135.709061:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c03488e21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:3642:1874622881664640:0@lo:400:kworker.0 00000100:00100000:3.0:1787780135.709101:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780135.709142:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346da4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881664512:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787780135.709157:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787780135.709162:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c03488e0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1874622881665280:0@lo:400:kworker.0 00000100:00100000:3.0:1787780135.709184:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780135.709211:0:17243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881664768 00000100:00100000:3.0:1787780135.709215:0:17243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881664768 00000100:00100000:3.0:1787780135.709242:0:17243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881665280 00000100:00100000:3.0:1787780135.709245:0:17243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881665280 00000100:00100000:3.0:1787780135.709258:0:17243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787780135.709264:0:17243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c047785c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874622881664768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787780135.709295:0:17243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c047785c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874622881664768:12345-0@lo:400:kworker.0 Request processed in 30us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780135.709301:0:17243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787780135.709313:0:17243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787780135.709319:0:17243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346da4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1874622881665280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787780135.709348:0:17243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346da4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1874622881665280:12345-0@lo:400:kworker.0 Request processed in 29us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780135.709353:0:17243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1787780135.709380:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c03488e0f00 x1874622881665280/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787780151 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787780135.709390:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c03488e0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1874622881665280:0@lo:400:kworker.0 00000100:00100000:2.0:1787780135.709632:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787780135.709642:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348a0ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881665408:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787780135.709673:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787780135.709874:0:18276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881665408 00000100:00100000:0.0:1787780135.709879:0:18276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881665408 00000100:00100000:0.0:1787780135.709903:0:18276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787780135.709910:0:18276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0348a0bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881665408:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787780135.709930:0:18276:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1787780135.710359:0:17237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881664640 00000100:00100000:1.0:1787780135.710365:0:17237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881664640 00000100:00100000:1.0:1787780135.710400:0:17237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787780135.710407:0:17237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0468599850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+18:3642:x1874622881664640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787780135.710443:0:17237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0468599850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+18:3642:x1874622881664640:12345-0@lo:400:kworker.0 Request processed in 37us (1341us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780135.710449:0:17237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:1.0:1787780135.710492:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c03488e2580 x1874622881664768/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787780151 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787780135.710502:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c03488e2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874622881664768:0@lo:400:kworker.0 00000100:00100000:1.0:1787780135.710513:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c03488e1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881664896:0@lo:400:kworker.0 00000100:00100000:1.0:1787780135.710535:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c03488e30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1874622881665024:0@lo:8:kworker.0 00000400:00000100:1.0:1787780135.710568:0:3640:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874622881665024 offset 0 length 520: 4 00000100:00100000:1.0:1787780135.710582:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c03488e1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1874622881665152:0@lo:8:kworker.0 00000400:00000100:1.0:1787780135.710598:0:3640:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874622881665152 offset 0 length 520: 4 00000100:00100000:0.0:1787780135.710775:0:18276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0348a0bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881665408:12345-0@lo:41:osp-pre-0-1.0 Request processed in 864us (1100us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780135.710784:0:18276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787780135.712876:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c03488e21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:3642:1874622881664640:0@lo:400:kworker.0 00000001:00100000:1.0:1787780135.714619:0:17974:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1787780135.715796:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348a0ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881665408:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787780136.285334:0:17231:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787780137.308426:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787780137.692456:0:17994:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787780138.332416:0:18397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787780138.547289:0:18744:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1787780138.547300:0:18744:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:0.0:1787780138.547301:0:18744:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1787780138.547412:0:18744:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9c0446175800 00000020:01000004:0.0:1787780138.547427:0:18744:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1787780138.547440:0:18744:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1787780138.547453:0:18744:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9c045156b370) 00000020:00000080:0.0:1787780138.547470:0:18744:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1787780138.602388:0:18744:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1787780138.611058:0:18744:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1787780138.611387:0:18744:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1787780138.611867:0:18744:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1787780138.613128:0:18744:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1787780138.613588:0:18744:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1787780138.613903:0:18744:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:01000000:3.0:1787780138.614801:0:18744:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1787780138.615173:0:18744:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1787780138.615185:0:18744:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787780138.615195:0:18744:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xc8fc0a51799619b0 00000020:01000004:3.0:1787780138.615200:0:18744:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:3.0:1787780138.615218:0:18744:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.131@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1787780138.615222:0:18744:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.131@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1787780138.615227:0:18744:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1787780138.615231:0:18744:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1787780138.615240:0:18744:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9c0476624d28) 00000020:00000080:3.0:1787780138.615250:0:18744:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:3.0:1787780138.616951:0:18744:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787780138.617261:0:18744:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1787780138.617267:0:18744:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1787780138.618411:0:18744:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1787780138.618421:0:18744:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1787780138.618752:0:18744:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1787780138.618767:0:18744:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1787780138.628754:0:18744:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787780138.632420:0:18744:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1787780138.632429:0:18744:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1787780138.634705:0:18744:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1787780138.634726:0:18744:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1787780138.665579:0:18744:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787780138.665831:0:18744:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1787780138.665862:0:18744:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1787780138.667994:0:18744:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1787780138.668006:0:18744:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1787780138.673088:0:18744:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1787780138.673104:0:18744:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1787780138.675367:0:18744:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787780138.675570:0:18744:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1787780138.675576:0:18744:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1787780138.678116:0:18744:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1787780138.678262:0:18744:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1787780138.713896:0:18744:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787780138.714086:0:18744:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1787780138.714092:0:18744:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1787780138.723245:0:18744:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1787780138.723278:0:18744:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1787780138.723882:0:18744:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1787780138.723908:0:18744:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:0.0:1787780138.723914:0:18744:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.131@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1787780138.762598:0:18744:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.131@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787780138.762654:0:18744:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.131@tcp, index=0000, flags=0x20002 00000020:01000004:3.0:1787780138.762659:0:18744:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787780138.762660:0:18744:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787780138.762661:0:18744:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787780138.762663:0:18744:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787780138.762664:0:18744:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787780138.762665:0:18744:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787780138.762667:0:18744:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787780138.762668:0:18744:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787780138.762669:0:18744:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787780138.762673:0:18744:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:3.0:1787780138.762675:0:18744:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787780138.762677:0:18744:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787780138.762678:0:18744:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787780138.762684:0:18744:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787780138.762685:0:18744:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787780138.762686:0:18744:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787780138.762687:0:18744:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787780138.762687:0:18744:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787780138.762688:0:18744:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787780138.762722:0:18744:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1787780138.762742:0:18744:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346da6d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:18744:1874622881665536:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787780138.762810:0:18744:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780138.762886:0:18744:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c04500bf180 going to sleep for 11 seconds 00000100:00100000:2.0:1787780138.763050:0:17236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881665536 00000100:00100000:2.0:1787780138.763056:0:17236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881665536 00000100:00100000:2.0:1787780138.763126:0:17236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787780138.763135:0:17236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c044502e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+18:18744:x1874622881665536:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787780138.763172:0:17236:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1787780138.763175:0:17236:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:2.0:1787780138.763178:0:17236:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1787780138.763887:0:17236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c044502e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+18:18744:x1874622881665536:12345-0@lo:253:mount.lustre.0 Request processed in 751us (1075us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780138.763896:0:17236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787780138.764350:0:18744:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346da6d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:18744:1874622881665536:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787780138.764362:0:18744:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1787780138.764365:0:18744:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787780138.764366:0:18744:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787780138.764368:0:18744:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787780138.764369:0:18744:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787780138.764370:0:18744:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787780138.764372:0:18744:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787780138.764373:0:18744:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787780138.764375:0:18744:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787780138.764376:0:18744:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787780138.764395:0:18744:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9c0446175800 from lustre-OST0000 10000000:01000000:3.0:1787780138.764422:0:18744:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1787780138.764425:0:18744:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1787780138.764434:0:18744:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9c04431399b8 local copy 00010000:00010000:3.0:1787780138.764444:0:18744:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c04766dde00/0xc8fc0a517996176b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a5179961772 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787780138.764547:0:18744:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346da6d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:18744:1874622881665664:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787780138.764586:0:18744:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780138.764734:0:18744:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c04500bf6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787780138.764774:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881665664 00000100:00100000:1.0:1787780138.764779:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881665664 00000100:00100000:1.0:1787780138.764994:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787780138.765006:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c044502f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+18:18744:x1874622881665664:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787780138.765081:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c044502f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+18:18744:x1874622881665664:12345-0@lo:501:mount.lustre.0 Request processed in 78us (495us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787780138.765089:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787780138.765223:0:18744:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346da6d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:18744:1874622881665664:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1787780138.765236:0:18744:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.131@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1787780138.765262:0:18744:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.131@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1787780138.765268:0:18744:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c04766dde00/0xc8fc0a517996176b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a5179961772 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780138.765282:0:18744:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff9c04766dde00/0xc8fc0a517996176b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a5179961772 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787780138.765306:0:18744:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9c0446175800 10000000:01000000:3.0:1787780138.765311:0:18744:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787780138.765316:0:18744:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1787780138.765319:0:18744:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787780138.765324:0:18744:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1787780138.765327:0:18744:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1787780138.765347:0:18744:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c04766dc800/0xc8fc0a51799619be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780138.765355:0:18744:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff9c04766dc800/0xc8fc0a51799619be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780138.765364:0:18744:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff9c04766dc800/0xc8fc0a51799619be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787780138.765377:0:18744:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346da6d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:18744:1874622881665792:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787780138.765403:0:18744:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780138.765743:0:18744:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c04500bf6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787780138.765865:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881665792 00000100:00100000:1.0:1787780138.765870:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881665792 00000100:00100000:1.0:1787780138.766066:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787780138.766073:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c044502c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+18:18744:x1874622881665792:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787780138.766082:0:17234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787780138.766444:0:17234:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0347e4be00/0xc8fc0a51799619c5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xc8fc0a51799619be expref: -99 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780138.766471:0:17234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0347e4be00/0xc8fc0a51799619c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc8fc0a51799619be expref: 19 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780138.766482:0:17234:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0347e4be00/0xc8fc0a51799619c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a51799619be expref: 19 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780138.766490:0:17234:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0347e4be00, rc 0) 00000100:00100000:1.0:1787780138.766649:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c044502c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+19:18744:x1874622881665792:12345-0@lo:101:mount.lustre.0 Request processed in 575us (1244us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780138.766664:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787780138.767273:0:18744:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346da6d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:18744:1874622881665792:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787780138.767291:0:18744:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff9c04766dc800/0xc8fc0a51799619be lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a51799619c5 expref: -99 pid: 18744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780138.767301:0:18744:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff9c04766dc800/0xc8fc0a51799619be lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xc8fc0a51799619c5 expref: -99 pid: 18744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787780138.768387:0:18744:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1787780138.769093:0:18744:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787780138.773927:0:18744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1787780138.774079:0:18744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1787780138.774094:0:18744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1787780138.774116:0:18744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1787780138.774128:0:18744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1787780138.774139:0:18744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1787780138.774162:0:18744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1787780138.774168:0:18744:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1787780138.774270:0:18744:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346da52c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:18744:1874622881665920:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787780138.774334:0:18744:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780138.774433:0:18744:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c04778dc480 going to sleep for 11 seconds 00000100:00100000:1.0:1787780138.779982:0:3640:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787780123/real 1787780123] req@ffff9c0348a0b840 x1874622881656448/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787780138 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787780138.780016:0:3640:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c0348a0b840 x1874622881656448/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787780138 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787780138.780027:0:3640:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787780123/real 1787780123] req@ffff9c0348a08780 x1874622881656576/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787780138 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787780138.780038:0:3640:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c0348a08780 x1874622881656576/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787780138 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787780138.780057:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9c047787a000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787780138.780082:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787780138.780087:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348a0b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1874622881656448:0@lo:8:kworker.0 00000100:00080000:1.0:1787780138.780092:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9c044963b000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787780138.780097:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787780138.780109:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348a08780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1874622881656576:0@lo:8:kworker.0 00000100:00080000:2.0:1787780138.781443:0:2253:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787780138.781448:0:2253:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1787780138.781452:0:2253:0:(import.c:65:import_set_state_nolock()) ffff9c047787a000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787780138.781458:0:2253:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 531 00000100:00080000:2.0:1787780138.781463:0:2253:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1787780138.781469:0:2253:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9c047787a000 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:2.0:1787780138.781490:0:2253:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c0348a09680 x1874622881666176/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787780138.781503:0:2253:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787780138.781506:0:2253:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787780138.781508:0:2253:0:(import.c:65:import_set_state_nolock()) ffff9c044963b000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787780138.781511:0:2253:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 531 00000100:00080000:2.0:1787780138.781513:0:2253:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1787780138.781516:0:2253:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9c044963b000 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:2.0:1787780138.781524:0:2253:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c0348a08b40 x1874622881666304/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787780138.781549:0:2253:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787780138.781553:0:2253:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787780138.781556:0:2253:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787780138.781558:0:2253:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787780138.781584:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348a083c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881666560:0@lo:400:kworker.0 00000100:00100000:2.0:1787780138.781651:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787780138.781692:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787780138.781698:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348a08780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874622881666688:0@lo:400:kworker.0 00000100:00100000:2.0:1787780138.781737:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780138.781862:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348a0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881666048:0@lo:400:kworker.0 00000100:00100000:3.0:1787780138.781896:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780138.781916:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787780138.781921:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348a09e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1874622881666432:0@lo:400:kworker.0 00000100:00100000:3.0:1787780138.781938:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780138.781973:0:17243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881666688 00000100:00100000:3.0:1787780138.781979:0:17243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881666688 00000100:00100000:3.0:1787780138.782014:0:17243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881666432 00000100:00100000:3.0:1787780138.782016:0:17243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881666432 00000100:00100000:3.0:1787780138.782028:0:17243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787780138.782034:0:17243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0348a0ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874622881666688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787780138.782086:0:17243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0348a0ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874622881666688:12345-0@lo:400:kworker.0 Request processed in 51us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780138.782092:0:17243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787780138.782255:0:17243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787780138.782262:0:17243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346da5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1874622881666432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787780138.782306:0:17243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346da5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1874622881666432:12345-0@lo:400:kworker.0 Request processed in 45us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780138.782312:0:17243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1787780138.782343:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c0348a09e00 x1874622881666432/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787780154 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787780138.782363:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348a09e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1874622881666432:0@lo:400:kworker.0 00010000:00080000:3.0:1787780138.782390:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c0348a08780 x1874622881666688/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787780154 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787780138.782397:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348a08780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874622881666688:0@lo:400:kworker.0 00000100:00100000:2.0:1787780138.782606:0:17248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881666560 00000100:00100000:2.0:1787780138.782611:0:17248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881666560 00000100:00100000:2.0:1787780138.782705:0:17248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881666048 00000100:00100000:2.0:1787780138.782709:0:17248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881666048 00000100:00100000:2.0:1787780138.782733:0:17248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787780138.782739:0:17248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0348a0b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881666560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787780138.782776:0:17248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0348a0b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881666560:12345-0@lo:400:kworker.0 Request processed in 37us (1125us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780138.782782:0:17248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787780138.782794:0:17248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787780138.782800:0:17248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346da70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881666048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787780138.782829:0:17248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346da70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881666048:12345-0@lo:400:kworker.0 Request processed in 30us (932us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780138.782835:0:17248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787780138.783072:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348a09680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1874622881666176:0@lo:8:kworker.0 00000100:00100000:1.0:1787780138.783234:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780138.783272:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348a08b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1874622881666304:0@lo:8:kworker.0 00000100:00100000:1.0:1787780138.783294:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787780138.783725:0:18748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881666176 00000100:00100000:2.0:1787780138.783731:0:18748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881666176 00000100:00100000:2.0:1787780138.783759:0:18748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881666304 00000100:00100000:2.0:1787780138.783762:0:18748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881666304 00000100:00100000:2.0:1787780138.783773:0:18748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787780138.783780:0:18748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c047785cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3640:x1874622881666176:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1787780138.783799:0:18748:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787780138.784056:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348a0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881666048:0@lo:400:kworker.0 00000100:00100000:3.0:1787780138.785281:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348a083c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881666560:0@lo:400:kworker.0 00000100:00100000:0.0:1787780138.786186:0:17236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881665920 00000100:00100000:0.0:1787780138.786196:0:17236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881665920 00000100:00100000:1.0:1787780138.786440:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787780138.786450:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c044502f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+19:18744:x1874622881665920:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787780138.786636:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c044502f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+19:18744:x1874622881665920:12345-0@lo:501:mount.lustre.0 Request processed in 187us (12301us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780138.786654:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787780138.787291:0:18744:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346da52c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:18744:1874622881665920:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787780138.787334:0:18744:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346da52c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:18744:1874622881666816:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787780138.787382:0:18744:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780138.787404:0:18744:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c04778dc480 going to sleep for 11 seconds 00000100:00100000:0.0:1787780138.787457:0:17237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881666816 00000100:00100000:0.0:1787780138.787462:0:17237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881666816 00000100:00100000:0.0:1787780138.787495:0:17237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787780138.787502:0:17237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c044502d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+19:18744:x1874622881666816:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787780138.788438:0:17237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c044502d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+19:18744:x1874622881666816:12345-0@lo:503:mount.lustre.0 Request processed in 934us (1053us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780138.788457:0:17237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787780138.789054:0:18744:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346da52c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:18744:1874622881666816:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787780138.790859:0:18744:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787780138.791793:0:18744:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346da52c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:18744:1874622881666944:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787780138.792753:0:18744:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780138.792804:0:18744:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c047782bc00 going to sleep for 11 seconds 00000100:00100000:1.0:1787780138.794437:0:17236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881666944 00000100:00100000:1.0:1787780138.794450:0:17236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881666944 00000100:00100000:1.0:1787780138.794510:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787780138.794519:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c044502d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+19:18744:x1874622881666944:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787780138.795051:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c044502d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+19:18744:x1874622881666944:12345-0@lo:502:mount.lustre.0 Request processed in 532us (2298us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780138.795060:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787780138.795788:0:18744:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346da52c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:18744:1874622881666944:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787780138.797596:0:18744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1787780138.797646:0:18744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1787780138.797660:0:18744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1787780138.797673:0:18744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1787780138.798115:0:18744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1787780138.798135:0:18744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1787780138.798160:0:18744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1787780138.798175:0:18744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1787780138.798189:0:18744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:3.0:1787780138.798202:0:18744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:3.0:1787780138.798215:0:18744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:3.0:1787780138.798228:0:18744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:3.0:1787780138.798278:0:18744:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346da52c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:18744:1874622881667072:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787780138.798347:0:18744:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780138.798432:0:18744:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c047782bc00 going to sleep for 11 seconds 00000100:00100000:0.0:1787780138.799346:0:17237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881667072 00000100:00100000:0.0:1787780138.799354:0:17237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881667072 00000100:00100000:0.0:1787780138.799515:0:17237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787780138.799526:0:17237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c044502e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+19:18744:x1874622881667072:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787780138.799731:0:17237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c044502e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+19:18744:x1874622881667072:12345-0@lo:502:mount.lustre.0 Request processed in 207us (1384us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780138.799739:0:17237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787780138.799828:0:18744:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346da52c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:18744:1874622881667072:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787780138.799908:0:18744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:3.0:1787780138.799921:0:18744:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:3.0:1787780138.803157:0:18761:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787780138.803169:0:18761:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:3.0:1787780138.803175:0:18761:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787780138.803178:0:18761:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1787780138.803184:0:18761:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787780138.803202:0:18761:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9c0476623370) 00000020:00000080:3.0:1787780138.803229:0:18761:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:3.0:1787780138.803236:0:18761:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787780138.803337:0:18761:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c0446175800 from lustre-OST0000, refs=2 00080000:01000000:3.0:1787780138.803346:0:18761:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787780138.803353:0:18761:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xc8fc0a51799619d3 00010000:00010000:3.0:1787780138.817651:0:18761:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:0.0:1787780138.822758:0:18761:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967311 00000100:00100000:3.0:1787780138.824307:0:18748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c047785cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3640:x1874622881666176:12345-0@lo:8:kworker.0 Request processed in 40520us (41066us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787780138.824326:0:18748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787780138.824368:0:18748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787780138.824375:0:18748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c047785e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3640:x1874622881666304:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1787780138.824395:0:18748:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787780138.824454:0:18748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c047785e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3640:x1874622881666304:12345-0@lo:8:kworker.0 Request processed in 77us (41158us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787780138.824461:0:18748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00080000:10000000:0.0:1787780138.825667:0:18761:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0xa:0x0] (8/32) registered 00000100:00080000:2.0:1787780138.826766:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9c047787a000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787780138.826775:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787780138.826779:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348a09680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1874622881666176:0@lo:8:kworker.0 00000100:00080000:2.0:1787780138.826800:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9c044963b000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787780138.826803:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787780138.826805:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348a08b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1874622881666304:0@lo:8:kworker.0 00000020:00000080:1.0:1787780138.827530:0:18761:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1787780138.827542:0:18761:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787780138.827605:0:18761:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787780138.827608:0:18761:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1787780138.827611:0:18761:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787780138.827615:0:18761:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:1.0:1787780138.827616:0:18761:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787780138.827618:0:18761:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787780138.827619:0:18761:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787780138.827622:0:18761:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787780138.827624:0:18761:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787780138.827626:0:18761:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787780138.827629:0:18761:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787780138.827631:0:18761:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787780138.827634:0:18761:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787780138.827635:0:18761:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787780138.827638:0:18761:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787780138.827640:0:18761:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787780138.827641:0:18761:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:1.0:1787780138.827644:0:18761:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787780138.827646:0:18761:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787780138.827647:0:18761:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787780138.827650:0:18761:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1787780138.827684:0:18761:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787780138.827687:0:18761:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787780138.827688:0:18761:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787780138.827691:0:18761:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:3.0:1787780138.830146:0:18744:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1787780138.830186:0:18744:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1787780138.830217:0:18744:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c04766dc800/0xc8fc0a51799619be lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a51799619c5 expref: -99 pid: 18744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780138.830231:0:18744:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff9c04766dc800/0xc8fc0a51799619be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a51799619c5 expref: -99 pid: 18744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787780138.830239:0:18744:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c0446175800 from 1 10000000:01000000:3.0:1787780138.830243:0:18744:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787780138.830276:0:18744:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c04766dcc00/0xc8fc0a51799619da lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780138.830285:0:18744:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff9c04766dcc00/0xc8fc0a51799619da lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780138.830294:0:18744:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff9c04766dcc00/0xc8fc0a51799619da lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787780138.830319:0:18744:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346da52c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:18744:1874622881667200:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787780138.830450:0:18744:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780138.830492:0:18744:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c047782b480 going to sleep for 11 seconds 00000100:00100000:0.0:1787780138.830555:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881667200 00000100:00100000:0.0:1787780138.830562:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881667200 00000100:00100000:0.0:1787780138.830608:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787780138.830617:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0478633850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+19:18744:x1874622881667200:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787780138.830629:0:17234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787780138.830640:0:17234:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0481373400/0xc8fc0a51799619e1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc8fc0a51799619da expref: -99 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780138.830661:0:17234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0481373400/0xc8fc0a51799619e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc8fc0a51799619da expref: 20 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780138.830672:0:17234:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0481373400/0xc8fc0a51799619e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a51799619da expref: 20 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780138.830679:0:17234:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0481373400, rc 0) 00000100:00100000:0.0:1787780138.830749:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0478633850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+20:18744:x1874622881667200:12345-0@lo:101:mount.lustre.0 Request processed in 133us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780138.830768:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787780138.830938:0:18744:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346da52c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:18744:1874622881667200:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787780138.830967:0:18744:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff9c04766dcc00/0xc8fc0a51799619da lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a51799619e1 expref: -99 pid: 18744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780138.830979:0:18744:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff9c04766dcc00/0xc8fc0a51799619da lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc8fc0a51799619e1 expref: -99 pid: 18744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787780138.832057:0:18744:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1787780138.832874:0:18744:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787780138.833291:0:18744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1787780138.833320:0:18744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1787780138.833341:0:18744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1787780138.833347:0:18744:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1787780138.833426:0:18744:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348a08b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:18744:1874622881667328:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787780138.833488:0:18744:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787780138.833536:0:18744:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c04451b6900 going to sleep for 11 seconds 00000100:00100000:0.0:1787780138.833594:0:17237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881667328 00000100:00100000:0.0:1787780138.833601:0:17237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881667328 00000100:00100000:0.0:1787780138.833650:0:17237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787780138.833659:0:17237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0478632c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+20:18744:x1874622881667328:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787780138.833788:0:17237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0478632c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+20:18744:x1874622881667328:12345-0@lo:501:mount.lustre.0 Request processed in 129us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780138.833796:0:17237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787780138.833895:0:18744:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348a08b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:18744:1874622881667328:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787780138.833927:0:18744:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346da7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:18744:1874622881667456:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787780138.833966:0:18744:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780138.833995:0:18744:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c047782b600 going to sleep for 11 seconds 00000100:00100000:0.0:1787780138.834154:0:17236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881667456 00000100:00100000:0.0:1787780138.834158:0:17236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881667456 00000100:00100000:0.0:1787780138.834182:0:17237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787780138.834188:0:17237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0478633c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+20:18744:x1874622881667456:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787780138.834266:0:17237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0478633c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+20:18744:x1874622881667456:12345-0@lo:503:mount.lustre.0 Request processed in 77us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780138.834273:0:17237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787780138.834343:0:18744:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346da7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:18744:1874622881667456:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787780138.834668:0:18744:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787780138.834754:0:18744:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346da7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:18744:1874622881667584:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787780138.834798:0:18744:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780138.834822:0:18744:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c047782b600 going to sleep for 11 seconds 00000100:00100000:2.0:1787780138.834891:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881667584 00000100:00100000:2.0:1787780138.834896:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881667584 00000100:00100000:2.0:1787780138.834933:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787780138.834941:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0478632850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+20:18744:x1874622881667584:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787780138.835029:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0478632850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+20:18744:x1874622881667584:12345-0@lo:502:mount.lustre.0 Request processed in 89us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780138.835036:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787780138.835068:0:18744:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346da7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:18744:1874622881667584:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787780138.835215:0:18744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1787780138.835250:0:18744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1787780138.835265:0:18744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1787780138.835277:0:18744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1787780138.835290:0:18744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1787780138.835303:0:18744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1787780138.835315:0:18744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1787780138.835327:0:18744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:3.0:1787780138.835339:0:18744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1787780138.835487:0:18744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:3.0:1787780138.835512:0:18744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:3.0:1787780138.835533:0:18744:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346da7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:18744:1874622881667712:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787780138.835567:0:18744:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780138.835626:0:18744:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c047782b600 going to sleep for 11 seconds 00000100:00100000:0.0:1787780138.838010:0:17236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881667712 00000100:00100000:0.0:1787780138.838023:0:17236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881667712 00000100:00100000:1.0:1787780138.838125:0:17236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787780138.838135:0:17236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0478633450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+20:18744:x1874622881667712:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787780138.838289:0:17236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0478633450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+20:18744:x1874622881667712:12345-0@lo:502:mount.lustre.0 Request processed in 155us (2721us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780138.838297:0:17236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787780138.839380:0:18744:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346da7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:18744:1874622881667712:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787780138.839477:0:18744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:2.0:1787780138.839490:0:18744:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1787780138.843572:0:18765:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787780138.843587:0:18765:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787780138.843590:0:18765:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787780138.843608:0:18765:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c0446175800 00000020:00000080:1.0:1787780138.843611:0:18765:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787780138.843618:0:18765:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787780138.843621:0:18765:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787780138.843623:0:18765:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1787780138.843627:0:18765:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787780138.843629:0:18765:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787780138.843631:0:18765:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787780138.843634:0:18765:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c0446175800 00000020:00000080:1.0:1787780138.843636:0:18765:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787780138.843692:0:18765:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787780138.843696:0:18765:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787780138.843698:0:18765:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1787780138.843702:0:18765:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787780138.843705:0:18765:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787780138.843707:0:18765:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787780138.843711:0:18765:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c0446175800 00000020:00000080:1.0:1787780138.843723:0:18765:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787780138.843746:0:18765:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787780138.843749:0:18765:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787780138.843756:0:18765:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787780138.843762:0:18765:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787780138.843765:0:18765:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787780138.843767:0:18765:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1787780138.843772:0:18765:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c0446175800 00000020:00000080:1.0:1787780138.843775:0:18765:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787780138.843803:0:18765:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787780138.843806:0:18765:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787780138.843808:0:18765:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1787780138.843812:0:18765:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:2.0:1787780138.845947:0:18744:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1787780138.846052:0:18744:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787780138.846070:0:18744:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c04766dcc00/0xc8fc0a51799619da lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a51799619e1 expref: -99 pid: 18744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780138.846084:0:18744:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff9c04766dcc00/0xc8fc0a51799619da lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a51799619e1 expref: -99 pid: 18744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787780138.846151:0:18744:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787780138.846155:0:18744:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9c0446175800 10000000:01000000:2.0:1787780138.846158:0:18744:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9c0446175800 10000000:01000000:2.0:1787780138.846163:0:18744:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787780138.846168:0:18744:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c0446175800 from 1 10000000:01000000:2.0:1787780138.846171:0:18744:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787780138.846202:0:18744:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c0444c19c00/0xc8fc0a51799619e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780138.846210:0:18744:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff9c0444c19c00/0xc8fc0a51799619e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780138.846221:0:18744:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff9c0444c19c00/0xc8fc0a51799619e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787780138.846245:0:18744:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348a09680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:18744:1874622881667840:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787780138.846304:0:18744:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787780138.846337:0:18744:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0444f62480 going to sleep for 11 seconds 00000100:00100000:2.0:1787780138.846362:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881667840 00000100:00100000:2.0:1787780138.846368:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881667840 00000100:00100000:2.0:1787780138.846410:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787780138.846418:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0478630850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+20:18744:x1874622881667840:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787780138.846430:0:17234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787780138.846441:0:17234:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0444c18200/0xc8fc0a51799619ef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xc8fc0a51799619e8 expref: -99 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780138.846464:0:17234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0444c18200/0xc8fc0a51799619ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc8fc0a51799619e8 expref: 21 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780138.846475:0:17234:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0444c18200/0xc8fc0a51799619ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a51799619e8 expref: 21 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780138.846484:0:17234:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0444c18200, rc 0) 00000100:00100000:2.0:1787780138.846519:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0478630850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+21:18744:x1874622881667840:12345-0@lo:101:mount.lustre.0 Request processed in 102us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780138.846526:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787780138.846567:0:18744:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348a09680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:18744:1874622881667840:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787780138.846579:0:18744:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff9c0444c19c00/0xc8fc0a51799619e8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a51799619ef expref: -99 pid: 18744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780138.846586:0:18744:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff9c0444c19c00/0xc8fc0a51799619e8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xc8fc0a51799619ef expref: -99 pid: 18744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787780138.849458:0:18744:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:3.0:1787780138.849822:0:18744:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787780138.850777:0:18744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1787780138.850808:0:18744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1787780138.850824:0:18744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1787780138.850836:0:18744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1787780138.850872:0:18744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1787780138.850886:0:18744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1787780138.850911:0:18744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1787780138.850924:0:18744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1787780138.851094:0:18744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1787780138.851112:0:18744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1787780138.851127:0:18744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1787780138.851141:0:18744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1787780138.851169:0:18744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1787780138.851185:0:18744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1787780138.851199:0:18744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1787780138.851212:0:18744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1787780138.851238:0:18744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1787780138.851251:0:18744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1787780138.851384:0:18744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1787780138.851400:0:18744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1787780138.851412:0:18744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1787780138.851425:0:18744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1787780138.851437:0:18744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1787780138.851450:0:18744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1787780138.851606:0:18744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:3.0:1787780138.851629:0:18744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:3.0:1787780138.851644:0:18744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:3.0:1787780138.851659:0:18744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:3.0:1787780138.851691:0:18744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:3.0:1787780138.851711:0:18744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:3.0:1787780138.851740:0:18744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:3.0:1787780138.851878:0:18744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:3.0:1787780138.851899:0:18744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:3.0:1787780138.851915:0:18744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:3.0:1787780138.852045:0:18744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:3.0:1787780138.852072:0:18744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:3.0:1787780138.852087:0:18744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:3.0:1787780138.852111:0:18744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:3.0:1787780138.852118:0:18744:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:3.0:1787780138.852238:0:18744:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346da7c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:18744:1874622881667968:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787780138.852636:0:18744:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780138.852680:0:18744:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c047782b540 going to sleep for 11 seconds 00000100:00100000:0.0:1787780138.852893:0:17237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881667968 00000100:00100000:0.0:1787780138.852901:0:17237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881667968 00000100:00100000:0.0:1787780138.852950:0:17237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787780138.852959:0:17237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0478633050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+21:18744:x1874622881667968:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787780138.853081:0:17237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0478633050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+21:18744:x1874622881667968:12345-0@lo:501:mount.lustre.0 Request processed in 123us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780138.853089:0:17237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787780138.853123:0:18744:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346da7c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:18744:1874622881667968:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787780138.853161:0:18744:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346da7c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:18744:1874622881668096:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787780138.853205:0:18744:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780138.853917:0:18744:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c047782b540 going to sleep for 11 seconds 00000100:00100000:1.0:1787780138.854458:0:17236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881668096 00000100:00100000:1.0:1787780138.854464:0:17236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881668096 00000100:00100000:1.0:1787780138.855291:0:17236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787780138.855307:0:17236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0478631050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+21:18744:x1874622881668096:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787780138.855521:0:17236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0478631050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+21:18744:x1874622881668096:12345-0@lo:503:mount.lustre.0 Request processed in 219us (2315us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780138.855529:0:17236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787780138.855734:0:18744:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346da7c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:18744:1874622881668096:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787780138.856167:0:18744:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787780138.856252:0:18744:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346da7c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:18744:1874622881668224:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787780138.856303:0:18744:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780138.856330:0:18744:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c047782b540 going to sleep for 11 seconds 00000100:00100000:1.0:1787780138.859784:0:17236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881668224 00000100:00100000:1.0:1787780138.859794:0:17236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881668224 00000100:00100000:1.0:1787780138.859865:0:17236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787780138.859875:0:17236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0478631850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+21:18744:x1874622881668224:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787780138.860037:0:17236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0478631850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+21:18744:x1874622881668224:12345-0@lo:502:mount.lustre.0 Request processed in 163us (3733us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780138.860045:0:17236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787780138.860934:0:18744:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346da7c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:18744:1874622881668224:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787780138.861453:0:18744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1787780138.861484:0:18744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1787780138.861498:0:18744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1787780138.861512:0:18744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1787780138.861536:0:18744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1787780138.861550:0:18744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1787780138.861563:0:18744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1787780138.861577:0:18744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1787780138.861589:0:18744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1787780138.861599:0:18744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1787780138.861610:0:18744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1787780138.861623:0:18744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1787780138.861650:0:18744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1787780138.861666:0:18744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1787780138.861693:0:18744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1787780138.861707:0:18744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1787780138.861730:0:18744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1787780138.861742:0:18744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1787780138.861753:0:18744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1787780138.861765:0:18744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1787780138.861776:0:18744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1787780138.861787:0:18744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1787780138.861797:0:18744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1787780138.861808:0:18744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1787780138.861820:0:18744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:2.0:1787780138.861830:0:18744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:2.0:1787780138.861861:0:18744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:2.0:1787780138.861983:0:18744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:2.0:1787780138.862004:0:18744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:2.0:1787780138.862020:0:18744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:2.0:1787780138.862049:0:18744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:2.0:1787780138.862067:0:18744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:2.0:1787780138.862084:0:18744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:2.0:1787780138.862097:0:18744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:2.0:1787780138.862125:0:18744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:2.0:1787780138.862139:0:18744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:2.0:1787780138.862151:0:18744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:2.0:1787780138.862177:0:18744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:2.0:1787780138.862193:0:18744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:2.0:1787780138.862211:0:18744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:2.0:1787780138.862229:0:18744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:2.0:1787780138.862247:0:18744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:2.0:1787780138.862267:0:18744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:2.0:1787780138.862287:0:18744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:2.0:1787780138.862309:0:18744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:2.0:1787780138.862325:0:18744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:2.0:1787780138.862356:0:18744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:2.0:1787780138.862372:0:18744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:2.0:1787780138.862422:0:18744:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348a09680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:18744:1874622881668352:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787780138.862493:0:18744:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787780138.862528:0:18744:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0444f62300 going to sleep for 11 seconds 00000100:00100000:2.0:1787780138.862550:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881668352 00000100:00100000:2.0:1787780138.862557:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881668352 00000100:00100000:2.0:1787780138.862598:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787780138.862607:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0478632450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+21:18744:x1874622881668352:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787780138.863043:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0478632450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+21:18744:x1874622881668352:12345-0@lo:502:mount.lustre.0 Request processed in 434us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780138.863051:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787780138.863174:0:18744:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348a09680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:18744:1874622881668352:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787780138.863322:0:18744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:2.0:1787780138.863346:0:18744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:2.0:1787780138.863368:0:18744:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348a09680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:18744:1874622881668480:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787780138.863404:0:18744:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787780138.863423:0:18744:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c045848be40 going to sleep for 11 seconds 00000100:00100000:1.0:1787780138.864114:0:17236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881668480 00000100:00100000:1.0:1787780138.864121:0:17236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881668480 00000100:00100000:1.0:1787780138.864165:0:17236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787780138.864174:0:17236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0478630050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+21:18744:x1874622881668480:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787780138.864269:0:17236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0478630050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+21:18744:x1874622881668480:12345-0@lo:502:mount.lustre.0 Request processed in 95us (864us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780138.864281:0:17236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787780138.864739:0:18744:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348a09680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:18744:1874622881668480:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787780138.864801:0:18744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:2.0:1787780138.864812:0:18744:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1787780138.866295:0:18769:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1787780138.866312:0:18769:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9c0451568000) 00000020:00000080:0.0:1787780138.866340:0:18769:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:0.0:1787780138.867978:0:18769:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c0446175800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787780138.867988:0:18769:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c0446175800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787780138.867991:0:18769:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c0446175800 3 00010000:00080000:0.0:1787780138.868033:0:18769:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c0345e36800@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.131@tcp at head 00010000:00010000:0.0:1787780138.873957:0:18769:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:0.0:1787780138.874187:0:18769:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1787780138.874479:0:18769:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787780138.874493:0:18769:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xc8fc0a51799619fd 00000100:00080000:0.0:1787780138.874503:0:18769:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787780138.874509:0:18769:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9c0345e36800 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:0.0:1787780138.874543:0:18769:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c0346cfc3c0 x1874622881668608/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787780138.874589:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346cfc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1874622881668608:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787780138.874656:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787780138.874720:0:18769:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787780138.874721:0:17243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881668608 00000100:00100000:3.0:1787780138.874729:0:17243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881668608 00000100:00100000:3.0:1787780138.874781:0:17243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787780138.874791:0:17243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346cfe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1874622881668608:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1787780138.874814:0:17243:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 546 last 0 00000020:00000080:3.0:1787780138.874875:0:17243:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xc8fc0a5179961a04 00000004:00100000:3.0:1787780138.874889:0:17243:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787780138.874918:0:17243:0:(import.c:65:import_set_state_nolock()) ffff9c034881b800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787780138.874979:0:17243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346cfe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1874622881668608:12345-0@lo:38:llog_process_th.0 Request processed in 188us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780138.874987:0:17243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1787780138.875036:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c0346cfc3c0 x1874622881668608/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787780148 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787780138.875744:0:3640:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787780138.875754:0:3640:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:3.0:1787780138.875761:0:3640:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1787780138.875770:0:3640:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787780138.875773:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9c0345e36800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787780138.875780:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346cfc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1874622881668608:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1787780138.876392:0:2253:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787780138.876398:0:2253:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787780138.876401:0:2253:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787780138.876403:0:2253:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000004:0.0:1787780138.881223:0:18769:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1787780138.881253:0:18769:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9c034691b370) 00000020:00000080:0.0:1787780138.881277:0:18769:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:0.0:1787780138.881390:0:18769:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c0446175800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787780138.881394:0:18769:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c0446175800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787780138.881397:0:18769:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c0446175800 3 00010000:00080000:0.0:1787780138.881426:0:18769:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c0345e37800@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.131@tcp at head 00010000:00010000:0.0:1787780138.883044:0:18769:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:0.0:1787780138.883256:0:18769:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:0.0:1787780138.883307:0:18769:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787780138.883321:0:18769:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xc8fc0a5179961a12 00000100:00080000:0.0:1787780138.883332:0:18769:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787780138.883339:0:18769:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9c0345e37800 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:0.0:1787780138.883380:0:18769:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c0346cfd680 x1874622881668736/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787780138.883402:0:18769:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:3.0:1787780138.883440:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346cfd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3640:1874622881668736:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787780138.883506:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787780138.883591:0:2253:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787780138.883597:0:2253:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:0.0:1787780138.883599:0:18769:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000100:00080000:2.0:1787780138.883600:0:2253:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787780138.883607:0:2253:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787780138.884682:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881668736 00000100:00100000:1.0:1787780138.884692:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881668736 00000100:00100000:1.0:1787780138.884904:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787780138.884913:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346da4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3640:x1874622881668736:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1787780138.884942:0:17244:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 546 last 0 00000020:01000000:2.0:1787780138.884956:0:18744:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 00000020:00000080:1.0:1787780138.884991:0:17244:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xc8fc0a5179961a19 10000000:01000000:2.0:1787780138.884999:0:18744:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-client' succeeded (0). 00000004:00100000:1.0:1787780138.885008:0:17244:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00010000:00010000:2.0:1787780138.885017:0:18744:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c0444c19c00/0xc8fc0a51799619e8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a51799619ef expref: -99 pid: 18744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780138.885029:0:18744:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff9c0444c19c00/0xc8fc0a51799619e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a51799619ef expref: -99 pid: 18744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787780138.885044:0:17244:0:(import.c:65:import_set_state_nolock()) ffff9c046c8b6800 : changing import state from RECOVER to FULL 00000020:01000004:2.0:1787780138.885082:0:18744:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787780138.885085:0:18744:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787780138.885087:0:18744:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787780138.885088:0:18744:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787780138.885090:0:18744:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787780138.885091:0:18744:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787780138.885093:0:18744:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787780138.885095:0:18744:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787780138.885097:0:18744:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00010000:00080000:3.0:1787780138.885154:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c0346cfd680 x1874622881668736/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787780148 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787780138.885164:0:3640:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787780138.885172:0:3640:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 2 00000100:00080000:3.0:1787780138.885178:0:3640:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1787780138.885182:0:3640:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1787780138.885185:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9c0345e37800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787780138.885190:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346cfd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3640:1874622881668736:0@lo:38:llog_process_th.0 10000000:01000000:2.0:1787780138.885193:0:18744:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000100:00100000:1.0:1787780138.885197:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346da4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1874622881668736:12345-0@lo:38:llog_process_th.0 Request processed in 281us (1687us total) trans 0 rc 0/0 00000020:01000004:2.0:1787780138.885203:0:18744:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787780138.885207:0:18744:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787780138.885209:0:18744:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787780138.885211:0:18744:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000100:00100000:1.0:1787780138.885212:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000020:01000004:2.0:1787780138.885213:0:18744:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787780138.885216:0:18744:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787780138.885218:0:18744:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787780138.885220:0:18744:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787780138.885221:0:18744:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787780138.885238:0:18744:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1787780138.885251:0:18744:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348a09680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:18744:1874622881668864:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787780138.885294:0:18744:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787780138.885329:0:18744:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c045848bcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787780138.885402:0:17237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881668864 00000100:00100000:3.0:1787780138.885407:0:17237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881668864 00000100:00100000:3.0:1787780138.885455:0:17237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787780138.885462:0:17237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0478631c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+21:18744:x1874622881668864:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787780138.885481:0:17237:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1787780138.885495:0:17237:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1787780138.890812:0:17237:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787780138.891730:0:17237:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1787780138.892206:0:17237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0478631c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+21:18744:x1874622881668864:12345-0@lo:253:mount.lustre.0 Request processed in 6739us (6906us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780138.892220:0:17237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787780138.892302:0:18744:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348a09680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:18744:1874622881668864:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787780138.892316:0:18744:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1787780138.892320:0:18744:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787780138.892321:0:18744:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787780138.892323:0:18744:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787780138.892325:0:18744:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787780138.892326:0:18744:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787780138.892328:0:18744:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787780138.892329:0:18744:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787780138.892331:0:18744:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787780138.892332:0:18744:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787780138.892348:0:18744:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000001:00000004:3.0:1787780138.896809:0:18744:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 20000000:01000000:0.0:1787780138.899009:0:17258:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787780138.899019:0:17258:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787780138.899518:0:17258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c0347e4b800/0xc8fc0a5179961a20 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780138.899538:0:17258:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c0444c19000/0xc8fc0a517996196a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a5179961963 expref: 20 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780138.899545:0:17258:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c0444c18800/0xc8fc0a5179961978 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a5179961971 expref: 20 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780138.899551:0:17258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c0347e4b800/0xc8fc0a5179961a20 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1787780138.899564:0:18744:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1787780138.899574:0:18744:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00010000:00010000:1.0:1787780138.899588:0:17258:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c0444c18800/0xc8fc0a5179961978 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc8fc0a5179961971 expref: 20 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780138.899601:0:17258:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c0444c18800/0xc8fc0a5179961978 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc8fc0a5179961971 expref: 20 pid: 17236 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787780138.899606:0:18744:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787780138.899662:0:18744:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.131@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787780138.899681:0:18744:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1787780138.899698:0:18744:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000100:00100000:1.0:1787780138.899709:0:17258:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047785c000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17258:1874622881668992:0@lo:104: 00000100:00100000:1.0:1787780138.899778:0:17258:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780138.899821:0:17225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881668992 00000100:00100000:1.0:1787780138.899827:0:17225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881668992 00000100:00100000:1.0:1787780138.899890:0:17225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787780138.899900:0:17225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c047785d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+3:17258:x1874622881668992:12345-0@lo:104: 00010000:00010000:1.0:1787780138.899911:0:17225:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff9c0444c18600/0xc8fc0a5179961971 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc8fc0a5179961978 expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780138.900016:0:17225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787780138.900024:0:17225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c047785d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+3:17258:x1874622881668992:12345-0@lo:104: Request processed in 126us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780138.900034:0:17225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1787780138.900060:0:17231:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787780138.900133:0:17231:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff9c0444c18600/0xc8fc0a5179961971 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc8fc0a5179961978 expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780138.900141:0:17231:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0444c18600 already unused, calling callback (ffffffffc139ac20) 10000000:00010000:1.0:1787780138.900145:0:17231:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff9c0444c18600/0xc8fc0a5179961971 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc8fc0a5179961978 expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780138.900154:0:17231:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff9c0444c18600/0xc8fc0a5179961971 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc8fc0a5179961978 expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787780138.900161:0:17231:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff9c0444c18600/0xc8fc0a5179961971 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc8fc0a5179961978 expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787780138.900167:0:17231:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787780138.900202:0:17231:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff9c0444c18600/0xc8fc0a5179961971 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a5179961978 expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780138.900209:0:17231:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787780138.900229:0:17231:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff9c0444c18600/0xc8fc0a5179961971 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a5179961978 expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780138.900236:0:17231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff9c0444c18600/0xc8fc0a5179961971 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a5179961978 expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780138.900249:0:17231:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787780138.900251:0:17231:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787780138.900253:0:17231:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787780138.900275:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047785cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:3643:1874622881669120:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787780138.900305:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780138.900363:0:17228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881669120 00000100:00100000:1.0:1787780138.900367:0:17228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881669120 00010000:00010000:1.0:1787780138.900383:0:17228:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c0444c18800/0xc8fc0a5179961978 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc8fc0a5179961971 expref: 21 pid: 17236 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787780138.900403:0:17228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787780138.900408:0:17228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c047785f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+21:3643:x1874622881669120:12345-0@lo:103:ldlm_bl.0 00000020:00000004:3.0:1787780138.900475:0:18744:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00010000:00010000:1.0:1787780138.900489:0:17228:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787780138.900496:0:17228:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c0444c18800/0xc8fc0a5179961978 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc8fc0a5179961971 expref: 21 pid: 17236 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780138.900506:0:17228:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c0444c18800/0xc8fc0a5179961978 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc8fc0a5179961971 expref: 21 pid: 17236 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780138.900521:0:17228:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787780138.900554:0:17228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c047785f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+21:3643:x1874622881669120:12345-0@lo:103:ldlm_bl.0 Request processed in 145us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780138.900567:0:17228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787780138.900603:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047785cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:3643:1874622881669120:0@lo:103:ldlm_bl.0 00000020:00000004:3.0:1787780138.900707:0:18744:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787780138.901081:0:17258:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c0444c19000/0xc8fc0a517996196a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc8fc0a5179961963 expref: 20 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780138.901093:0:17258:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c0444c19000/0xc8fc0a517996196a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc8fc0a5179961963 expref: 20 pid: 17237 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787780138.901103:0:17258:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047785cf00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17258:1874622881669248:0@lo:104: 00000100:00100000:1.0:1787780138.901131:0:17258:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780138.902523:0:17258:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c04764c5f00 going to sleep for 11 seconds 00010000:00010000:1.0:1787780138.902547:0:17258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c0444c18800/0xc8fc0a5179961978 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc8fc0a5179961971 expref: 20 pid: 17236 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787780138.902562:0:17258:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047785c000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17258:1874622881668992:0@lo:104: 00000100:00100000:0.0:1787780138.902798:0:17225:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1787780138.902818:0:17225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881669248 00000100:00100000:0.0:1787780138.902824:0:17225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881669248 00000100:00100000:1.0:1787780138.903070:0:17225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787780138.903082:0:17225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046f0ae850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+3:17258:x1874622881669248:12345-0@lo:104: 00010000:00010000:1.0:1787780138.903096:0:17225:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff9c0481373200/0xc8fc0a5179961963 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc8fc0a517996196a expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780138.903168:0:17225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787780138.903174:0:17225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046f0ae850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+3:17258:x1874622881669248:12345-0@lo:104: Request processed in 97us (2043us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780138.903182:0:17225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787780138.903923:0:17258:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047785cf00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17258:1874622881669248:0@lo:104: 00010000:00010000:3.0:1787780138.903950:0:17258:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c0347e4b800/0xc8fc0a5179961a20 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780138.904535:0:17230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787780138.904543:0:17230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff9c0481373200/0xc8fc0a5179961963 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc8fc0a517996196a expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780138.904551:0:17230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0481373200 already unused, calling callback (ffffffffc139ac20) 10000000:00010000:0.0:1787780138.904556:0:17230:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff9c0481373200/0xc8fc0a5179961963 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc8fc0a517996196a expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780138.904565:0:17230:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff9c0481373200/0xc8fc0a5179961963 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc8fc0a517996196a expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787780138.904573:0:17230:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff9c0481373200/0xc8fc0a5179961963 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc8fc0a517996196a expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787780138.904578:0:17230:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787780138.904885:0:17230:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff9c0481373200/0xc8fc0a5179961963 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a517996196a expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780138.904892:0:17230:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787780138.904917:0:17230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff9c0481373200/0xc8fc0a5179961963 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a517996196a expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780138.904936:0:17230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff9c0481373200/0xc8fc0a5179961963 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a517996196a expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780138.904956:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787780138.904958:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787780138.904961:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787780138.905196:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346cfde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:3644:1874622881669376:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787780138.905260:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787780138.907958:0:18398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881669376 00000100:00100000:0.0:1787780138.907969:0:18398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881669376 00010000:00010000:0.0:1787780138.908004:0:18398:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c0444c19000/0xc8fc0a517996196a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc8fc0a5179961963 expref: 20 pid: 17237 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787780138.908038:0:18398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787780138.908047:0:18398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0341b5a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+20:3644:x1874622881669376:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787780138.908062:0:18398:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787780138.908068:0:18398:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c0444c19000/0xc8fc0a517996196a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc8fc0a5179961963 expref: 20 pid: 17237 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780138.908081:0:18398:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c0444c19000/0xc8fc0a517996196a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc8fc0a5179961963 expref: 20 pid: 17237 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780138.908099:0:18398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c0444c19000/0xc8fc0a517996196a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc8fc0a5179961963 expref: 20 pid: 17237 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780138.908115:0:18398:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c0347e4b800/0xc8fc0a5179961a20 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780138.908124:0:18398:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0347e4b800/0xc8fc0a5179961a20 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787780138.908152:0:18398:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.009133879s 00010000:00010000:0.0:1787780138.908157:0:18398:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c0347e4b800/0xc8fc0a5179961a20 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780138.908165:0:18398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c0347e4b800/0xc8fc0a5179961a20 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780138.908173:0:18398:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c0347e4b800/0xc8fc0a5179961a20 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780138.908180:0:18398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c0347e4b800/0xc8fc0a5179961a20 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780138.908187:0:18398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0347e4b800 already unused, calling callback (ffffffffc0d97420) 00010000:00010000:0.0:1787780138.908190:0:18398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c0347e4b800/0xc8fc0a5179961a20 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780138.908198:0:18398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c0347e4b800/0xc8fc0a5179961a20 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780138.908213:0:18398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c0347e4b800/0xc8fc0a5179961a20 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780138.908222:0:18398:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787780138.908283:0:18398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0341b5a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+19:3644:x1874622881669376:12345-0@lo:103:ldlm_bl.0 Request processed in 237us (3023us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780138.908291:0:18398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1787780138.908344:0:17258:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c0347e4b800/0xc8fc0a5179961a20 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780138.908361:0:17258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c0347e4b800/0xc8fc0a5179961a20 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780138.908367:0:17258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c0347e4b800/0xc8fc0a5179961a20 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787780138.908912:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346cfde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:3644:1874622881669376:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787780139.356938:0:18397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1787780139.786135:0:18824:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787780139.786360:0:18824:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787780140.381262:0:17231:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787780140.700975:0:17239:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787780140.700984:0:17239:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c0477821800 from 9 10000000:01000000:1.0:1787780140.700990:0:17239:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787780140.701032:0:17239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c0347e4a200/0xc8fc0a5179961a27 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780140.701045:0:17239:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff9c0347e4a200/0xc8fc0a5179961a27 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780140.701056:0:17239:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff9c0347e4a200/0xc8fc0a5179961a27 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787780140.701081:0:17239:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047785de00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17239:1874622881669504:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787780140.701143:0:17239:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780140.701191:0:17239:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c04764c5900 going to sleep for 11 seconds 00000100:00100000:2.0:1787780140.701248:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881669504 00000100:00100000:2.0:1787780140.701257:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881669504 00000100:00100000:2.0:1787780140.701317:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787780140.701335:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0478630c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+19:17239:x1874622881669504:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787780140.701348:0:17234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787780140.701360:0:17234:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0444c18600/0xc8fc0a5179961a2e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc8fc0a5179961a27 expref: -99 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780140.701382:0:17234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0444c18600/0xc8fc0a5179961a2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc8fc0a5179961a27 expref: 20 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780140.701393:0:17234:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0444c18600/0xc8fc0a5179961a2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a5179961a27 expref: 20 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780140.701402:0:17234:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0444c18600, rc 0) 00000100:00100000:2.0:1787780140.701445:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0478630c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+20:17239:x1874622881669504:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780140.701452:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787780140.701628:0:17239:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047785de00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17239:1874622881669504:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787780140.701642:0:17239:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff9c0347e4a200/0xc8fc0a5179961a27 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a5179961a2e expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780140.701651:0:17239:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff9c0347e4a200/0xc8fc0a5179961a27 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc8fc0a5179961a2e expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787780140.701712:0:17239:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346cfc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17239:1874622881669632:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1787780140.701744:0:17239:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787780140.701765:0:17239:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0443d6e6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787780140.701930:0:17237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881669632 00000100:00100000:2.0:1787780140.701934:0:17237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881669632 00000100:00100000:2.0:1787780140.701958:0:17237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787780140.701965:0:17237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0478631450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+20:17239:x1874622881669632:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787780140.701978:0:17237:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787780140.701993:0:17237:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787780140.701996:0:17237:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:2.0:1787780140.702079:0:17237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0478631450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+20:17239:x1874622881669632:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 113us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780140.702086:0:17237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787780140.702143:0:17239:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346cfc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17239:1874622881669632:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1787780140.702213:0:17239:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787780140.702220:0:17239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c0347e4a200/0xc8fc0a5179961a27 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a5179961a2e expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780140.702229:0:17239:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff9c0347e4a200/0xc8fc0a5179961a27 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a5179961a2e expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787780140.702237:0:17239:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787780140.702239:0:17239:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c0447266000 from 9 10000000:01000000:1.0:1787780140.702246:0:17239:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787780140.702262:0:17239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c0347e4b600/0xc8fc0a5179961a35 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780140.702270:0:17239:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff9c0347e4b600/0xc8fc0a5179961a35 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780140.702278:0:17239:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff9c0347e4b600/0xc8fc0a5179961a35 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787780140.702300:0:17239:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047785d2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17239:1874622881669760:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787780140.702326:0:17239:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780140.702358:0:17239:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c04764c5540 going to sleep for 11 seconds 00000100:00100000:2.0:1787780140.702721:0:17236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881669760 00000100:00100000:2.0:1787780140.702728:0:17236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881669760 00000100:00100000:2.0:1787780140.702764:0:17236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787780140.702770:0:17236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0478630450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+20:17239:x1874622881669760:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787780140.702785:0:17236:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787780140.702794:0:17236:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0444c18800/0xc8fc0a5179961a3c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc8fc0a5179961a35 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780140.702809:0:17236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0444c18800/0xc8fc0a5179961a3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc8fc0a5179961a35 expref: 21 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780140.702817:0:17236:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0444c18800/0xc8fc0a5179961a3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a5179961a35 expref: 21 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780140.702823:0:17236:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0444c18800, rc 0) 00000100:00100000:2.0:1787780140.702876:0:17236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0478630450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+21:17239:x1874622881669760:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 107us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780140.702883:0:17236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787780140.703323:0:17239:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047785d2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17239:1874622881669760:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787780140.703337:0:17239:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff9c0347e4b600/0xc8fc0a5179961a35 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a5179961a3c expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780140.703346:0:17239:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff9c0347e4b600/0xc8fc0a5179961a35 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc8fc0a5179961a3c expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787780140.703394:0:17239:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047785d2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17239:1874622881669888:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1787780140.703426:0:17239:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780140.703455:0:17239:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c04764c5540 going to sleep for 11 seconds 00000100:00100000:2.0:1787780140.703551:0:17236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881669888 00000100:00100000:2.0:1787780140.703555:0:17236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881669888 00000100:00100000:2.0:1787780140.703588:0:17236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787780140.703594:0:17236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0478632050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+21:17239:x1874622881669888:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787780140.703606:0:17236:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787780140.703620:0:17236:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787780140.703623:0:17236:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:2.0:1787780140.703710:0:17236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0478632050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+21:17239:x1874622881669888:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 104us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780140.703718:0:17236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787780140.704003:0:17239:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047785d2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17239:1874622881669888:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1787780140.704058:0:17239:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787780140.704065:0:17239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c0347e4b600/0xc8fc0a5179961a35 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a5179961a3c expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780140.704082:0:17239:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff9c0347e4b600/0xc8fc0a5179961a35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a5179961a3c expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787780140.828567:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787780140.828591:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348a09a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874622881670016:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787780140.828666:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787780140.828768:0:17248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881670016 00000100:00100000:2.0:1787780140.828776:0:17248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881670016 00000100:00100000:2.0:1787780140.828823:0:17248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787780140.828831:0:17248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346cfd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1874622881670016:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787780140.828906:0:17248:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1787780140.828961:0:17248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346cfd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1874622881670016:12345-0@lo:41:osp-pre-0-1.0 Request processed in 130us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780140.828969:0:17248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787780140.829279:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348a09a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874622881670016:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787780140.829638:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787780140.829648:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346cfc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881670144:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787780140.829686:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780140.829797:0:18276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881670144 00000100:00100000:3.0:1787780140.829803:0:18276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881670144 00000100:00100000:2.0:1787780140.830003:0:17248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787780140.830012:0:17248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0348a09680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874622881670144:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787780140.830037:0:17248:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1787780140.830094:0:17248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0348a09680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874622881670144:12345-0@lo:41:osp-pre-1-0.0 Request processed in 84us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780140.830101:0:17248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787780140.830253:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346cfc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881670144:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787780141.405892:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787780142.436497:0:18397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787780143.452237:0:17231:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787780143.905313:0:2253:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787780143.905319:0:2253:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1787780143.905323:0:2253:0:(import.c:65:import_set_state_nolock()) ffff9c047787a000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787780143.905331:0:2253:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 546 00000100:00080000:1.0:1787780143.905337:0:2253:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1787780143.905343:0:2253:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9c047787a000 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:1.0:1787780143.905365:0:2253:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c047785f840 x1874622881670528/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787780143.905383:0:2253:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787780143.905386:0:2253:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787780143.905388:0:2253:0:(import.c:65:import_set_state_nolock()) ffff9c044963b000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787780143.905392:0:2253:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 546 00000100:00080000:1.0:1787780143.905395:0:2253:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1787780143.905398:0:2253:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9c044963b000 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:1.0:1787780143.905409:0:2253:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c047785da40 x1874622881670656/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787780143.905440:0:2253:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787780143.905443:0:2253:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787780143.905445:0:2253:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787780143.905457:0:2253:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787780143.905517:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047785e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:3643:1874622881670272:0@lo:400:kworker.0 00000100:00100000:1.0:1787780143.905583:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780143.905627:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047785ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874622881671040:0@lo:400:kworker.0 00000100:00100000:1.0:1787780143.906054:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780143.906362:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787780143.906370:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047785e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881670400:0@lo:400:kworker.0 00000100:00100000:1.0:1787780143.906402:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780143.906423:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047785d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1874622881671168:0@lo:400:kworker.0 00000100:00100000:1.0:1787780143.906448:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780143.906483:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047785f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1874622881670528:0@lo:8:kworker.0 00000100:00100000:1.0:1787780143.906507:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780143.906525:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047785da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1874622881670656:0@lo:8:kworker.0 00000100:00100000:1.0:1787780143.906545:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780143.906574:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047785f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874622881670784:0@lo:400:kworker.0 00000100:00100000:1.0:1787780143.906599:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780143.906617:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047785de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1874622881671296:0@lo:400:kworker.0 00000100:00100000:1.0:1787780143.906640:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780143.906650:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787780143.906656:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047785fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881670912:0@lo:400:kworker.0 00000100:00100000:1.0:1787780143.906760:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780143.906797:0:17237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881670272 00000100:00100000:1.0:1787780143.906804:0:17237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881670272 00000100:00100000:1.0:1787780143.907014:0:17237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1787780143.907025:0:17237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0478636c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+21:3643:x1874622881670272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787780143.907199:0:17243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881671040 00000100:00100000:2.0:1787780143.907204:0:17243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881671040 00000100:00100000:2.0:1787780143.907227:0:17243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881671168 00000100:00100000:2.0:1787780143.907230:0:17243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881671168 00000100:00100000:2.0:1787780143.907253:0:17243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881670784 00000100:00100000:2.0:1787780143.907256:0:17243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881670784 00000100:00100000:2.0:1787780143.907266:0:17243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881671296 00000100:00100000:2.0:1787780143.907268:0:17243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881671296 00000100:00100000:2.0:1787780143.907282:0:17243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787780143.907288:0:17243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c047785f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1874622881671040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787780143.907334:0:17243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c047785f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1874622881671040:12345-0@lo:400:kworker.0 Request processed in 45us (1280us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780143.907341:0:17243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787780143.907357:0:17243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787780143.907371:0:17243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c047785c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1874622881671168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787780143.907403:0:17243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c047785c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1874622881671168:12345-0@lo:400:kworker.0 Request processed in 34us (954us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780143.907409:0:17243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787780143.907420:0:17243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787780143.907425:0:17243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347fa92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874622881670784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787780143.907457:0:17243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347fa92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874622881670784:12345-0@lo:400:kworker.0 Request processed in 31us (857us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780143.907463:0:17243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787780143.907475:0:17243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787780143.907481:0:17243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347fabc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1874622881671296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787780143.907506:0:17243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347fabc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1874622881671296:12345-0@lo:400:kworker.0 Request processed in 26us (865us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780143.907511:0:17243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787780143.907528:0:17248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881670400 00000100:00100000:2.0:1787780143.907531:0:17248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881670400 00000100:00100000:2.0:1787780143.907553:0:17248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881670912 00000100:00100000:2.0:1787780143.907556:0:17248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881670912 00000100:00100000:2.0:1787780143.907569:0:17248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787780143.907577:0:17248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c047785cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881670400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787780143.907610:0:17248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c047785cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881670400:12345-0@lo:400:kworker.0 Request processed in 34us (1208us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780143.907616:0:17248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787780143.907628:0:17248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787780143.907634:0:17248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347fa8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881670912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787780143.907685:0:17248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347fa8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881670912:12345-0@lo:400:kworker.0 Request processed in 43us (916us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780143.907699:0:17248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787780143.907742:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047785fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881670912:0@lo:400:kworker.0 00010000:00080000:2.0:1787780143.907762:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c047785f0c0 x1874622881670784/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787780159 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787780143.907772:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047785f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874622881670784:0@lo:400:kworker.0 00010000:00080000:2.0:1787780143.907787:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c047785de00 x1874622881671296/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787780159 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787780143.907795:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047785de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1874622881671296:0@lo:400:kworker.0 00000100:00100000:2.0:1787780143.907835:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047785e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881670400:0@lo:400:kworker.0 00010000:00080000:2.0:1787780143.907876:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c047785d680 x1874622881671168/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787780159 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787780143.907884:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047785d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1874622881671168:0@lo:400:kworker.0 00010000:00080000:2.0:1787780143.907895:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c047785ed00 x1874622881671040/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787780159 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787780143.907903:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047785ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874622881671040:0@lo:400:kworker.0 00000100:00100000:1.0:1787780143.908210:0:17237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0478636c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+21:3643:x1874622881670272:12345-0@lo:400:kworker.0 Request processed in 1186us (2625us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780143.908219:0:17237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1787780143.908267:0:18750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881670528 00000100:00100000:1.0:1787780143.908272:0:18750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881670528 00000100:00100000:1.0:1787780143.908290:0:18750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881670656 00000100:00100000:1.0:1787780143.908293:0:18750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881670656 00000100:00100000:1.0:1787780143.908304:0:18750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787780143.908309:0:18750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c047785c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3640:x1874622881670528:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1787780143.908332:0:18750:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 551 last 0 00000020:00000080:1.0:1787780143.908356:0:18750:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc8fc0a5179961a43 00002000:00100000:1.0:1787780143.908368:0:18750:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9c046c8b7000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113939 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1787780143.908372:0:18750:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1787780143.908375:0:18750:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1787780143.908546:0:18750:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787780143.908568:0:18750:0:(import.c:65:import_set_state_nolock()) ffff9c046c8b0000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787780143.908608:0:18750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c047785c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3640:x1874622881670528:12345-0@lo:8:kworker.0 Request processed in 298us (2100us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780143.908616:0:18750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787780143.908630:0:18750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787780143.908635:0:18750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347fa8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3640:x1874622881670656:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1787780143.908647:0:18750:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787780143.911894:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047785e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:3643:1874622881670272:0@lo:400:kworker.0 00000100:00080000:2.0:1787780143.912417:0:17238:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787780143.912423:0:17238:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787780143.926161:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c047785f840 x1874622881670528/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787780168 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787780143.926190:0:3640:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787780143.926201:0:3640:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1787780143.926210:0:3640:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1787780143.926216:0:3640:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1787780143.926220:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9c047787a000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1787780143.926251:0:3640:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1787780143.926258:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047785f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1874622881670528:0@lo:8:kworker.0 00000004:00080000:2.0:1787780143.926308:0:17266:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1787780143.926396:0:17266:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 551930556586ns, next at 0ns, rc = 0 00080000:00080000:2.0:1787780143.926403:0:17266:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:2.0:1787780143.927735:0:17222:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:0.0:1787780143.929807:0:17267:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x5:0x0] 00000100:00100000:0.0:1787780143.929836:0:17267:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346cfda40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17267:1874622881671552:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1787780143.929916:0:17267:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787780143.929946:0:17267:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c04429a8e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787780143.929966:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787780143.929978:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346cfcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881671424:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787780143.930011:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787780143.930017:0:18751:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1787780143.930027:0:18751:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1787780143.930059:0:18752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881671424 00000100:00100000:2.0:1787780143.930066:0:18752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881671424 00000100:00100000:2.0:1787780143.930117:0:18752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787780143.930126:0:18752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346cfc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3641:x1874622881671424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787780143.930167:0:18752:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1787780143.930215:0:18752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346cfc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3641:x1874622881671424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780143.930221:0:18752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1787780143.931208:0:17238:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787780143.931305:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0346cfcb40 x1874622881671424/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787780159 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787780143.931324:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346cfcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881671424:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787780143.936777:0:18751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881671552 00000100:00100000:2.0:1787780143.936789:0:18751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881671552 00000100:00100000:0.0:1787780143.938062:0:19055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787780143.938077:0:19055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346cff840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17267:x1874622881671552:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1787780143.940011:0:19055:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:0.0:1787780143.940021:0:19055:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:0.0:1787780143.940026:0:19055:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:6 to 0x280000401:33) 00000100:00100000:1.0:1787780143.941690:0:18750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347fa8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3640:x1874622881670656:12345-0@lo:8:kworker.0 Request processed in 33038us (35128us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787780143.941703:0:18750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1787780143.941756:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9c044963b000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787780143.941769:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787780143.941773:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047785da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1874622881670656:0@lo:8:kworker.0 00002000:00010000:0.0:1787780143.959962:0:19055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787780143.959982:0:19055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000757da721/0xc8fc0a5179961a4a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780143.959999:0:19055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=551s v=(0 0) 00010000:00010000:0.0:1787780143.960004:0:19055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787780143.960011:0:19055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000757da721/0xc8fc0a5179961a4a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780143.960032:0:19055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000757da721/0xc8fc0a5179961a4a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780143.960043:0:19055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000757da721/0xc8fc0a5179961a4a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780143.960052:0:19055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000757da721/0xc8fc0a5179961a4a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780143.960066:0:19055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787780143.960276:0:17230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787780143.960284:0:17230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000757da721/0xc8fc0a5179961a4a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780143.960293:0:17230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0481372e00 already unused, calling callback (ffffffffc0d97420) 00010000:00010000:1.0:1787780143.960297:0:17230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000757da721/0xc8fc0a5179961a4a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780143.960306:0:17230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000757da721/0xc8fc0a5179961a4a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780143.960324:0:17230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000757da721/0xc8fc0a5179961a4a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780143.960332:0:17230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000757da721/0xc8fc0a5179961a4a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780143.960359:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787780143.960361:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787780143.960364:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787780143.960627:0:19055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787780143.960634:0:19055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003bdd5036/0xc8fc0a5179961a51 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780143.960643:0:19055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=551s v=(0 0) 00010000:00010000:0.0:1787780143.960646:0:19055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787780143.960651:0:19055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003bdd5036/0xc8fc0a5179961a51 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780143.960662:0:19055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003bdd5036/0xc8fc0a5179961a51 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780143.960688:0:19055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003bdd5036/0xc8fc0a5179961a51 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780143.960697:0:19055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003bdd5036/0xc8fc0a5179961a51 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780143.961318:0:19055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787780143.962008:0:19055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787780143.962016:0:19055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a07e46b3/0xc8fc0a5179961a58 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780143.962028:0:19055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=551s v=(0 0) 00010000:00010000:0.0:1787780143.962032:0:19055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787780143.962037:0:19055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a07e46b3/0xc8fc0a5179961a58 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780143.962048:0:19055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a07e46b3/0xc8fc0a5179961a58 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780143.962057:0:19055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a07e46b3/0xc8fc0a5179961a58 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780143.962063:0:19055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a07e46b3/0xc8fc0a5179961a58 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780143.962532:0:18397:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787780143.962540:0:18397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003bdd5036/0xc8fc0a5179961a51 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780143.962550:0:18397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0481373c00 already unused, calling callback (ffffffffc0d97420) 00010000:00010000:1.0:1787780143.962560:0:18397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003bdd5036/0xc8fc0a5179961a51 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780143.962570:0:18397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003bdd5036/0xc8fc0a5179961a51 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780143.962584:0:18397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003bdd5036/0xc8fc0a5179961a51 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780143.962591:0:18397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003bdd5036/0xc8fc0a5179961a51 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780143.962616:0:18397:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787780143.962620:0:18397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a07e46b3/0xc8fc0a5179961a58 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780143.962626:0:18397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0481373600 already unused, calling callback (ffffffffc0d97420) 00010000:00010000:1.0:1787780143.962629:0:18397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a07e46b3/0xc8fc0a5179961a58 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780143.962636:0:18397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a07e46b3/0xc8fc0a5179961a58 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780143.962647:0:18397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a07e46b3/0xc8fc0a5179961a58 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780143.962654:0:18397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787780143.962662:0:18397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787780143.962664:0:18397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787780143.963231:0:19055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787780143.963238:0:19055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a07e46b3/0xc8fc0a5179961a58 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787780143.964245:0:19055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787780143.964254:0:19055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006cab1d5/0xc8fc0a5179961a5f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780143.964266:0:19055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=551s v=(0 0) 00010000:00010000:0.0:1787780143.964271:0:19055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787780143.964277:0:19055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000006cab1d5/0xc8fc0a5179961a5f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780143.964287:0:19055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000006cab1d5/0xc8fc0a5179961a5f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780143.964296:0:19055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006cab1d5/0xc8fc0a5179961a5f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780143.964304:0:19055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000006cab1d5/0xc8fc0a5179961a5f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780143.964571:0:17231:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787780143.964579:0:17231:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000006cab1d5/0xc8fc0a5179961a5f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780143.964587:0:17231:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0481372400 already unused, calling callback (ffffffffc0d97420) 00010000:00010000:1.0:1787780143.964592:0:17231:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000006cab1d5/0xc8fc0a5179961a5f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780143.964602:0:17231:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000006cab1d5/0xc8fc0a5179961a5f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780143.964616:0:17231:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000006cab1d5/0xc8fc0a5179961a5f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780143.964626:0:17231:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787780143.964628:0:17231:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787780143.964630:0:17231:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787780143.964756:0:19055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787780143.964762:0:19055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000006cab1d5/0xc8fc0a5179961a5f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787780143.965410:0:19055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787780143.965418:0:19055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000daa43216/0xc8fc0a5179961a66 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780143.965428:0:19055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=551s v=(0 0) 00010000:00010000:0.0:1787780143.965445:0:19055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787780143.965450:0:19055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000daa43216/0xc8fc0a5179961a66 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780143.965461:0:19055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000daa43216/0xc8fc0a5179961a66 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780143.965470:0:19055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000daa43216/0xc8fc0a5179961a66 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780143.965478:0:19055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000daa43216/0xc8fc0a5179961a66 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780143.965768:0:17230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787780143.965778:0:17230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000daa43216/0xc8fc0a5179961a66 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780143.965787:0:17230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0481372200 already unused, calling callback (ffffffffc0d97420) 00010000:00010000:1.0:1787780143.965791:0:17230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000daa43216/0xc8fc0a5179961a66 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780143.965799:0:17230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000daa43216/0xc8fc0a5179961a66 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780143.965820:0:17230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000daa43216/0xc8fc0a5179961a66 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780143.965830:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787780143.965832:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787780143.965834:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787780143.965933:0:19055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787780143.965939:0:19055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000daa43216/0xc8fc0a5179961a66 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787780143.966294:0:19055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787780143.966301:0:19055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000937f61df/0xc8fc0a5179961a6d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780143.966322:0:19055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=551s v=(0 0) 00010000:00010000:0.0:1787780143.966326:0:19055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787780143.966330:0:19055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000937f61df/0xc8fc0a5179961a6d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780143.966346:0:19055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000937f61df/0xc8fc0a5179961a6d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780143.966354:0:19055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000937f61df/0xc8fc0a5179961a6d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780143.966363:0:19055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000937f61df/0xc8fc0a5179961a6d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780143.966387:0:18397:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787780143.966393:0:18397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000937f61df/0xc8fc0a5179961a6d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780143.966401:0:18397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0481373000 already unused, calling callback (ffffffffc0d97420) 00010000:00010000:1.0:1787780143.966405:0:18397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000937f61df/0xc8fc0a5179961a6d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780143.966413:0:18397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000937f61df/0xc8fc0a5179961a6d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780143.966425:0:18397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000937f61df/0xc8fc0a5179961a6d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780143.966434:0:18397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787780143.966435:0:18397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787780143.966437:0:18397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787780143.966494:0:19055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787780143.966498:0:19055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000937f61df/0xc8fc0a5179961a6d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787780143.966813:0:19055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787780143.966823:0:19055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f02415f3/0xc8fc0a5179961a74 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780143.966833:0:19055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=551s v=(0 0) 00010000:00010000:0.0:1787780143.966857:0:19055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787780143.966863:0:19055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f02415f3/0xc8fc0a5179961a74 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780143.966885:0:19055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f02415f3/0xc8fc0a5179961a74 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780143.966894:0:19055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f02415f3/0xc8fc0a5179961a74 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780143.966902:0:19055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f02415f3/0xc8fc0a5179961a74 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780143.967075:0:17231:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787780143.967081:0:17231:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f02415f3/0xc8fc0a5179961a74 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780143.967099:0:17231:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0481372a00 already unused, calling callback (ffffffffc0d97420) 00010000:00010000:1.0:1787780143.967102:0:17231:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f02415f3/0xc8fc0a5179961a74 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780143.967110:0:17231:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f02415f3/0xc8fc0a5179961a74 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780143.967121:0:17231:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f02415f3/0xc8fc0a5179961a74 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780143.967130:0:17231:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787780143.967131:0:17231:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787780143.967133:0:17231:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787780143.967220:0:19055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787780143.967226:0:19055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f02415f3/0xc8fc0a5179961a74 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787780143.967545:0:19055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787780143.967551:0:19055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e521b2ec/0xc8fc0a5179961a7b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780143.967560:0:19055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=551s v=(0 0) 00010000:00010000:2.0:1787780143.967563:0:19055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787780143.967568:0:19055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e521b2ec/0xc8fc0a5179961a7b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780143.967579:0:19055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e521b2ec/0xc8fc0a5179961a7b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780143.967587:0:19055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e521b2ec/0xc8fc0a5179961a7b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780143.967600:0:19055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e521b2ec/0xc8fc0a5179961a7b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780143.967640:0:17230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787780143.967645:0:17230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e521b2ec/0xc8fc0a5179961a7b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780143.967652:0:17230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0444c19000 already unused, calling callback (ffffffffc0d97420) 00010000:00010000:1.0:1787780143.967655:0:17230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e521b2ec/0xc8fc0a5179961a7b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780143.967663:0:17230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e521b2ec/0xc8fc0a5179961a7b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780143.967674:0:17230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e521b2ec/0xc8fc0a5179961a7b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780143.967698:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787780143.967700:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787780143.967702:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787780143.967756:0:19055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787780143.967760:0:19055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e521b2ec/0xc8fc0a5179961a7b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787780143.968099:0:19055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787780143.968105:0:19055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000086ad9800/0xc8fc0a5179961a82 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780143.968113:0:19055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=551s v=(0 0) 00010000:00010000:2.0:1787780143.968116:0:19055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787780143.968120:0:19055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000086ad9800/0xc8fc0a5179961a82 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780143.968128:0:19055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000086ad9800/0xc8fc0a5179961a82 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780143.968135:0:19055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000086ad9800/0xc8fc0a5179961a82 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780143.968143:0:19055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000086ad9800/0xc8fc0a5179961a82 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780143.968213:0:18397:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787780143.968218:0:18397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000086ad9800/0xc8fc0a5179961a82 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780143.968226:0:18397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0444c19a00 already unused, calling callback (ffffffffc0d97420) 00010000:00010000:1.0:1787780143.968230:0:18397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000086ad9800/0xc8fc0a5179961a82 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780143.968238:0:18397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000086ad9800/0xc8fc0a5179961a82 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780143.968249:0:18397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000086ad9800/0xc8fc0a5179961a82 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780143.968257:0:18397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787780143.968258:0:18397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787780143.968260:0:18397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787780143.968334:0:19055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787780143.968338:0:19055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000086ad9800/0xc8fc0a5179961a82 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787780143.968623:0:19055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787780143.968630:0:19055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d671ad5/0xc8fc0a5179961a89 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780143.968639:0:19055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=551s v=(0 0) 00010000:00010000:2.0:1787780143.968642:0:19055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787780143.968647:0:19055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001d671ad5/0xc8fc0a5179961a89 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780143.968656:0:19055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001d671ad5/0xc8fc0a5179961a89 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780143.968668:0:19055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d671ad5/0xc8fc0a5179961a89 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780143.968674:0:17231:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787780143.968685:0:19055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001d671ad5/0xc8fc0a5179961a89 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780143.968696:0:19055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787780143.968707:0:17230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787780143.968712:0:17230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001d671ad5/0xc8fc0a5179961a89 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780143.968719:0:17230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0477868600 already unused, calling callback (ffffffffc0d97420) 00010000:00010000:1.0:1787780143.968729:0:17230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001d671ad5/0xc8fc0a5179961a89 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780143.968737:0:17230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001d671ad5/0xc8fc0a5179961a89 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780143.968748:0:17230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001d671ad5/0xc8fc0a5179961a89 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780143.968756:0:17230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001d671ad5/0xc8fc0a5179961a89 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780143.968769:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787780143.968771:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787780143.968773:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787780143.969616:0:19055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787780143.969624:0:19055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d5c9544/0xc8fc0a5179961a90 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780143.969639:0:19055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=551s v=(0 0) 00010000:00010000:2.0:1787780143.969643:0:19055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787780143.969647:0:19055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000d5c9544/0xc8fc0a5179961a90 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780143.969658:0:19055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000d5c9544/0xc8fc0a5179961a90 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780143.969666:0:19055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d5c9544/0xc8fc0a5179961a90 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780143.969673:0:19055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000d5c9544/0xc8fc0a5179961a90 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780143.969705:0:19055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787780143.969822:0:18397:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787780143.969827:0:18397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000d5c9544/0xc8fc0a5179961a90 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780143.969863:0:18397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0477869e00 already unused, calling callback (ffffffffc0d97420) 00010000:00010000:1.0:1787780143.969868:0:18397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000d5c9544/0xc8fc0a5179961a90 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780143.969878:0:18397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000d5c9544/0xc8fc0a5179961a90 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780143.969890:0:18397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000d5c9544/0xc8fc0a5179961a90 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780143.969905:0:18397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000d5c9544/0xc8fc0a5179961a90 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780143.969920:0:18397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787780143.969923:0:18397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787780143.969925:0:18397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787780143.970168:0:19055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787780143.970376:0:19055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000046497e02/0xc8fc0a5179961a97 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780143.970388:0:19055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=551s v=(0 0) 00010000:00010000:2.0:1787780143.970392:0:19055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787780143.970396:0:19055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000046497e02/0xc8fc0a5179961a97 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780143.970406:0:19055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000046497e02/0xc8fc0a5179961a97 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780143.970426:0:19055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000046497e02/0xc8fc0a5179961a97 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780143.970433:0:19055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000046497e02/0xc8fc0a5179961a97 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780143.970452:0:19055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787780143.970594:0:17231:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787780143.970599:0:17231:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000046497e02/0xc8fc0a5179961a97 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780143.970608:0:17231:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0477868a00 already unused, calling callback (ffffffffc0d97420) 00010000:00010000:1.0:1787780143.970612:0:17231:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000046497e02/0xc8fc0a5179961a97 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780143.970621:0:17231:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000046497e02/0xc8fc0a5179961a97 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780143.970633:0:17231:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000046497e02/0xc8fc0a5179961a97 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780143.970640:0:17231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000046497e02/0xc8fc0a5179961a97 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780143.970654:0:17231:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787780143.970656:0:17231:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787780143.970658:0:17231:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787780143.971397:0:19055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787780143.971404:0:19055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000443adca/0xc8fc0a5179961a9e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780143.971413:0:19055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=551s v=(0 0) 00010000:00010000:2.0:1787780143.971417:0:19055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787780143.971421:0:19055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000443adca/0xc8fc0a5179961a9e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780143.971430:0:19055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000443adca/0xc8fc0a5179961a9e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780143.971438:0:19055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000443adca/0xc8fc0a5179961a9e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780143.971445:0:19055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000443adca/0xc8fc0a5179961a9e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780143.971475:0:19055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787780143.971752:0:19055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787780143.971757:0:19055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000164ee716/0xc8fc0a5179961aa5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780143.971766:0:19055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=551s v=(0 0) 00010000:00010000:2.0:1787780143.971768:0:19055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787780143.971772:0:19055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000164ee716/0xc8fc0a5179961aa5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780143.971780:0:19055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000164ee716/0xc8fc0a5179961aa5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780143.971787:0:19055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000164ee716/0xc8fc0a5179961aa5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780143.971794:0:19055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000164ee716/0xc8fc0a5179961aa5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780143.971806:0:19055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1787780143.972088:0:19055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787780143.972094:0:19055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ed60ca7/0xc8fc0a5179961aac lrc: 3/0,1 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780143.972101:0:19055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=551s v=(0 0) 00010000:00010000:2.0:1787780143.972109:0:19055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787780143.972113:0:19055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ed60ca7/0xc8fc0a5179961aac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780143.972122:0:19055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ed60ca7/0xc8fc0a5179961aac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780143.972130:0:19055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ed60ca7/0xc8fc0a5179961aac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780143.972136:0:19055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ed60ca7/0xc8fc0a5179961aac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780143.972146:0:19055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1787780143.972363:0:19055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787780143.972369:0:19055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003ebef227/0xc8fc0a5179961ab3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780143.972377:0:19055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=551s v=(0 0) 00010000:00010000:2.0:1787780143.972380:0:19055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787780143.972384:0:19055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003ebef227/0xc8fc0a5179961ab3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780143.972392:0:19055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003ebef227/0xc8fc0a5179961ab3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780143.972399:0:19055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003ebef227/0xc8fc0a5179961ab3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780143.972412:0:19055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003ebef227/0xc8fc0a5179961ab3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780143.972420:0:19055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:1.0:1787780143.972653:0:17231:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1787780143.972660:0:17231:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000443adca/0xc8fc0a5179961a9e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780143.972668:0:17231:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0477868200 already unused, calling callback (ffffffffc0d97420) 00010000:00010000:1.0:1787780143.972672:0:17231:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000443adca/0xc8fc0a5179961a9e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780143.972689:0:17231:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000443adca/0xc8fc0a5179961a9e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780143.972703:0:17231:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000443adca/0xc8fc0a5179961a9e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780143.972710:0:17231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000443adca/0xc8fc0a5179961a9e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780143.972728:0:17231:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787780143.972731:0:17231:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000164ee716/0xc8fc0a5179961aa5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780143.972738:0:17231:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0477869800 already unused, calling callback (ffffffffc0d97420) 00010000:00010000:1.0:1787780143.972741:0:17231:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000164ee716/0xc8fc0a5179961aa5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780143.972748:0:17231:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000164ee716/0xc8fc0a5179961aa5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780143.972772:0:17231:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000164ee716/0xc8fc0a5179961aa5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780143.972779:0:17231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000164ee716/0xc8fc0a5179961aa5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780143.972791:0:17231:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787780143.972795:0:17231:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ed60ca7/0xc8fc0a5179961aac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780143.972800:0:17231:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0477869a00 already unused, calling callback (ffffffffc0d97420) 00010000:00010000:1.0:1787780143.972804:0:17231:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ed60ca7/0xc8fc0a5179961aac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780143.972811:0:17231:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ed60ca7/0xc8fc0a5179961aac lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780143.972820:0:17231:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ed60ca7/0xc8fc0a5179961aac lrc: 1/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780143.972827:0:17231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ed60ca7/0xc8fc0a5179961aac lrc: 0/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780143.972855:0:17231:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787780143.972858:0:17231:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003ebef227/0xc8fc0a5179961ab3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780143.972871:0:17231:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0477868800 already unused, calling callback (ffffffffc0d97420) 00010000:00010000:1.0:1787780143.972874:0:17231:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003ebef227/0xc8fc0a5179961ab3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780143.972882:0:17231:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003ebef227/0xc8fc0a5179961ab3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780143.972892:0:17231:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003ebef227/0xc8fc0a5179961ab3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780143.972900:0:17231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003ebef227/0xc8fc0a5179961ab3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780143.972912:0:17231:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787780143.972914:0:17231:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787780143.972915:0:17231:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787780143.973135:0:19055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787780143.973140:0:19055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000622593a2/0xc8fc0a5179961aba lrc: 3/0,1 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780143.973149:0:19055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=551s v=(0 0) 00010000:00010000:2.0:1787780143.973153:0:19055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787780143.973157:0:19055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000622593a2/0xc8fc0a5179961aba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780143.973167:0:19055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000622593a2/0xc8fc0a5179961aba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780143.973175:0:19055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000622593a2/0xc8fc0a5179961aba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780143.973183:0:19055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000622593a2/0xc8fc0a5179961aba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780143.973195:0:19055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787780143.973422:0:17230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787780143.973428:0:17230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000622593a2/0xc8fc0a5179961aba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780143.973437:0:17230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0477868000 already unused, calling callback (ffffffffc0d97420) 00010000:00010000:1.0:1787780143.973441:0:17230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000622593a2/0xc8fc0a5179961aba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780143.973449:0:17230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000622593a2/0xc8fc0a5179961aba lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780143.973468:0:17230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000622593a2/0xc8fc0a5179961aba lrc: 1/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780143.973476:0:17230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000622593a2/0xc8fc0a5179961aba lrc: 0/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780143.973488:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787780143.973491:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787780143.973492:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787780143.973499:0:18397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787780143.973503:0:17231:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787780143.973909:0:19055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787780143.973915:0:19055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a424796/0xc8fc0a5179961ac1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780143.974144:0:19055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=551s v=(0 0) 00010000:00010000:2.0:1787780143.974148:0:19055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787780143.974152:0:19055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a424796/0xc8fc0a5179961ac1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780143.974162:0:19055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a424796/0xc8fc0a5179961ac1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780143.974170:0:19055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a424796/0xc8fc0a5179961ac1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780143.974177:0:19055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007a424796/0xc8fc0a5179961ac1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780143.974197:0:19055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787780143.975060:0:17230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787780143.975068:0:17230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007a424796/0xc8fc0a5179961ac1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780143.975077:0:17230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0477869200 already unused, calling callback (ffffffffc0d97420) 00010000:00010000:0.0:1787780143.975082:0:17230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007a424796/0xc8fc0a5179961ac1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780143.975091:0:17230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007a424796/0xc8fc0a5179961ac1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780143.975106:0:17230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007a424796/0xc8fc0a5179961ac1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780143.975118:0:17230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a424796/0xc8fc0a5179961ac1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787780143.975251:0:19055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787780143.975258:0:19055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd4d065d/0xc8fc0a5179961ac8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780143.975268:0:19055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=551s v=(0 0) 00010000:00010000:2.0:1787780143.975272:0:19055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787780143.975277:0:19055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cd4d065d/0xc8fc0a5179961ac8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780143.975287:0:19055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cd4d065d/0xc8fc0a5179961ac8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780143.975306:0:19055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd4d065d/0xc8fc0a5179961ac8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780143.975313:0:19055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cd4d065d/0xc8fc0a5179961ac8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780143.975330:0:19055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787780143.975339:0:18397:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787780143.975344:0:18397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cd4d065d/0xc8fc0a5179961ac8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780143.975351:0:18397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0477868c00 already unused, calling callback (ffffffffc0d97420) 00010000:00010000:0.0:1787780143.975483:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787780143.975486:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787780143.975489:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787780143.975514:0:18397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd4d065d/0xc8fc0a5179961ac8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780143.975523:0:18397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd4d065d/0xc8fc0a5179961ac8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780143.975535:0:18397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cd4d065d/0xc8fc0a5179961ac8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780143.975542:0:18397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cd4d065d/0xc8fc0a5179961ac8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780143.975556:0:18397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787780143.975564:0:18397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787780143.975566:0:18397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787780143.976272:0:19055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787780143.976279:0:19055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd392458/0xc8fc0a5179961acf lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780143.976290:0:19055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=551s v=(0 0) 00010000:00010000:2.0:1787780143.976294:0:19055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787780143.976299:0:19055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cd392458/0xc8fc0a5179961acf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780143.976309:0:19055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cd392458/0xc8fc0a5179961acf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780143.976318:0:19055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd392458/0xc8fc0a5179961acf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780143.976325:0:19055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cd392458/0xc8fc0a5179961acf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780143.976394:0:19055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787780143.976897:0:19055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787780143.976904:0:19055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000748c3687/0xc8fc0a5179961ad6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780143.976913:0:19055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=551s v=(0 0) 00010000:00010000:2.0:1787780143.976917:0:19055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787780143.976921:0:19055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000748c3687/0xc8fc0a5179961ad6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780143.976989:0:19055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000748c3687/0xc8fc0a5179961ad6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780143.976998:0:19055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000748c3687/0xc8fc0a5179961ad6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780143.977005:0:19055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000748c3687/0xc8fc0a5179961ad6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780143.977080:0:17231:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787780143.977087:0:17231:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cd392458/0xc8fc0a5179961acf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780143.977094:0:17231:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0477869400 already unused, calling callback (ffffffffc0d97420) 00010000:00010000:1.0:1787780143.977098:0:17231:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd392458/0xc8fc0a5179961acf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780143.977106:0:17231:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd392458/0xc8fc0a5179961acf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780143.977119:0:17231:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cd392458/0xc8fc0a5179961acf lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780143.977127:0:17231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cd392458/0xc8fc0a5179961acf lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780143.977152:0:17231:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787780143.977155:0:17231:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000748c3687/0xc8fc0a5179961ad6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780143.977162:0:17231:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0477869c00 already unused, calling callback (ffffffffc0d97420) 00010000:00010000:1.0:1787780143.977165:0:17231:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000748c3687/0xc8fc0a5179961ad6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780143.977172:0:17231:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000748c3687/0xc8fc0a5179961ad6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780143.977181:0:17231:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000748c3687/0xc8fc0a5179961ad6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780143.977189:0:17231:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787780143.977191:0:17231:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787780143.977193:0:17231:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787780143.977264:0:19055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787780143.977269:0:19055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000748c3687/0xc8fc0a5179961ad6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780143.977333:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787780143.977635:0:19055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787780143.977736:0:19055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000091228ed4/0xc8fc0a5179961add lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780143.977746:0:19055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=551s v=(0 0) 00010000:00010000:2.0:1787780143.977749:0:19055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787780143.977753:0:19055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000091228ed4/0xc8fc0a5179961add lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780143.977761:0:19055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000091228ed4/0xc8fc0a5179961add lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780143.977782:0:19055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000091228ed4/0xc8fc0a5179961add lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780143.977789:0:19055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000091228ed4/0xc8fc0a5179961add lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780143.977857:0:19055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787780143.977901:0:18397:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787780143.977907:0:18397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000091228ed4/0xc8fc0a5179961add lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780143.977915:0:18397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0477869600 already unused, calling callback (ffffffffc0d97420) 00010000:00010000:1.0:1787780143.977918:0:18397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000091228ed4/0xc8fc0a5179961add lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780143.977938:0:18397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000091228ed4/0xc8fc0a5179961add lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780143.977950:0:18397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000091228ed4/0xc8fc0a5179961add lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780143.977958:0:18397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000091228ed4/0xc8fc0a5179961add lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780143.977973:0:18397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787780143.977975:0:18397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787780143.977977:0:18397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787780143.978154:0:19055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787780143.978159:0:19055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8d3477e/0xc8fc0a5179961ae4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780143.978168:0:19055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=551s v=(0 0) 00010000:00010000:2.0:1787780143.978171:0:19055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787780143.978175:0:19055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d8d3477e/0xc8fc0a5179961ae4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780143.978185:0:19055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d8d3477e/0xc8fc0a5179961ae4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780143.978192:0:19055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8d3477e/0xc8fc0a5179961ae4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780143.978199:0:19055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d8d3477e/0xc8fc0a5179961ae4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780143.978232:0:19055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787780143.978261:0:17231:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787780143.978266:0:17231:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d8d3477e/0xc8fc0a5179961ae4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780143.978273:0:17231:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0477869000 already unused, calling callback (ffffffffc0d97420) 00010000:00010000:1.0:1787780143.978276:0:17231:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8d3477e/0xc8fc0a5179961ae4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780143.978285:0:17231:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8d3477e/0xc8fc0a5179961ae4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780143.978553:0:17231:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d8d3477e/0xc8fc0a5179961ae4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780143.978573:0:17231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d8d3477e/0xc8fc0a5179961ae4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780143.978589:0:17231:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787780143.978591:0:17231:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787780143.978592:0:17231:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787780143.978705:0:19055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787780143.978710:0:19055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000064595807/0xc8fc0a5179961aeb lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780143.978718:0:19055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=551s v=(0 0) 00010000:00010000:2.0:1787780143.978722:0:19055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787780143.978726:0:19055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000064595807/0xc8fc0a5179961aeb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780143.978734:0:19055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000064595807/0xc8fc0a5179961aeb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780143.978741:0:19055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000064595807/0xc8fc0a5179961aeb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780143.978748:0:19055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000064595807/0xc8fc0a5179961aeb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780143.978800:0:19055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787780143.979137:0:19055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787780143.979144:0:19055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016b576fc/0xc8fc0a5179961af2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780143.979152:0:19055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=551s v=(0 0) 00010000:00010000:2.0:1787780143.979169:0:19055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787780143.979174:0:19055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016b576fc/0xc8fc0a5179961af2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780143.979185:0:19055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016b576fc/0xc8fc0a5179961af2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780143.979197:0:19055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016b576fc/0xc8fc0a5179961af2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780143.979204:0:19055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000016b576fc/0xc8fc0a5179961af2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780143.979257:0:17230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787780143.979263:0:17230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000064595807/0xc8fc0a5179961aeb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780143.979271:0:17230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0477868400 already unused, calling callback (ffffffffc0d97420) 00010000:00010000:1.0:1787780143.979275:0:17230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000064595807/0xc8fc0a5179961aeb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780143.979284:0:17230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000064595807/0xc8fc0a5179961aeb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780143.979522:0:17230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000064595807/0xc8fc0a5179961aeb lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780143.979533:0:17230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000064595807/0xc8fc0a5179961aeb lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780143.979550:0:17230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787780143.979553:0:17230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000016b576fc/0xc8fc0a5179961af2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780143.979566:0:17230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0477868e00 already unused, calling callback (ffffffffc0d97420) 00010000:00010000:1.0:1787780143.979570:0:17230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000016b576fc/0xc8fc0a5179961af2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780143.979577:0:17230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000016b576fc/0xc8fc0a5179961af2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780143.979594:0:17230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000016b576fc/0xc8fc0a5179961af2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780143.979604:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787780143.979605:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787780143.979607:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787780143.979705:0:19055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787780143.979711:0:19055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016b576fc/0xc8fc0a5179961af2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787780143.980121:0:19055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787780143.980127:0:19055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000086ad9800/0xc8fc0a5179961af9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780143.980137:0:19055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=551s v=(0 0) 00010000:00010000:2.0:1787780143.980140:0:19055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787780143.980145:0:19055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000086ad9800/0xc8fc0a5179961af9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780143.980154:0:19055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000086ad9800/0xc8fc0a5179961af9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780143.980168:0:19055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000086ad9800/0xc8fc0a5179961af9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780143.980183:0:19055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000086ad9800/0xc8fc0a5179961af9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780143.980258:0:18397:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787780143.980263:0:18397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000086ad9800/0xc8fc0a5179961af9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780143.980271:0:18397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0444c19a00 already unused, calling callback (ffffffffc0d97420) 00010000:00010000:1.0:1787780143.980275:0:18397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000086ad9800/0xc8fc0a5179961af9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780143.980283:0:18397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000086ad9800/0xc8fc0a5179961af9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780143.980295:0:18397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000086ad9800/0xc8fc0a5179961af9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780143.980309:0:18397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787780143.980311:0:18397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787780143.980314:0:18397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787780143.980375:0:19055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787780143.980389:0:19055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000086ad9800/0xc8fc0a5179961af9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787780143.980772:0:19055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787780143.980778:0:19055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e521b2ec/0xc8fc0a5179961b00 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780143.980787:0:19055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=551s v=(0 0) 00010000:00010000:2.0:1787780143.980791:0:19055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787780143.980795:0:19055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e521b2ec/0xc8fc0a5179961b00 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780143.980805:0:19055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e521b2ec/0xc8fc0a5179961b00 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780143.980813:0:19055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e521b2ec/0xc8fc0a5179961b00 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780143.980830:0:19055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e521b2ec/0xc8fc0a5179961b00 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780143.980891:0:17231:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787780143.980897:0:17231:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e521b2ec/0xc8fc0a5179961b00 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780143.980905:0:17231:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0444c19000 already unused, calling callback (ffffffffc0d97420) 00010000:00010000:1.0:1787780143.980909:0:17231:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e521b2ec/0xc8fc0a5179961b00 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780143.980970:0:17231:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e521b2ec/0xc8fc0a5179961b00 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780143.980985:0:17231:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e521b2ec/0xc8fc0a5179961b00 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780143.980998:0:17231:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787780143.981000:0:17231:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787780143.981003:0:17231:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787780143.981070:0:19055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787780143.981076:0:19055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e521b2ec/0xc8fc0a5179961b00 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787780143.981351:0:19055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787780143.981356:0:19055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6bb400f/0xc8fc0a5179961b07 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780143.981366:0:19055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=551s v=(0 0) 00010000:00010000:2.0:1787780143.981369:0:19055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787780143.981374:0:19055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6bb400f/0xc8fc0a5179961b07 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780143.981394:0:19055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6bb400f/0xc8fc0a5179961b07 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780143.981404:0:19055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6bb400f/0xc8fc0a5179961b07 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780143.981411:0:19055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a6bb400f/0xc8fc0a5179961b07 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780143.981485:0:17230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787780143.981491:0:17230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a6bb400f/0xc8fc0a5179961b07 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780143.981499:0:17230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0477a71000 already unused, calling callback (ffffffffc0d97420) 00010000:00010000:1.0:1787780143.981502:0:17230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6bb400f/0xc8fc0a5179961b07 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780143.981517:0:17230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6bb400f/0xc8fc0a5179961b07 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780143.981528:0:17230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a6bb400f/0xc8fc0a5179961b07 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780143.981537:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787780143.981539:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787780143.981540:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787780143.981598:0:19055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787780143.981603:0:19055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6bb400f/0xc8fc0a5179961b07 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1787780143.981652:0:19055:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:5 00000100:00100000:2.0:1787780143.981756:0:19055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346cff840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17267:x1874622881671552:12345-0@lo:5:osp-pre-0-0.0 Request processed in 43679us (51835us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780143.981767:0:19055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787780143.981793:0:17267:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346cfda40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17267:1874622881671552:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1787780143.981810:0:17267:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x21:0x0] from OST, last_created [0x280000401:0x21:0x0]last_used is [0x280000401:0x5:0x0] 00010000:00010000:1.0:1787780143.981818:0:18397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787780143.981875:0:17267:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346cfda40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17267:1874622881671680:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1787780143.981912:0:17267:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787780143.981944:0:17267:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c04429a8e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787780143.981952:0:18751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881671680 00000100:00100000:2.0:1787780143.981959:0:18751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881671680 00000100:00100000:2.0:1787780143.982007:0:18751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787780143.982017:0:18751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346cfcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17267:x1874622881671680:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1787780143.982051:0:18751:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 34 00000001:00080000:2.0:1787780143.989463:0:18745:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:2.0:1787780143.989507:0:18745:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1787780143.989659:0:18751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346cfcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:17267:x1874622881671680:12345-0@lo:5:osp-pre-0-0.0 Request processed in 7639us (7742us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1787780143.989670:0:18751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787780143.989756:0:17267:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1787780143.989763:0:17267:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346cfda40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17267:1874622881671680:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1787780143.989777:0:17267:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x21:0x0]-[0x280000401:0x41:0x0] 00010000:00010000:1.0:1787780144.477166:0:17231:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787780144.517226:0:19115:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg331-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000020:00000004:1.0:1787780145.326111:0:19167:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787780145.326347:0:19167:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787780145.499976:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787780145.820588:0:17278:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787780145.949775:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787780145.949799:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348a0a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881671808:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787780145.949883:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780145.952059:0:17248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881671808 00000100:00100000:1.0:1787780145.952072:0:17248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881671808 00000100:00100000:1.0:1787780145.952133:0:17248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787780145.952143:0:17248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347fa83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881671808:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787780145.952192:0:17248:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1787780145.952269:0:17248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347fa83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881671808:12345-0@lo:41:osp-pre-0-1.0 Request processed in 127us (2385us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780145.952276:0:17248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787780145.952326:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348a0a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881671808:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787780145.952506:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787780145.952521:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346da7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881671936:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787780145.952562:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780145.953008:0:17247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881671936 00000100:00100000:3.0:1787780145.953067:0:17247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881671936 00000100:00100000:3.0:1787780145.953117:0:17247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787780145.953124:0:17247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346cfcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881671936:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787780145.953143:0:17247:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787780145.953186:0:17247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346cfcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881671936:12345-0@lo:41:osp-pre-1-0.0 Request processed in 62us (624us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780145.953192:0:17247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787780145.953251:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346da7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881671936:0@lo:41:osp-pre-1-0.0 00000020:00000004:1.0:1787780146.072817:0:19217:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787780146.073036:0:19217:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787780146.524334:0:18397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787780147.558950:0:17231:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787780147.938313:0:17994:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787780148.572599:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787780149.020041:0:2253:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787780149.020048:0:2253:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787780149.020052:0:2253:0:(import.c:65:import_set_state_nolock()) ffff9c044963b000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787780149.020059:0:2253:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 551 00000100:00080000:1.0:1787780149.020064:0:2253:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1787780149.020071:0:2253:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9c044963b000 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:1.0:1787780149.020107:0:2253:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c0347faa940 x1874622881672448/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787780149.020148:0:2253:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787780149.020152:0:2253:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787780149.020155:0:2253:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787780149.020158:0:2253:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787780149.020193:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347fa8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874622881672576:0@lo:400:kworker.0 00000100:00100000:1.0:1787780149.020261:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780149.020310:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347fa9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1874622881673088:0@lo:400:kworker.0 00000100:00100000:1.0:1787780149.020350:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780149.020378:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787780149.020384:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347fa8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881672320:0@lo:400:kworker.0 00000100:00100000:1.0:1787780149.020406:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780149.020429:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347fa9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1874622881672960:0@lo:400:kworker.0 00000100:00100000:1.0:1787780149.020448:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780149.020481:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347faa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1874622881672448:0@lo:8:kworker.0 00000100:00100000:1.0:1787780149.020503:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780149.020534:0:17243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881672576 00000100:00100000:1.0:1787780149.020540:0:17243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881672576 00000100:00100000:1.0:1787780149.020573:0:17243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881673088 00000100:00100000:1.0:1787780149.020576:0:17243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881673088 00000100:00100000:1.0:1787780149.020595:0:17243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881672960 00000100:00100000:1.0:1787780149.020598:0:17243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881672960 00000100:00100000:1.0:1787780149.020612:0:17243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787780149.020620:0:17243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347fa9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874622881672576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787780149.020678:0:17243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347fa9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874622881672576:12345-0@lo:400:kworker.0 Request processed in 58us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780149.020685:0:17243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787780149.020702:0:17243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787780149.020708:0:17243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347fab840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874622881673088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787780149.020735:0:17243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347fab840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874622881673088:12345-0@lo:400:kworker.0 Request processed in 27us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780149.020740:0:17243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787780149.020750:0:17243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787780149.020755:0:17243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0461befc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1874622881672960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787780149.020792:0:17243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0461befc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1874622881672960:12345-0@lo:400:kworker.0 Request processed in 36us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780149.020798:0:17243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787780149.020819:0:18750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881672320 00000100:00100000:1.0:1787780149.020822:0:18750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881672320 00000100:00100000:1.0:1787780149.020870:0:18750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881672448 00000100:00100000:1.0:1787780149.020874:0:18750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881672448 00000100:00100000:1.0:1787780149.020888:0:18750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787780149.020895:0:18750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347fab0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881672320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787780149.020924:0:18750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347fab0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881672320:12345-0@lo:400:kworker.0 Request processed in 30us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780149.020929:0:18750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787780149.020943:0:18750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787780149.020946:0:18750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0461beed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3640:x1874622881672448:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1787780149.020964:0:18750:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787780149.020992:0:18750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0461beed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3640:x1874622881672448:12345-0@lo:8:kworker.0 Request processed in 44us (489us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787780149.020998:0:18750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:1.0:1787780149.021022:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9c044963b000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787780149.021026:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787780149.021030:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347faa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1874622881672448:0@lo:8:kworker.0 00000100:00100000:1.0:1787780149.021054:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347fa8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881672320:0@lo:400:kworker.0 00010000:00080000:1.0:1787780149.021064:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0347fa9e00 x1874622881672960/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787780165 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787780149.021073:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347fa9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1874622881672960:0@lo:400:kworker.0 00010000:00080000:1.0:1787780149.021092:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0347fa8f00 x1874622881672576/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787780165 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787780149.021100:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347fa8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874622881672576:0@lo:400:kworker.0 00010000:00080000:1.0:1787780149.021108:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0347fa9680 x1874622881673088/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787780165 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787780149.021116:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347fa9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1874622881673088:0@lo:400:kworker.0 00000100:00100000:0.0:1787780149.021719:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347fab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:3641:1874622881672064:0@lo:400:kworker.0 00000100:00100000:0.0:1787780149.021755:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787780149.021778:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347faa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881672704:0@lo:400:kworker.0 00000100:00100000:0.0:1787780149.021798:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787780149.021815:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787780149.021820:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347faad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881672192:0@lo:400:kworker.0 00000100:00100000:0.0:1787780149.021854:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787780149.021871:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347faa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874622881672832:0@lo:400:kworker.0 00000100:00100000:0.0:1787780149.021904:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787780149.021933:0:17238:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787780149.021937:0:17238:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787780149.021945:0:17238:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787780149.022081:0:17247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881672704 00000100:00100000:1.0:1787780149.022086:0:17247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881672704 00000100:00100000:1.0:1787780149.022123:0:17247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881672192 00000100:00100000:1.0:1787780149.022125:0:17247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881672192 00000100:00100000:1.0:1787780149.022136:0:17247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787780149.025058:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881672832 00000100:00100000:2.0:1787780149.025070:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881672832 00000100:00100000:2.0:1787780149.025132:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787780149.025151:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346cfda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874622881672832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787780149.025231:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346cfda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874622881672832:12345-0@lo:400:kworker.0 Request processed in 90us (3325us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780149.025248:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787780149.027830:0:17247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346cfde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881672704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787780149.027928:0:17247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346cfde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881672704:12345-0@lo:400:kworker.0 Request processed in 114us (6128us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780149.033311:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0461bef0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881673216:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787780149.033390:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1787780149.033451:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0347faa1c0 x1874622881672832/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787780165 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787780149.033466:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347faa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874622881672832:0@lo:400:kworker.0 00000100:00100000:0.0:1787780149.033483:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347faa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881672704:0@lo:400:kworker.0 00000100:00100000:0.0:1787780149.033574:0:18752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881673216 00000100:00100000:0.0:1787780149.033581:0:18752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881673216 00000100:00100000:0.0:1787780149.033627:0:18752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787780149.033636:0:18752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346cffc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874622881673216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787780149.034113:0:18752:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1787780149.034237:0:17248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787780149.034250:0:17248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346cfc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874622881672192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787780149.034304:0:17248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346cfc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874622881672192:12345-0@lo:400:kworker.0 Request processed in 58us (12465us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780149.034311:0:17248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787780149.034340:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881672064 00000100:00100000:2.0:1787780149.034345:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881672064 00000100:00100000:2.0:1787780149.034372:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787780149.034378:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0478637c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+21:3641:x1874622881672064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787780149.034409:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0478637c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+21:3641:x1874622881672064:12345-0@lo:400:kworker.0 Request processed in 32us (12654us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780149.034415:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787780149.035058:0:18752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346cffc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874622881673216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1421us (1666us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780149.035068:0:18752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787780149.035132:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0461bef0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881673216:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787780149.035828:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347faad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881672192:0@lo:400:kworker.0 00000100:00100000:0.0:1787780149.035858:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347fab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:3641:1874622881672064:0@lo:400:kworker.0 00000100:00100000:1.0:1787780149.037087:0:17247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00010000:2.0:1787780149.597866:0:18397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787780150.044061:0:3640:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787780135/real 1787780135] req@ffff9c03488e30c0 x1874622881665024/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787780150 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787780150.044091:0:3640:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c03488e30c0 x1874622881665024/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787780150 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787780150.044100:0:3640:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787780135/real 1787780135] req@ffff9c03488e1e00 x1874622881665152/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787780150 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787780150.044110:0:3640:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c03488e1e00 x1874622881665152/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787780150 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787780150.044128:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9c0345e54800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787780150.044168:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787780150.044173:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c03488e30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1874622881665024:0@lo:8:kworker.0 00000100:00080000:1.0:1787780150.044179:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9c0446172800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787780150.044184:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787780150.044186:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c03488e1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1874622881665152:0@lo:8:kworker.0 00000100:00080000:0.0:1787780150.044339:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787780150.044343:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787780150.044346:0:8:0:(import.c:65:import_set_state_nolock()) ffff9c044963b000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787780150.044352:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 557 00000100:00080000:0.0:1787780150.044355:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1787780150.044369:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9c044963b000 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:0.0:1787780150.044398:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c03489f4b40 x1874622881673728/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787780150.044422:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787780150.044425:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1787780150.044426:0:8:0:(import.c:65:import_set_state_nolock()) ffff9c0345e54800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787780150.044429:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 543 00000100:00080000:0.0:1787780150.044432:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1787780150.044436:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9c0345e54800 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:0.0:1787780150.044445:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c03489f6d00 x1874622881674112/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787780150.044453:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787780150.044455:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787780150.044457:0:8:0:(import.c:65:import_set_state_nolock()) ffff9c0446172800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787780150.044460:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 543 00000100:00080000:0.0:1787780150.044474:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1787780150.044478:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9c0446172800 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:0.0:1787780150.044488:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c03489f6940 x1874622881674240/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787780150.044525:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346cfc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881673472:0@lo:400:kworker.0 00000100:00100000:0.0:1787780150.044630:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787780150.044671:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c03489f7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874622881674368:0@lo:400:kworker.0 00000100:00100000:0.0:1787780150.044695:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787780150.044730:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787780150.044736:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0458b89680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881673600:0@lo:400:kworker.0 00000100:00100000:0.0:1787780150.044769:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787780150.044786:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c03489f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1874622881674496:0@lo:400:kworker.0 00000100:00100000:0.0:1787780150.044806:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787780150.044880:0:17248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881673472 00000100:00100000:0.0:1787780150.044887:0:17248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881673472 00000100:00100000:0.0:1787780150.044930:0:17248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787780150.044938:0:17248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03489f7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881673472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787780150.044989:0:17248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03489f7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881673472:12345-0@lo:400:kworker.0 Request processed in 50us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780150.044996:0:17248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787780150.045020:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881674368 00000100:00100000:0.0:1787780150.045023:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881674368 00000100:00100000:0.0:1787780150.045047:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881674496 00000100:00100000:0.0:1787780150.045050:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881674496 00000100:00100000:0.0:1787780150.045064:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787780150.045070:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03489f5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1874622881674368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787780150.045100:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03489f5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1874622881674368:12345-0@lo:400:kworker.0 Request processed in 30us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780150.045106:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787780150.045117:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787780150.045123:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03489f52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1874622881674496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787780150.045148:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03489f52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1874622881674496:12345-0@lo:400:kworker.0 Request processed in 26us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780150.045153:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:0.0:1787780150.045195:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c03489f7480 x1874622881674496/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787780166 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787780150.045219:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c03489f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1874622881674496:0@lo:400:kworker.0 00000100:00100000:0.0:1787780150.045230:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346cfc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881673472:0@lo:400:kworker.0 00010000:00080000:0.0:1787780150.045238:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c03489f7840 x1874622881674368/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787780166 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787780150.045245:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c03489f7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874622881674368:0@lo:400:kworker.0 00000100:00100000:1.0:1787780150.045474:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346cff0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:3642:1874622881673344:0@lo:400:kworker.0 00000100:00100000:1.0:1787780150.045507:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780150.045542:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c03489f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874622881673984:0@lo:400:kworker.0 00000100:00100000:1.0:1787780150.045564:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780150.045584:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787780150.045590:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c03489f5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1874622881673856:0@lo:400:kworker.0 00000100:00100000:1.0:1787780150.045615:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780150.045632:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c03489f70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1874622881674624:0@lo:400:kworker.0 00000100:00100000:1.0:1787780150.045664:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780150.045692:0:18750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881673600 00000100:00100000:1.0:1787780150.045695:0:18750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881673600 00000100:00100000:1.0:1787780150.045725:0:18750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787780150.045731:0:18750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03489f5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881673600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787780150.045766:0:18750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03489f5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881673600:12345-0@lo:400:kworker.0 Request processed in 35us (996us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780150.045773:0:18750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787780150.045790:0:17247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881673984 00000100:00100000:1.0:1787780150.045793:0:17247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881673984 00000100:00100000:1.0:1787780150.045816:0:17247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787780150.045822:0:17247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0461bee1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1874622881673984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787780150.045988:0:17247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0461bee1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1874622881673984:12345-0@lo:400:kworker.0 Request processed in 166us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780150.045996:0:17247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787780150.046013:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881673856 00000100:00100000:1.0:1787780150.046016:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881673856 00000100:00100000:1.0:1787780150.046036:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881674624 00000100:00100000:1.0:1787780150.046039:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881674624 00000100:00100000:1.0:1787780150.046052:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787780150.046057:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0461bef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1874622881673856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787780150.046086:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0461bef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1874622881673856:12345-0@lo:400:kworker.0 Request processed in 28us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780150.046091:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787780150.046104:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787780150.046109:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0461beda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1874622881674624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787780150.046134:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0461beda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1874622881674624:12345-0@lo:400:kworker.0 Request processed in 25us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780150.046139:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787780150.046171:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0458b89680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881673600:0@lo:400:kworker.0 00000100:00100000:1.0:1787780150.046194:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c03489f4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1874622881673728:0@lo:8:kworker.0 00000100:00100000:1.0:1787780150.046217:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780150.046235:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c03489f6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1874622881674112:0@lo:8:kworker.0 00000100:00100000:1.0:1787780150.046259:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780150.046280:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c03489f6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1874622881674240:0@lo:8:kworker.0 00000100:00100000:1.0:1787780150.046300:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780150.046326:0:18751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881673728 00000100:00100000:1.0:1787780150.046336:0:18751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881673728 00000100:00100000:1.0:1787780150.046353:0:18751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881674112 00000100:00100000:1.0:1787780150.046355:0:18751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881674112 00000100:00100000:1.0:1787780150.046360:0:18751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881674240 00000100:00100000:1.0:1787780150.046362:0:18751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881674240 00000100:00100000:1.0:1787780150.046371:0:18751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787780150.046375:0:18751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0461bec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3640:x1874622881673728:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1787780150.046392:0:18751:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787780150.046425:0:18751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0461bec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3640:x1874622881673728:12345-0@lo:8:kworker.0 Request processed in 48us (207us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787780150.046430:0:18751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787780150.046442:0:18751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787780150.046446:0:18751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0461bee940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3640:x1874622881674112:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1787780150.046557:0:17237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881673344 00000100:00100000:0.0:1787780150.046562:0:17237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881673344 00000100:00100000:0.0:1787780150.046592:0:17237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787780150.046599:0:17237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0478636850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+21:3642:x1874622881673344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787780150.046632:0:17237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0478636850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+21:3642:x1874622881673344:12345-0@lo:400:kworker.0 Request processed in 33us (1124us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780150.046651:0:17237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1787780150.047390:0:19055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787780150.047398:0:19055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0461bed2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3640:x1874622881674240:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1787780150.047413:0:19055:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787780150.047448:0:19055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0461bed2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3640:x1874622881674240:12345-0@lo:8:kworker.0 Request processed in 50us (1147us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787780150.047454:0:19055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:1.0:1787780150.048052:0:18751:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 558 last 0 00000020:00000080:1.0:1787780150.048081:0:18751:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xc8fc0a5179961b0e 00002000:00100000:1.0:1787780150.048095:0:18751:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9c0477820800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113939 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:1.0:1787780150.048099:0:18751:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:1.0:1787780150.048102:0:18751:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1787780150.048172:0:18751:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:1.0:1787780150.048197:0:18751:0:(import.c:65:import_set_state_nolock()) ffff9c046eecd800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787780150.048247:0:18751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0461bee940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3640:x1874622881674112:12345-0@lo:8:kworker.0 Request processed in 1799us (1987us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780150.048255:0:18751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1787780150.050490:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c03489f5680 x1874622881673856/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787780166 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787780150.050508:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c03489f5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1874622881673856:0@lo:400:kworker.0 00010000:00080000:2.0:1787780150.050521:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c03489f70c0 x1874622881674624/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787780166 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787780150.050538:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c03489f70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1874622881674624:0@lo:400:kworker.0 00000100:00100000:2.0:1787780150.050551:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346cff0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:3642:1874622881673344:0@lo:400:kworker.0 00000100:00100000:2.0:1787780150.050562:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c03489f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874622881673984:0@lo:400:kworker.0 00000100:00080000:0.0:1787780150.050949:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9c044963b000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787780150.050956:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787780150.050960:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c03489f4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1874622881673728:0@lo:8:kworker.0 00000100:00100000:0.0:1787780150.050976:0:3640:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787780150.050985:0:3640:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 2 00000100:00080000:0.0:1787780150.050992:0:3640:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1787780150.050998:0:3640:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1787780150.051001:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9c0345e54800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1787780150.051012:0:3640:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1787780150.051017:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c03489f6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1874622881674112:0@lo:8:kworker.0 00000100:00080000:0.0:1787780150.051047:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9c0446172800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787780150.051056:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787780150.051060:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c03489f6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1874622881674240:0@lo:8:kworker.0 00000004:00080000:0.0:1787780150.051119:0:17983:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:0.0:1787780150.051140:0:17983:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c03489f6d00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17983:1874622881674880:0@lo:7:osp-pre-0-1.0 00000100:00100000:0.0:1787780150.051192:0:17983:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787780150.051218:0:17983:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0347c50c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787780150.051236:0:19055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881674880 00000100:00100000:0.0:1787780150.051241:0:19055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881674880 00000100:00100000:0.0:1787780150.051290:0:19055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787780150.051299:0:19055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03489f4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17983:x1874622881674880:12345-0@lo:7:osp-pre-0-1.0 00000100:00080000:0.0:1787780150.053268:0:17238:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1787780150.055038:0:17982:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1787780150.055123:0:17982:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 558059283601ns, next at 0ns, rc = 0 00080000:00080000:0.0:1787780150.055131:0:17982:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00002000:00080000:0.0:1787780150.055154:0:19055:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:0.0:1787780150.055160:0:19055:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x21:0x0] 00000100:00100000:0.0:1787780150.055237:0:19055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03489f4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17983:x1874622881674880:12345-0@lo:7:osp-pre-0-1.0 Request processed in 3936us (4041us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780150.055246:0:19055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787780150.055299:0:17983:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c03489f6d00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17983:1874622881674880:0@lo:7:osp-pre-0-1.0 00000004:00080000:0.0:1787780150.055312:0:17983:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x21:0x0] 00000100:00100000:0.0:1787780150.055350:0:17983:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c03489f6d00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17983:1874622881675008:0@lo:5:osp-pre-0-1.0 00000100:00100000:0.0:1787780150.055383:0:17983:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787780150.055404:0:17983:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0347c50c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787780150.055598:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787780150.056878:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c03489f6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881674752:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787780150.057109:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780150.057189:0:18752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881674752 00000100:00100000:3.0:1787780150.057195:0:18752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881674752 00000100:00100000:3.0:1787780150.057240:0:18752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787780150.057249:0:18752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346da7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3641:x1874622881674752:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787780150.057270:0:18752:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1787780150.057322:0:18752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346da7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3641:x1874622881674752:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780150.057329:0:18752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787780150.057373:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c03489f6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881674752:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787780150.059221:0:18751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881675008 00000100:00100000:2.0:1787780150.059232:0:18751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881675008 00000100:00100000:3.0:1787780150.059315:0:18751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787780150.059325:0:18751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03489f7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17983:x1874622881675008:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:3.0:1787780150.059353:0:18751:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:3.0:1787780150.059429:0:18751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03489f7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17983:x1874622881675008:12345-0@lo:5:osp-pre-0-1.0 Request processed in 106us (4046us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780150.059436:0:18751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787780150.059591:0:17983:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c03489f6d00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17983:1874622881675008:0@lo:5:osp-pre-0-1.0 00000004:00080000:2.0:1787780150.059605:0:17983:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x21:0x0] 00000100:00100000:2.0:1787780150.059665:0:17983:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348a092c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17983:1874622881675136:0@lo:5:osp-pre-0-1.0 00000100:00100000:2.0:1787780150.059717:0:17983:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787780150.059749:0:17983:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0445fd3600 going to sleep for 11 seconds 00000100:00100000:3.0:1787780150.061045:0:19055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881675136 00000100:00100000:3.0:1787780150.061056:0:19055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881675136 00000100:00100000:3.0:1787780150.061111:0:19055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787780150.061121:0:19055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0348a08b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17983:x1874622881675136:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:3.0:1787780150.061158:0:19055:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 34 00000004:00080000:3.0:1787780150.066561:0:17974:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000001:00080000:0.0:1787780150.082192:0:18745:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00100000:0.0:1787780150.082209:0:18745:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:3.0:1787780150.083325:0:19055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0348a08b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:17983:x1874622881675136:12345-0@lo:5:osp-pre-0-1.0 Request processed in 22199us (23601us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1787780150.083345:0:19055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787780150.083471:0:17983:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934594 gen 2 00000100:00100000:0.0:1787780150.083500:0:17983:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348a092c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17983:1874622881675136:0@lo:5:osp-pre-0-1.0 00000004:00080000:0.0:1787780150.083522:0:17983:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:0.0:1787780150.083590:0:17983:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c03489f7480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17983:1874622881675264:0@lo:900:osp-pre-0-1.0 00000100:00100000:0.0:1787780150.083630:0:17983:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787780150.084594:0:17983:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0347c50c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787780150.092406:0:17254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881675264 00000100:00100000:1.0:1787780150.092423:0:17254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881675264 00000100:00100000:1.0:1787780150.092487:0:17253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787780150.092498:0:17253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03489f61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17983:x1874622881675264:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:1.0:1787780150.092611:0:17253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03489f61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17983:x1874622881675264:12345-0@lo:900:osp-pre-0-1.0 Request processed in 114us (8979us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780150.092619:0:17253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787780150.092675:0:17983:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c03489f7480 x1874622881675264/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787780166 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787780150.092692:0:17983:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c03489f7480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17983:1874622881675264:0@lo:900:osp-pre-0-1.0 00010000:00010000:2.0:1787780150.620331:0:17231:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787780151.068225:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787780151.068251:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346da6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881675392:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787780151.068317:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780151.068558:0:18276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881675392 00000100:00100000:1.0:1787780151.068567:0:18276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881675392 00000100:00100000:1.0:1787780151.068637:0:18276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787780151.068647:0:18276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03489f4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881675392:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787780151.068676:0:18276:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787780151.068720:0:18276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03489f4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881675392:12345-0@lo:41:osp-pre-1-0.0 Request processed in 75us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780151.068722:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348a0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881675520:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787780151.068734:0:18276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787780151.068778:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787780151.068896:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346da6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881675392:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787780151.070074:0:17248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881675520 00000100:00100000:1.0:1787780151.070082:0:17248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881675520 00000100:00100000:1.0:1787780151.070130:0:17248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787780151.070139:0:17248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03489f6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881675520:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787780151.070178:0:17248:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1787780151.070283:0:17248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03489f6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881675520:12345-0@lo:41:osp-pre-0-1.0 Request processed in 144us (1504us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780151.070291:0:17248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787780151.070796:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348a0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881675520:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1787780151.644247:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787780152.668691:0:18397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787780153.262356:0:19562:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787780153.262360:0:19562:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:1.0:1787780153.262361:0:19562:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1787780153.263365:0:19562:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9c046e01c800 00000020:01000004:1.0:1787780153.263381:0:19562:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1787780153.263402:0:19562:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1787780153.263417:0:19562:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9c0445fc3370) 00000020:00000080:1.0:1787780153.263556:0:19562:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1787780153.380228:0:19562:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1787780153.389374:0:19562:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1787780153.390426:0:19562:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1787780153.390995:0:19562:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1787780153.391253:0:19562:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1787780153.391528:0:19562:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1787780153.392037:0:19562:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:01000000:2.0:1787780153.396043:0:19562:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1787780153.396257:0:19562:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1787780153.396274:0:19562:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787780153.396287:0:19562:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xc8fc0a5179961b1c 00000020:01000004:2.0:1787780153.396300:0:19562:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:2.0:1787780153.396322:0:19562:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.131@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787780153.396325:0:19562:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.131@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787780153.396331:0:19562:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1787780153.396358:0:19562:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:2.0:1787780153.396362:0:19562:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.131@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1787780153.416248:0:19562:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.131@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787780153.416295:0:19562:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.131@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1787780153.416299:0:19562:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787780153.416301:0:19562:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787780153.416302:0:19562:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787780153.416303:0:19562:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787780153.416305:0:19562:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787780153.416311:0:19562:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787780153.416313:0:19562:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787780153.416314:0:19562:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787780153.416316:0:19562:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787780153.416319:0:19562:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1787780153.416321:0:19562:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787780153.416322:0:19562:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787780153.416323:0:19562:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787780153.416324:0:19562:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787780153.416325:0:19562:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787780153.416326:0:19562:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787780153.416327:0:19562:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787780153.416327:0:19562:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787780153.416328:0:19562:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787780153.416370:0:19562:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1787780153.416391:0:19562:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346da61c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:19562:1874622881675648:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787780153.416479:0:19562:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780153.416537:0:19562:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c04537e0600 going to sleep for 11 seconds 00000100:00100000:2.0:1787780153.416762:0:17236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881675648 00000100:00100000:2.0:1787780153.416770:0:17236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881675648 00000100:00100000:2.0:1787780153.416827:0:17236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787780153.416836:0:17236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0478637450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+21:19562:x1874622881675648:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787780153.416896:0:17236:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1787780153.416899:0:17236:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:2.0:1787780153.416903:0:17236:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1787780153.418812:0:17236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0478637450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+21:19562:x1874622881675648:12345-0@lo:253:mount.lustre.0 Request processed in 1971us (2327us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780153.418826:0:17236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787780153.418912:0:19562:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346da61c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:19562:1874622881675648:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787780153.418928:0:19562:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1787780153.418932:0:19562:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787780153.418933:0:19562:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787780153.418935:0:19562:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787780153.418936:0:19562:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787780153.418937:0:19562:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787780153.418938:0:19562:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787780153.418939:0:19562:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787780153.418941:0:19562:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787780153.418942:0:19562:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787780153.418963:0:19562:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9c046e01c800 from lustre-OST0001 10000000:01000000:3.0:1787780153.419139:0:19562:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1787780153.419143:0:19562:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1787780153.419152:0:19562:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9c04431399b8 local copy 00010000:00010000:3.0:1787780153.419162:0:19562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c04766dde00/0xc8fc0a517996176b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a5179961772 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787780153.419280:0:19562:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346da61c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:19562:1874622881675776:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787780153.419316:0:19562:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780153.419354:0:19562:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0346bb66c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787780153.419524:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881675776 00000100:00100000:0.0:1787780153.419531:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881675776 00000100:00100000:0.0:1787780153.419579:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1787780153.419587:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0478634850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+21:19562:x1874622881675776:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787780153.419672:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0478634850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+21:19562:x1874622881675776:12345-0@lo:501:mount.lustre.0 Request processed in 86us (355us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787780153.419679:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787780153.419783:0:19562:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346da61c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:19562:1874622881675776:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1787780153.419796:0:19562:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.131@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1787780153.419819:0:19562:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.131@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1787780153.419825:0:19562:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c04766dde00/0xc8fc0a517996176b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a5179961772 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780153.419833:0:19562:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff9c04766dde00/0xc8fc0a517996176b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a5179961772 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787780153.419892:0:19562:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9c046e01c800 10000000:01000000:3.0:1787780153.419898:0:19562:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787780153.419902:0:19562:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1787780153.419904:0:19562:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787780153.419909:0:19562:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1787780153.419912:0:19562:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1787780153.419933:0:19562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c04766dc000/0xc8fc0a5179961b23 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780153.419941:0:19562:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff9c04766dc000/0xc8fc0a5179961b23 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780153.419949:0:19562:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff9c04766dc000/0xc8fc0a5179961b23 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787780153.419990:0:19562:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346da61c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:19562:1874622881675904:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787780153.420020:0:19562:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780153.420048:0:19562:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0346bb66c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787780153.420572:0:17236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881675904 00000100:00100000:2.0:1787780153.420579:0:17236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881675904 00000100:00100000:2.0:1787780153.420626:0:17236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787780153.420635:0:17236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0478637050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+21:19562:x1874622881675904:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787780153.420646:0:17236:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787780153.420659:0:17236:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0477a70000/0xc8fc0a5179961b2a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xc8fc0a5179961b23 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780153.420682:0:17236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0477a70000/0xc8fc0a5179961b2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc8fc0a5179961b23 expref: 22 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780153.420692:0:17236:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0477a70000/0xc8fc0a5179961b2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a5179961b23 expref: 22 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780153.420713:0:17236:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0477a70000, rc 0) 00000100:00100000:2.0:1787780153.420760:0:17236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0478637050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+22:19562:x1874622881675904:12345-0@lo:101:mount.lustre.0 Request processed in 126us (739us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780153.420766:0:17236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1787780153.422090:0:19562:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346da61c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:19562:1874622881675904:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787780153.422112:0:19562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff9c04766dc000/0xc8fc0a5179961b23 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a5179961b2a expref: -99 pid: 19562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780153.422126:0:19562:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff9c04766dc000/0xc8fc0a5179961b23 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xc8fc0a5179961b2a expref: -99 pid: 19562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787780153.429370:0:19562:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1787780153.430027:0:19562:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787780153.432642:0:19562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1787780153.432698:0:19562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1787780153.432716:0:19562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1787780153.432730:0:19562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1787780153.432745:0:19562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1787780153.432760:0:19562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1787780153.432790:0:19562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1787780153.432797:0:19562:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1787780153.434690:0:19562:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346da61c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:19562:1874622881676032:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787780153.434762:0:19562:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780153.434802:0:19562:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0346bb6b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787780153.435969:0:17237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881676032 00000100:00100000:0.0:1787780153.435980:0:17237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881676032 00000100:00100000:0.0:1787780153.436042:0:17237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1787780153.436052:0:17237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0478635050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+22:19562:x1874622881676032:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787780153.436221:0:17237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0478635050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+22:19562:x1874622881676032:12345-0@lo:501:mount.lustre.0 Request processed in 171us (1460us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780153.436228:0:17237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1787780153.437477:0:19562:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346da61c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:19562:1874622881676032:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787780153.437534:0:19562:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346da61c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:19562:1874622881676160:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787780153.437604:0:19562:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780153.437659:0:19562:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0346bb6b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787780153.437759:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881676160 00000100:00100000:0.0:1787780153.437765:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881676160 00000100:00100000:0.0:1787780153.437823:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787780153.437831:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0478635850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+22:19562:x1874622881676160:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787780153.445741:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0478635850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+22:19562:x1874622881676160:12345-0@lo:503:mount.lustre.0 Request processed in 7900us (8127us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780153.445754:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787780153.446233:0:19562:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346da61c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:19562:1874622881676160:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787780153.446786:0:19562:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787780153.446962:0:19562:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346da61c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:19562:1874622881676288:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787780153.447256:0:19562:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780153.447297:0:19562:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0346bb66c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787780153.447349:0:17236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881676288 00000100:00100000:2.0:1787780153.447356:0:17236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881676288 00000100:00100000:2.0:1787780153.447407:0:17236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1787780153.447416:0:17236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0478636450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+22:19562:x1874622881676288:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787780153.448104:0:17236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0478636450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+22:19562:x1874622881676288:12345-0@lo:502:mount.lustre.0 Request processed in 686us (846us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780153.448113:0:17236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1787780153.448178:0:19562:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346da61c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:19562:1874622881676288:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787780153.448352:0:19562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1787780153.448395:0:19562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1787780153.448427:0:19562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1787780153.448443:0:19562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1787780153.448455:0:19562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1787780153.448468:0:19562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1787780153.448480:0:19562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1787780153.448495:0:19562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1787780153.448509:0:19562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:3.0:1787780153.448537:0:19562:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346da61c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:19562:1874622881676416:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787780153.448574:0:19562:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780153.448619:0:19562:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0346bb66c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787780153.448715:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881676416 00000100:00100000:0.0:1787780153.448720:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881676416 00000100:00100000:0.0:1787780153.448759:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787780153.448767:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0478634050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+22:19562:x1874622881676416:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787780153.448892:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0478634050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+22:19562:x1874622881676416:12345-0@lo:502:mount.lustre.0 Request processed in 125us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780153.448898:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1787780153.448990:0:19562:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346da61c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:19562:1874622881676416:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787780153.449029:0:19562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:3.0:1787780153.449037:0:19562:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:3.0:1787780153.450178:0:19566:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787780153.450188:0:19566:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:3.0:1787780153.450194:0:19566:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787780153.450196:0:19566:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1787780153.450202:0:19566:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787780153.450229:0:19566:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9c0347b14d28) 00000020:00000080:3.0:1787780153.450257:0:19566:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:3.0:1787780153.450264:0:19566:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787780153.450347:0:19566:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c046e01c800 from lustre-OST0001, refs=2 00080000:01000000:3.0:1787780153.450356:0:19566:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787780153.450363:0:19566:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xc8fc0a5179961b38 00010000:00010000:3.0:1787780153.453373:0:19566:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:3.0:1787780153.459311:0:19566:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967325 00080000:10000000:2.0:1787780153.461646:0:19566:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:2.0:1787780153.469989:0:19566:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1787780153.470002:0:19566:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787780153.470017:0:19566:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787780153.470020:0:19566:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1787780153.470024:0:19566:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787780153.470028:0:19566:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787780153.470030:0:19566:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787780153.470033:0:19566:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787780153.470035:0:19566:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787780153.470038:0:19566:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787780153.470040:0:19566:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787780153.470041:0:19566:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:2.0:1787780153.470043:0:19566:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787780153.470046:0:19566:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787780153.470047:0:19566:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787780153.470051:0:19566:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1787780153.470080:0:19566:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787780153.470091:0:19566:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787780153.470093:0:19566:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787780153.470096:0:19566:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:3.0:1787780153.470332:0:19562:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1787780153.470363:0:19562:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1787780153.470378:0:19562:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c04766dc000/0xc8fc0a5179961b23 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a5179961b2a expref: -99 pid: 19562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780153.470390:0:19562:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff9c04766dc000/0xc8fc0a5179961b23 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a5179961b2a expref: -99 pid: 19562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787780153.470398:0:19562:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c046e01c800 from 1 10000000:01000000:3.0:1787780153.470400:0:19562:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787780153.470434:0:19562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c04766dd400/0xc8fc0a5179961b3f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780153.470443:0:19562:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff9c04766dd400/0xc8fc0a5179961b3f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780153.470453:0:19562:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff9c04766dd400/0xc8fc0a5179961b3f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787780153.470476:0:19562:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346da61c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:19562:1874622881676544:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787780153.470539:0:19562:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780153.470580:0:19562:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c04537e06c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787780153.470684:0:17236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881676544 00000100:00100000:2.0:1787780153.470691:0:17236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881676544 00000100:00100000:2.0:1787780153.470740:0:17236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787780153.470749:0:17236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0478635c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+22:19562:x1874622881676544:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787780153.470762:0:17236:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787780153.470773:0:17236:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0477a71200/0xc8fc0a5179961b46 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc8fc0a5179961b3f expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780153.470796:0:17236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0477a71200/0xc8fc0a5179961b46 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc8fc0a5179961b3f expref: 23 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780153.470807:0:17236:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0477a71200/0xc8fc0a5179961b46 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a5179961b3f expref: 23 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780153.470815:0:17236:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0477a71200, rc 0) 00000100:00100000:2.0:1787780153.470879:0:17236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0478635c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+23:19562:x1874622881676544:12345-0@lo:101:mount.lustre.0 Request processed in 131us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780153.470886:0:17236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1787780153.471252:0:19562:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346da61c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:19562:1874622881676544:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787780153.471268:0:19562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff9c04766dd400/0xc8fc0a5179961b3f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a5179961b46 expref: -99 pid: 19562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780153.471278:0:19562:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff9c04766dd400/0xc8fc0a5179961b3f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc8fc0a5179961b46 expref: -99 pid: 19562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787780153.472517:0:19562:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1787780153.472780:0:19562:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787780153.473051:0:19562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1787780153.473086:0:19562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1787780153.473106:0:19562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1787780153.473111:0:19562:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1787780153.473174:0:19562:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0461becb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:19562:1874622881676672:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787780153.473233:0:19562:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780153.473275:0:19562:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0347ce3840 going to sleep for 11 seconds 00000100:00100000:2.0:1787780153.474761:0:17237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881676672 00000100:00100000:2.0:1787780153.474771:0:17237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881676672 00000100:00100000:2.0:1787780153.474832:0:17237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1787780153.474944:0:17237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0478634c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+23:19562:x1874622881676672:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787780153.475186:0:17237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0478634c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+23:19562:x1874622881676672:12345-0@lo:501:mount.lustre.0 Request processed in 246us (1952us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780153.475194:0:17237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1787780153.475370:0:19562:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0461becb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:19562:1874622881676672:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787780153.475421:0:19562:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0461becb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:19562:1874622881676800:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787780153.475471:0:19562:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780153.475542:0:19562:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0347ce3840 going to sleep for 11 seconds 00000100:00100000:3.0:1787780153.475620:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881676800 00000100:00100000:3.0:1787780153.475625:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881676800 00000100:00100000:3.0:1787780153.475699:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787780153.475706:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0478635450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+23:19562:x1874622881676800:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787780153.475874:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0478635450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+23:19562:x1874622881676800:12345-0@lo:503:mount.lustre.0 Request processed in 168us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780153.475881:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1787780153.476299:0:19562:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0461becb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:19562:1874622881676800:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787780153.476713:0:19562:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787780153.476782:0:19562:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0461becb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:19562:1874622881676928:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787780153.477066:0:19562:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780153.477141:0:19562:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0347ce3300 going to sleep for 11 seconds 00000100:00100000:3.0:1787780153.477195:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881676928 00000100:00100000:3.0:1787780153.477201:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881676928 00000100:00100000:3.0:1787780153.477239:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787780153.477248:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0478634450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+23:19562:x1874622881676928:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787780153.477332:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0478634450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+23:19562:x1874622881676928:12345-0@lo:502:mount.lustre.0 Request processed in 84us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780153.477339:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1787780153.477531:0:19562:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0461becb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:19562:1874622881676928:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787780153.477707:0:19562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1787780153.477733:0:19562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1787780153.477748:0:19562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1787780153.477763:0:19562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1787780153.477776:0:19562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1787780153.477806:0:19562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1787780153.477828:0:19562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1787780153.477970:0:19562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:1.0:1787780153.477988:0:19562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1787780153.478000:0:19562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:1.0:1787780153.478023:0:19562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:1.0:1787780153.478048:0:19562:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0461becb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:19562:1874622881677056:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787780153.478092:0:19562:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780153.478105:0:19562:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0347ce3300 going to sleep for 11 seconds 00000100:00100000:3.0:1787780153.478219:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881677056 00000100:00100000:3.0:1787780153.478224:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881677056 00000100:00100000:3.0:1787780153.478249:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787780153.478255:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0478636050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+23:19562:x1874622881677056:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787780153.478344:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0478636050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+23:19562:x1874622881677056:12345-0@lo:502:mount.lustre.0 Request processed in 89us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780153.478351:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1787780153.478731:0:19562:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0461becb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:19562:1874622881677056:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787780153.478775:0:19562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:1.0:1787780153.478784:0:19562:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1787780153.480216:0:19570:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787780153.480228:0:19570:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787780153.480230:0:19570:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787780153.480237:0:19570:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c046e01c800 00000020:00000080:0.0:1787780153.480240:0:19570:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787780153.480255:0:19570:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787780153.480258:0:19570:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787780153.480259:0:19570:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1787780153.480261:0:19570:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787780153.480264:0:19570:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787780153.480265:0:19570:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787780153.480268:0:19570:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c046e01c800 00000020:00000080:0.0:1787780153.480270:0:19570:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787780153.480318:0:19570:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787780153.494076:0:19570:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787780153.494097:0:19570:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1787780153.494111:0:19570:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787780153.494117:0:19570:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787780153.494118:0:19570:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787780153.494125:0:19570:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c046e01c800 00000020:00000080:2.0:1787780153.494128:0:19570:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787780153.494177:0:19570:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787780153.494181:0:19570:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787780153.494182:0:19570:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787780153.494185:0:19570:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787780153.494187:0:19570:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787780153.494188:0:19570:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1787780153.494192:0:19570:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c046e01c800 00000020:00000080:2.0:1787780153.494194:0:19570:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787780153.494237:0:19570:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787780153.494241:0:19570:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787780153.494242:0:19570:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1787780153.494245:0:19570:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:1.0:1787780153.497409:0:19562:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1787780153.497454:0:19562:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787780153.497479:0:19562:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c04766dd400/0xc8fc0a5179961b3f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a5179961b46 expref: -99 pid: 19562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780153.497492:0:19562:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff9c04766dd400/0xc8fc0a5179961b3f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a5179961b46 expref: -99 pid: 19562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787780153.497579:0:19562:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787780153.497582:0:19562:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9c046e01c800 10000000:01000000:1.0:1787780153.497598:0:19562:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9c046e01c800 10000000:01000000:1.0:1787780153.497602:0:19562:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787780153.497608:0:19562:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c046e01c800 from 1 10000000:01000000:1.0:1787780153.497620:0:19562:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787780153.497657:0:19562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c0347e4b400/0xc8fc0a5179961b4d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780153.497665:0:19562:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff9c0347e4b400/0xc8fc0a5179961b4d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780153.497675:0:19562:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff9c0347e4b400/0xc8fc0a5179961b4d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787780153.497698:0:19562:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0461becb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:19562:1874622881677184:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787780153.497760:0:19562:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780153.497813:0:19562:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0347ce3840 going to sleep for 11 seconds 00000100:00100000:3.0:1787780153.498019:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881677184 00000100:00100000:3.0:1787780153.498026:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881677184 00000100:00100000:3.0:1787780153.498069:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787780153.498078:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0478637850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+23:19562:x1874622881677184:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787780153.498090:0:17234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787780153.498103:0:17234:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c04766dc400/0xc8fc0a5179961b54 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xc8fc0a5179961b4d expref: -99 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780153.498138:0:17234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c04766dc400/0xc8fc0a5179961b54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc8fc0a5179961b4d expref: 24 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780153.498148:0:17234:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c04766dc400/0xc8fc0a5179961b54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a5179961b4d expref: 24 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780153.498157:0:17234:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c04766dc400, rc 0) 00000100:00100000:3.0:1787780153.498206:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0478637850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+24:19562:x1874622881677184:12345-0@lo:101:mount.lustre.0 Request processed in 128us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780153.498213:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787780153.498286:0:19562:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0461becb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:19562:1874622881677184:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787780153.498299:0:19562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff9c0347e4b400/0xc8fc0a5179961b4d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a5179961b54 expref: -99 pid: 19562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780153.498309:0:19562:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff9c0347e4b400/0xc8fc0a5179961b4d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xc8fc0a5179961b54 expref: -99 pid: 19562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787780153.499569:0:19562:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000040:00080000:3.0:1787780153.499931:0:19562:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787780153.500115:0:19562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1787780153.500141:0:19562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1787780153.500156:0:19562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1787780153.500170:0:19562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1787780153.500182:0:19562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1787780153.500196:0:19562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1787780153.500209:0:19562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1787780153.500222:0:19562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1787780153.500236:0:19562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1787780153.500249:0:19562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1787780153.500261:0:19562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1787780153.500273:0:19562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1787780153.500285:0:19562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1787780153.500297:0:19562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1787780153.500309:0:19562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1787780153.500334:0:19562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1787780153.500350:0:19562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1787780153.500364:0:19562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1787780153.500387:0:19562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1787780153.500401:0:19562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1787780153.500415:0:19562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1787780153.500428:0:19562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1787780153.500441:0:19562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1787780153.500453:0:19562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1787780153.500466:0:19562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:3.0:1787780153.500478:0:19562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:3.0:1787780153.500490:0:19562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:3.0:1787780153.500504:0:19562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:3.0:1787780153.500517:0:19562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:3.0:1787780153.500530:0:19562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:3.0:1787780153.500542:0:19562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:3.0:1787780153.500569:0:19562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:3.0:1787780153.500584:0:19562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:3.0:1787780153.500596:0:19562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:3.0:1787780153.502568:0:19562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:3.0:1787780153.502645:0:19562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:3.0:1787780153.502662:0:19562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:3.0:1787780153.502675:0:19562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:3.0:1787780153.502689:0:19562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14912 00000040:00080000:3.0:1787780153.502702:0:19562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 88 off15000 00000040:00080000:3.0:1787780153.502717:0:19562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 128 off15128 00000040:00080000:3.0:1787780153.502731:0:19562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 144 off15272 00000040:00080000:3.0:1787780153.502744:0:19562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 128 off15400 00000040:00080000:3.0:1787780153.502758:0:19562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 224 off15624 00000040:00080000:3.0:1787780153.502772:0:19562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off15848 00000040:00080000:3.0:1787780153.502785:0:19562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].46, 80 off15928 00000040:00080000:3.0:1787780153.502812:0:19562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].47, 224 off16152 00000040:00080000:3.0:1787780153.502819:0:19562:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 47 count 48 00000100:00100000:3.0:1787780153.503019:0:19562:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346da5680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:19562:1874622881677312:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787780153.503079:0:19562:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780153.503133:0:19562:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0449b62f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787780153.505992:0:17236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881677312 00000100:00100000:2.0:1787780153.506005:0:17236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881677312 00000100:00100000:2.0:1787780153.506054:0:17236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787780153.506064:0:17236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046f20f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+24:19562:x1874622881677312:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787780153.506228:0:17236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046f20f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+24:19562:x1874622881677312:12345-0@lo:501:mount.lustre.0 Request processed in 166us (3149us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780153.506245:0:17236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787780153.506300:0:19562:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346da5680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:19562:1874622881677312:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787780153.506345:0:19562:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348a0b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:19562:1874622881677440:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787780153.506394:0:19562:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787780153.506422:0:19562:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0346bb66c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787780153.506641:0:17237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881677440 00000100:00100000:1.0:1787780153.506646:0:17237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881677440 00000100:00100000:1.0:1787780153.506680:0:17237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1787780153.506687:0:17237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046f20c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+24:19562:x1874622881677440:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787780153.506769:0:17237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046f20c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+24:19562:x1874622881677440:12345-0@lo:503:mount.lustre.0 Request processed in 83us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780153.506776:0:17237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787780153.510607:0:19562:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348a0b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:19562:1874622881677440:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787780153.511118:0:19562:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787780153.511200:0:19562:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348a0b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:19562:1874622881677568:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787780153.511266:0:19562:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787780153.511300:0:19562:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0346915480 going to sleep for 11 seconds 00000100:00100000:1.0:1787780153.519942:0:17237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881677568 00000100:00100000:1.0:1787780153.519955:0:17237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881677568 00000100:00100000:1.0:1787780153.520280:0:17237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787780153.520291:0:17237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046f20e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+24:19562:x1874622881677568:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787780153.520479:0:17237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046f20e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+24:19562:x1874622881677568:12345-0@lo:502:mount.lustre.0 Request processed in 189us (9211us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780153.520494:0:17237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787780153.523200:0:19562:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348a0b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:19562:1874622881677568:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787780153.523455:0:19562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1787780153.523487:0:19562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1787780153.523502:0:19562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1787780153.523533:0:19562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1787780153.523549:0:19562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1787780153.523562:0:19562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1787780153.523575:0:19562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1787780153.523589:0:19562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1787780153.523600:0:19562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1787780153.523630:0:19562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1787780153.523646:0:19562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1787780153.523659:0:19562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1787780153.523672:0:19562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1787780153.523683:0:19562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1787780153.523695:0:19562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1787780153.523707:0:19562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1787780153.523719:0:19562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1787780153.523730:0:19562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1787780153.523741:0:19562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1787780153.523765:0:19562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1787780153.523781:0:19562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1787780153.523797:0:19562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1787780153.523811:0:19562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1787780153.523824:0:19562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1787780153.523836:0:19562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:3.0:1787780153.523888:0:19562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:3.0:1787780153.523903:0:19562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:3.0:1787780153.523915:0:19562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:3.0:1787780153.523928:0:19562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:3.0:1787780153.523940:0:19562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:3.0:1787780153.523972:0:19562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:3.0:1787780153.523985:0:19562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:3.0:1787780153.523998:0:19562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:3.0:1787780153.524010:0:19562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:3.0:1787780153.524023:0:19562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:3.0:1787780153.524049:0:19562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:3.0:1787780153.524066:0:19562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:3.0:1787780153.524079:0:19562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:3.0:1787780153.524092:0:19562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:3.0:1787780153.524104:0:19562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:3.0:1787780153.524116:0:19562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:3.0:1787780153.524129:0:19562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:3.0:1787780153.524142:0:19562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:3.0:1787780153.524155:0:19562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:3.0:1787780153.524169:0:19562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:3.0:1787780153.524182:0:19562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:3.0:1787780153.524196:0:19562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:3.0:1787780153.524210:0:19562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:3.0:1787780153.524256:0:19562:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346da6940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:19562:1874622881677696:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787780153.524325:0:19562:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780153.524373:0:19562:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0341c61cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787780153.524897:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881677696 00000100:00100000:1.0:1787780153.524904:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881677696 00000100:00100000:1.0:1787780153.524953:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787780153.524962:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046f20d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+24:19562:x1874622881677696:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787780153.525079:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046f20d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+24:19562:x1874622881677696:12345-0@lo:502:mount.lustre.0 Request processed in 117us (753us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780153.525087:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787780153.525140:0:19562:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346da6940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:19562:1874622881677696:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787780153.525305:0:19562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:1.0:1787780153.525327:0:19562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:1.0:1787780153.525350:0:19562:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0461bede00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:19562:1874622881677824:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787780153.525402:0:19562:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780153.525419:0:19562:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c04458d6600 going to sleep for 11 seconds 00000100:00100000:1.0:1787780153.525432:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881677824 00000100:00100000:1.0:1787780153.525436:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881677824 00000100:00100000:1.0:1787780153.525454:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787780153.525460:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046f20cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+24:19562:x1874622881677824:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787780153.525520:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046f20cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+24:19562:x1874622881677824:12345-0@lo:502:mount.lustre.0 Request processed in 60us (117us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780153.525527:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787780153.525563:0:19562:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0461bede00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:19562:1874622881677824:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787780153.525597:0:19562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:1.0:1787780153.525604:0:19562:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1787780153.538086:0:19574:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1787780153.538105:0:19574:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9c0450ce8000) 00000020:00000080:2.0:1787780153.538129:0:19574:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:2.0:1787780153.538227:0:19574:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c046e01c800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1787780153.538232:0:19574:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c046e01c800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1787780153.538234:0:19574:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c046e01c800 3 00010000:00080000:2.0:1787780153.538263:0:19574:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c03479e4000@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.131@tcp at head 00010000:00010000:2.0:1787780153.541379:0:19574:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:2.0:1787780153.543906:0:19574:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1787780153.543949:0:19574:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787780153.543962:0:19574:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xc8fc0a5179961b62 00000100:00080000:2.0:1787780153.543973:0:19574:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787780153.543979:0:19574:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9c03479e4000 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:2.0:1787780153.544011:0:19574:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c0348a08780 x1874622881677952/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787780153.544031:0:19574:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787780153.547929:0:2253:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787780153.547936:0:2253:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787780153.547940:0:2253:0:(import.c:65:import_set_state_nolock()) ffff9c044963b000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787780153.547948:0:2253:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 558 00000100:00080000:3.0:1787780153.547953:0:2253:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1787780153.547959:0:2253:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9c044963b000 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:3.0:1787780153.547982:0:2253:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c0346da61c0 x1874622881678336/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787780153.548040:0:2253:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787780153.548043:0:2253:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787780153.548044:0:2253:0:(import.c:65:import_set_state_nolock()) ffff9c0446172800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787780153.548048:0:2253:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 558 00000100:00080000:3.0:1787780153.548051:0:2253:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1787780153.548055:0:2253:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9c0446172800 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:3.0:1787780153.548068:0:2253:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c0346da7840 x1874622881678848/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787780153.548122:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346da6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1874622881678464:0@lo:400:kworker.0 00000100:00100000:3.0:1787780153.548205:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780153.548237:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c03488e30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1874622881679104:0@lo:400:kworker.0 00000100:00100000:3.0:1787780153.548265:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780153.548287:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787780153.548293:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346da52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881678592:0@lo:400:kworker.0 00000100:00100000:3.0:1787780153.548320:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780153.548333:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c03488e12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1874622881679232:0@lo:400:kworker.0 00000100:00100000:3.0:1787780153.548353:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787780153.549150:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348a08780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1874622881677952:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787780153.549204:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787780153.549230:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346da61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1874622881678336:0@lo:8:kworker.0 00000100:00100000:0.0:1787780153.549254:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787780153.549274:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346da7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1874622881678848:0@lo:8:kworker.0 00000100:00100000:0.0:1787780153.549297:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780153.549498:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881678464 00000100:00100000:1.0:1787780153.549511:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881678464 00000100:00100000:1.0:1787780153.549547:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881679104 00000100:00100000:1.0:1787780153.549550:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881679104 00000100:00100000:1.0:1787780153.549573:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881679232 00000100:00100000:1.0:1787780153.549576:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881679232 00000100:00100000:1.0:1787780153.549588:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881677952 00000100:00100000:1.0:1787780153.549590:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881677952 00000100:00100000:1.0:1787780153.549604:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787780153.549623:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03488e3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1874622881678464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787780153.549680:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03488e3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1874622881678464:12345-0@lo:400:kworker.0 Request processed in 69us (1476us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780153.549687:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787780153.549702:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787780153.549708:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03488e2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1874622881679104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787780153.549734:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03488e2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1874622881679104:12345-0@lo:400:kworker.0 Request processed in 27us (1469us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780153.549739:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787780153.549749:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787780153.549755:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03488e1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1874622881679232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787780153.549779:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03488e1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1874622881679232:12345-0@lo:400:kworker.0 Request processed in 24us (1424us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780153.549784:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787780153.549797:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787780153.549800:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03489f4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3640:x1874622881677952:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1787780153.549820:0:17244:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 561 last 0 00000020:00000080:1.0:1787780153.549875:0:17244:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xc8fc0a5179961b69 00000004:00100000:1.0:1787780153.549889:0:17244:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787780153.549926:0:17244:0:(import.c:65:import_set_state_nolock()) ffff9c046e019800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787780153.549965:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03489f4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1874622881677952:12345-0@lo:38:llog_process_th.0 Request processed in 162us (761us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780153.549972:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787780153.549997:0:18276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881678592 00000100:00100000:1.0:1787780153.550001:0:18276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881678592 00000100:00100000:1.0:1787780153.550027:0:18276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787780153.550034:0:18276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03488e03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881678592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787780153.550069:0:18276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03488e03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881678592:12345-0@lo:400:kworker.0 Request processed in 36us (1748us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780153.550075:0:18276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787780153.550114:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346da52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881678592:0@lo:400:kworker.0 00010000:00080000:1.0:1787780153.550127:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c03488e12c0 x1874622881679232/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787780169 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787780153.550136:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c03488e12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1874622881679232:0@lo:400:kworker.0 00010000:00080000:1.0:1787780153.550146:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0346da6d00 x1874622881678464/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787780169 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787780153.550153:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346da6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1874622881678464:0@lo:400:kworker.0 00010000:00080000:1.0:1787780153.550162:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c03488e30c0 x1874622881679104/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787780169 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787780153.550170:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c03488e30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1874622881679104:0@lo:400:kworker.0 00000100:00100000:2.0:1787780153.550461:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346da6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881678080:0@lo:400:kworker.0 00000100:00100000:2.0:1787780153.550496:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787780153.550526:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346da7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881678720:0@lo:400:kworker.0 00000100:00100000:2.0:1787780153.550549:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787780153.550569:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787780153.550577:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346da5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881678208:0@lo:400:kworker.0 00000100:00100000:2.0:1787780153.550599:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787780153.550631:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c03488e1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874622881678976:0@lo:400:kworker.0 00000100:00100000:3.0:1787780153.550639:0:19055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881678336 00000100:00100000:3.0:1787780153.550645:0:19055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881678336 00000100:00100000:2.0:1787780153.550657:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780153.550665:0:19055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881678848 00000100:00100000:3.0:1787780153.550670:0:19055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881678848 00000100:00100000:3.0:1787780153.550681:0:19055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881678720 00000100:00100000:3.0:1787780153.550685:0:19055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881678720 00000100:00100000:3.0:1787780153.550706:0:19055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881678208 00000100:00100000:3.0:1787780153.550709:0:19055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881678208 00000100:00100000:3.0:1787780153.550726:0:19055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787780153.550742:0:19055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0348a0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881678720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787780153.550787:0:19055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0348a0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881678720:12345-0@lo:400:kworker.0 Request processed in 48us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780153.550796:0:19055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787780153.550816:0:19055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787780153.550824:0:19055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0348a083c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1874622881678208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787780153.550867:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346da7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881678720:0@lo:400:kworker.0 00000100:00100000:3.0:1787780153.550882:0:19055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0348a083c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1874622881678208:12345-0@lo:400:kworker.0 Request processed in 58us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780153.550889:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346da5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881678208:0@lo:400:kworker.0 00000100:00100000:3.0:1787780153.550892:0:19055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787780153.550914:0:19055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787780153.550919:0:19055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03489f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3640:x1874622881678336:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1787780153.550965:0:19055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03489f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3640:x1874622881678336:12345-0@lo:8:kworker.0 Request processed in 44us (1709us total) trans 0 rc -11/-11 00000100:00100000:3.0:1787780153.550971:0:19055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787780153.550983:0:19055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787780153.550988:0:19055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03489f6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3640:x1874622881678848:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1787780153.551020:0:19055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03489f6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3640:x1874622881678848:12345-0@lo:8:kworker.0 Request processed in 30us (1722us total) trans 0 rc -11/-11 00000100:00100000:3.0:1787780153.551026:0:19055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787780153.551032:0:17248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881678080 00000100:00100000:1.0:1787780153.551037:0:17248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881678080 00000100:00100000:1.0:1787780153.551064:0:17248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787780153.551072:0:17248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0348a09e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874622881678080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787780153.551116:0:17248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0348a09e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874622881678080:12345-0@lo:400:kworker.0 Request processed in 46us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780153.551123:0:17248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:0.0:1787780153.551253:0:17238:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787780153.551258:0:17238:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787780153.551260:0:17238:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787780153.551281:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0348a08780 x1874622881677952/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787780163 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787780153.551289:0:3640:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787780153.551296:0:3640:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:0.0:1787780153.551303:0:3640:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787780153.551308:0:3640:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787780153.551311:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9c03479e4000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787780153.551316:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348a08780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1874622881677952:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787780153.551326:0:3640:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787780153.551330:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9c044963b000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787780153.551334:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1787780153.551337:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346da61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1874622881678336:0@lo:8:kworker.0 00000100:00100000:0.0:1787780153.551345:0:3640:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787780153.551348:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9c0446172800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787780153.551350:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1787780153.551352:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346da7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1874622881678848:0@lo:8:kworker.0 00000100:00100000:3.0:1787780153.553905:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881678976 00000100:00100000:3.0:1787780153.553917:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881678976 00000100:00100000:3.0:1787780153.553968:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787780153.553978:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0348a0b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874622881678976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787780153.554050:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0348a0b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874622881678976:12345-0@lo:400:kworker.0 Request processed in 74us (3393us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780153.554057:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:2.0:1787780153.555295:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c03488e1e00 x1874622881678976/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787780169 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787780153.555313:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c03488e1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874622881678976:0@lo:400:kworker.0 00000100:00100000:2.0:1787780153.555328:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346da6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881678080:0@lo:400:kworker.0 00000020:01000004:2.0:1787780153.555706:0:19574:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1787780153.555732:0:19574:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff9c0348bc4d28) 00000020:00000080:2.0:1787780153.555758:0:19574:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:2.0:1787780153.555871:0:19574:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c046e01c800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1787780153.555876:0:19574:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c046e01c800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1787780153.555879:0:19574:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c046e01c800 3 00010000:00080000:2.0:1787780153.555920:0:19574:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c03479e2800@lustre-MDT0001-lwp-OST0001: add connection 192.168.203.131@tcp at head 00010000:00010000:3.0:1787780153.565342:0:19574:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:3.0:1787780153.565530:0:19574:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:3.0:1787780153.565572:0:19574:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787780153.565584:0:19574:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xc8fc0a5179961b77 00000100:00080000:3.0:1787780153.565594:0:19574:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787780153.565599:0:19574:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9c03479e2800 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:3.0:1787780153.565646:0:19574:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c03488e21c0 x1874622881679360/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787780153.565700:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c03488e21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3640:1874622881679360:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787780153.565769:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780153.565878:0:17243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881679360 00000100:00100000:1.0:1787780153.565884:0:17243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881679360 00000100:00100000:1.0:1787780153.565920:0:17243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787780153.565928:0:17243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03489f6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1874622881679360:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1787780153.565951:0:17243:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 561 last 0 00000100:00080000:3.0:1787780153.565967:0:19574:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000020:00000080:1.0:1787780153.565980:0:17243:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xc8fc0a5179961b7e 00000004:00100000:1.0:1787780153.565995:0:17243:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787780153.566025:0:17243:0:(import.c:65:import_set_state_nolock()) ffff9c046e01e000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787780153.566298:0:17243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03489f6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1874622881679360:12345-0@lo:38:llog_process_th.0 Request processed in 369us (528us total) trans 0 rc 0/0 00010000:00080000:0.0:1787780153.566302:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c03488e21c0 x1874622881679360/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787780163 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787780153.566306:0:17243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787780153.566311:0:3640:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787780153.566318:0:3640:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 2 00000100:00080000:0.0:1787780153.566325:0:3640:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787780153.566329:0:3640:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1787780153.566331:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9c03479e2800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787780153.566337:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c03488e21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3640:1874622881679360:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1787780153.566597:0:19574:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:1.0:1787780153.567520:0:19562:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1787780153.567552:0:19562:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787780153.567574:0:19562:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c0347e4b400/0xc8fc0a5179961b4d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a5179961b54 expref: -99 pid: 19562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780153.567586:0:19562:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff9c0347e4b400/0xc8fc0a5179961b4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a5179961b54 expref: -99 pid: 19562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787780153.567639:0:19562:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787780153.567642:0:19562:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787780153.567644:0:19562:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787780153.567645:0:19562:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787780153.567646:0:19562:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787780153.567648:0:19562:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787780153.567649:0:19562:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787780153.567654:0:19562:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787780153.567656:0:19562:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787780153.567659:0:19562:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:1.0:1787780153.567661:0:19562:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787780153.567662:0:19562:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787780153.567663:0:19562:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787780153.567664:0:19562:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787780153.567665:0:19562:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787780153.567666:0:19562:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787780153.567667:0:19562:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787780153.567668:0:19562:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787780153.567668:0:19562:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787780153.567687:0:19562:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1787780153.567701:0:19562:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0461bede00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:19562:1874622881679488:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787780153.567749:0:19562:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780153.567784:0:19562:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c04778b2240 going to sleep for 11 seconds 00000100:00100000:0.0:1787780153.568882:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881679488 00000100:00100000:0.0:1787780153.568891:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881679488 00000100:00100000:0.0:1787780153.568935:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1787780153.568944:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046f20dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+24:19562:x1874622881679488:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787780153.569091:0:17234:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1787780153.569106:0:17234:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1787780153.575593:0:17234:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787780153.575620:0:17234:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1787780153.576030:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046f20dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+24:19562:x1874622881679488:12345-0@lo:253:mount.lustre.0 Request processed in 7082us (8275us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780153.576044:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787780153.576165:0:19562:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0461bede00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:19562:1874622881679488:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787780153.576179:0:19562:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1787780153.576183:0:19562:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787780153.576184:0:19562:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787780153.576186:0:19562:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787780153.576187:0:19562:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787780153.576188:0:19562:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787780153.576190:0:19562:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787780153.576196:0:19562:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787780153.576198:0:19562:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787780153.576199:0:19562:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787780153.576213:0:19562:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:3.0:1787780153.576224:0:17258:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787780153.576229:0:17258:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787780153.576246:0:17258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c04766dda00/0xc8fc0a5179961b85 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780153.576260:0:17258:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c0444c18600/0xc8fc0a5179961a2e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a5179961a27 expref: 23 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780153.576269:0:17258:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c0444c18800/0xc8fc0a5179961a3c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a5179961a35 expref: 23 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780153.576276:0:17258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c04766dda00/0xc8fc0a5179961b85 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780153.576309:0:17258:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c0444c18800/0xc8fc0a5179961a3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc8fc0a5179961a35 expref: 23 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780153.576321:0:17258:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c0444c18800/0xc8fc0a5179961a3c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc8fc0a5179961a35 expref: 23 pid: 17236 timeout: 661 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787780153.576333:0:17258:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c03488e1a40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17258:1874622881679616:0@lo:104: 00000100:00100000:3.0:1787780153.576375:0:17258:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787780153.576423:0:17258:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c0444c18600/0xc8fc0a5179961a2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc8fc0a5179961a27 expref: 23 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780153.576432:0:17258:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c0444c18600/0xc8fc0a5179961a2e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc8fc0a5179961a27 expref: 23 pid: 17234 timeout: 661 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787780153.576441:0:17258:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c03488e0f00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17258:1874622881679744:0@lo:104: 00000100:00100000:3.0:1787780153.576462:0:17258:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780153.576486:0:17258:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0341c61600 going to sleep for 11 seconds 00000100:00100000:0.0:1787780153.576530:0:17226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881679616 00000100:00100000:0.0:1787780153.576537:0:17226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881679616 00000100:00100000:2.0:1787780153.576559:0:17225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881679744 00000100:00100000:2.0:1787780153.576566:0:17225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881679744 00000100:00100000:0.0:1787780153.576574:0:17226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787780153.576586:0:17226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03488e2580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+4:17258:x1874622881679616:12345-0@lo:104: 00010000:00010000:0.0:1787780153.576598:0:17226:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff9c0347e4b600/0xc8fc0a5179961a35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc8fc0a5179961a3c expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780153.576668:0:17226:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787780153.576673:0:17226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03488e2580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+4:17258:x1874622881679616:12345-0@lo:104: Request processed in 92us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780153.576688:0:17226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787780153.576703:0:17226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787780153.576709:0:17226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03488e21c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+3:17258:x1874622881679744:12345-0@lo:104: 00010000:00010000:0.0:1787780153.576717:0:17226:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff9c0347e4a200/0xc8fc0a5179961a27 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc8fc0a5179961a2e expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780153.577118:0:17226:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:2.0:1787780153.577123:0:17231:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:0.0:1787780153.577126:0:17226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03488e21c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+3:17258:x1874622881679744:12345-0@lo:104: Request processed in 417us (662us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780153.577136:0:17226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:2.0:1787780153.577139:0:17231:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff9c0347e4b600/0xc8fc0a5179961a35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc8fc0a5179961a3c expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780153.577158:0:17230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787780153.577163:0:17230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff9c0347e4a200/0xc8fc0a5179961a27 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc8fc0a5179961a2e expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780153.577171:0:17230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0347e4a200 already unused, calling callback (ffffffffc139ac20) 10000000:00010000:0.0:1787780153.577175:0:17230:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff9c0347e4a200/0xc8fc0a5179961a27 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc8fc0a5179961a2e expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780153.577183:0:17230:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff9c0347e4a200/0xc8fc0a5179961a27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc8fc0a5179961a2e expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787780153.577191:0:17230:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff9c0347e4a200/0xc8fc0a5179961a27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc8fc0a5179961a2e expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787780153.577198:0:17230:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787780153.577212:0:17231:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0347e4b600 already unused, calling callback (ffffffffc139ac20) 10000000:00010000:2.0:1787780153.577218:0:17231:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff9c0347e4b600/0xc8fc0a5179961a35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc8fc0a5179961a3c expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780153.577227:0:17231:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff9c0347e4b600/0xc8fc0a5179961a35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc8fc0a5179961a3c expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787780153.577237:0:17231:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff9c0347e4b600/0xc8fc0a5179961a35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc8fc0a5179961a3c expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780153.577237:0:17230:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff9c0347e4a200/0xc8fc0a5179961a27 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a5179961a2e expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780153.577255:0:17230:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:01000000:2.0:1787780153.577256:0:17231:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787780153.577277:0:17230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff9c0347e4a200/0xc8fc0a5179961a27 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a5179961a2e expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780153.577280:0:17231:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff9c0347e4b600/0xc8fc0a5179961a35 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a5179961a3c expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780153.577291:0:17230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff9c0347e4a200/0xc8fc0a5179961a27 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a5179961a2e expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780153.577293:0:17231:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787780153.577306:0:17231:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff9c0347e4b600/0xc8fc0a5179961a35 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a5179961a3c expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780153.577310:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787780153.577314:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787780153.577315:0:17231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff9c0347e4b600/0xc8fc0a5179961a35 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a5179961a3c expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780153.577316:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787780153.577335:0:17231:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787780153.577338:0:17231:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787780153.577338:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c03489f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:3641:1874622881679872:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787780153.577341:0:17231:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787780153.577374:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787780153.577398:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787780153.577406:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348a092c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:3641:1874622881680000:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787780153.577416:0:17227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881679872 00000100:00100000:2.0:1787780153.577421:0:17227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881679872 00000100:00100000:0.0:1787780153.577431:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787780153.577461:0:18398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881680000 00000100:00100000:0.0:1787780153.577466:0:18398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881680000 00010000:00010000:0.0:1787780153.577481:0:18398:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c0444c18800/0xc8fc0a5179961a3c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc8fc0a5179961a35 expref: 25 pid: 17236 timeout: 661 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787780153.577502:0:18398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787780153.577508:0:18398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03489f5680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+25:3641:x1874622881680000:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787780153.577518:0:18398:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787780153.577523:0:18398:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c0444c18800/0xc8fc0a5179961a3c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc8fc0a5179961a35 expref: 25 pid: 17236 timeout: 661 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780153.577532:0:18398:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c0444c18800/0xc8fc0a5179961a3c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc8fc0a5179961a35 expref: 25 pid: 17236 timeout: 661 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780153.577544:0:17227:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c0444c18600/0xc8fc0a5179961a2e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc8fc0a5179961a27 expref: 25 pid: 17234 timeout: 661 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780153.577556:0:18398:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787780153.577584:0:17227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787780153.577589:0:18398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03489f5680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+25:3641:x1874622881680000:12345-0@lo:103:ldlm_bl.0 Request processed in 80us (157us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780153.577594:0:17227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03489f70c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+25:3641:x1874622881679872:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787780153.577600:0:18398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:2.0:1787780153.577626:0:17227:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787780153.577632:0:17227:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c0444c18600/0xc8fc0a5179961a2e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc8fc0a5179961a27 expref: 24 pid: 17234 timeout: 661 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780153.577642:0:17227:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c0444c18600/0xc8fc0a5179961a2e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc8fc0a5179961a27 expref: 24 pid: 17234 timeout: 661 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787780153.577648:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348a092c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:3641:1874622881680000:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787780153.577658:0:17227:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c04766dda00/0xc8fc0a5179961b85 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780153.577667:0:17227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c04766dda00/0xc8fc0a5179961b85 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787780153.577678:0:17227:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.009133879s 00010000:00010000:2.0:1787780153.577682:0:17227:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c04766dda00/0xc8fc0a5179961b85 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780153.577688:0:17227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c04766dda00/0xc8fc0a5179961b85 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780153.577695:0:17227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c04766dda00/0xc8fc0a5179961b85 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780153.577701:0:17227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c04766dda00/0xc8fc0a5179961b85 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780153.577707:0:17227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c04766dda00 already unused, calling callback (ffffffffc0d97420) 00010000:00010000:3.0:1787780153.577710:0:17258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c0444c18800/0xc8fc0a5179961a3c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc8fc0a5179961a35 expref: 24 pid: 17236 timeout: 661 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780153.577717:0:17227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c04766dda00/0xc8fc0a5179961b85 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787780153.577725:0:17258:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c03488e1a40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17258:1874622881679616:0@lo:104: 00010000:00010000:2.0:1787780153.577726:0:17227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c04766dda00/0xc8fc0a5179961b85 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780153.577738:0:17227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c04766dda00/0xc8fc0a5179961b85 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780153.577741:0:17258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c0444c18600/0xc8fc0a5179961a2e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc8fc0a5179961a27 expref: 23 pid: 17234 timeout: 661 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780153.577756:0:17227:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787780153.577769:0:17258:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c03488e0f00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17258:1874622881679744:0@lo:104: 00010000:00010000:3.0:1787780153.577786:0:17258:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c04766dda00/0xc8fc0a5179961b85 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780153.577795:0:17258:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c04766dda00/0xc8fc0a5179961b85 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780153.577802:0:17258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c04766dda00/0xc8fc0a5179961b85 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787780153.577803:0:17227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03489f70c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+22:3641:x1874622881679872:12345-0@lo:103:ldlm_bl.0 Request processed in 211us (428us total) trans 0 rc 0/0 00010000:00010000:3.0:1787780153.577818:0:17258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c04766dda00/0xc8fc0a5179961b85 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787780153.577819:0:17227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787780153.577957:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c03489f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:3641:1874622881679872:0@lo:103:ldlm_bl.0 00000001:00000004:1.0:1787780153.596070:0:19562:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1787780153.603661:0:19562:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1787780153.603669:0:19562:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1787780153.603718:0:19562:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787780153.603757:0:19562:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.131@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787780153.603775:0:19562:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=50 00000080:00000004:1.0:1787780153.603797:0:19562:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:1.0:1787780153.604706:0:19562:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787780153.604925:0:19562:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787780153.692740:0:18397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787780154.142640:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0461bede00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881680128:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787780154.142709:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780154.142815:0:18752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881680128 00000100:00100000:1.0:1787780154.142822:0:18752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881680128 00000100:00100000:1.0:1787780154.142902:0:18752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787780154.142912:0:18752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03488e0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881680128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787780154.142939:0:18752:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1787780154.142987:0:18752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03488e0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881680128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780154.142994:0:18752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787780154.143038:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0461bede00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881680128:0@lo:13:osp-pre-0-0.0 00000020:00000004:0.0:1787780154.620621:0:19630:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787780154.621283:0:19630:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:0.0:1787780154.652980:0:17239:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787780154.652988:0:17239:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c0477821800 from 10 10000000:01000000:0.0:1787780154.652995:0:17239:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787780154.653039:0:17239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c0481372a00/0xc8fc0a5179961b8c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780154.653051:0:17239:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff9c0481372a00/0xc8fc0a5179961b8c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780154.653062:0:17239:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff9c0481372a00/0xc8fc0a5179961b8c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787780154.653088:0:17239:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c03489f4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17239:1874622881680256:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787780154.653155:0:17239:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787780154.653197:0:17239:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0443d6e840 going to sleep for 11 seconds 00000100:00100000:1.0:1787780154.653375:0:17236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881680256 00000100:00100000:1.0:1787780154.653383:0:17236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881680256 00000100:00100000:1.0:1787780154.653433:0:17236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1787780154.653442:0:17236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046f20c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+22:17239:x1874622881680256:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787780154.653454:0:17236:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787780154.653466:0:17236:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0347e4b800/0xc8fc0a5179961b93 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc8fc0a5179961b8c expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780154.653488:0:17236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0347e4b800/0xc8fc0a5179961b93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc8fc0a5179961b8c expref: 23 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780154.653497:0:17236:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0347e4b800/0xc8fc0a5179961b93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a5179961b8c expref: 23 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780154.653505:0:17236:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0347e4b800, rc 0) 00000100:00100000:1.0:1787780154.653545:0:17236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046f20c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+23:17239:x1874622881680256:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 104us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780154.653551:0:17236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787780154.653650:0:17239:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c03489f4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17239:1874622881680256:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787780154.653667:0:17239:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff9c0481372a00/0xc8fc0a5179961b8c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a5179961b93 expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780154.653676:0:17239:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff9c0481372a00/0xc8fc0a5179961b8c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc8fc0a5179961b93 expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787780154.653738:0:17239:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348a092c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17239:1874622881680384:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787780154.653768:0:17239:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787780154.653794:0:17239:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c04766fc9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787780154.653985:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881680384 00000100:00100000:1.0:1787780154.653990:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881680384 00000100:00100000:1.0:1787780154.654012:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787780154.654019:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046f20e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+23:17239:x1874622881680384:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787780154.654032:0:17234:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787780154.654048:0:17234:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787780154.654052:0:17234:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:1.0:1787780154.654131:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046f20e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+23:17239:x1874622881680384:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 112us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780154.654139:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787780154.654167:0:17239:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348a092c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17239:1874622881680384:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1787780154.654222:0:17239:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787780154.654229:0:17239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c0481372a00/0xc8fc0a5179961b8c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a5179961b93 expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780154.654237:0:17239:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff9c0481372a00/0xc8fc0a5179961b8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a5179961b93 expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787780154.654245:0:17239:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787780154.654247:0:17239:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c0447266000 from 10 10000000:01000000:1.0:1787780154.654249:0:17239:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787780154.654264:0:17239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c0347e4b200/0xc8fc0a5179961b9a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780154.654272:0:17239:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff9c0347e4b200/0xc8fc0a5179961b9a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780154.654279:0:17239:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff9c0347e4b200/0xc8fc0a5179961b9a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787780154.654301:0:17239:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0461bede00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17239:1874622881680512:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787780154.654326:0:17239:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780154.654343:0:17239:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0346be2600 going to sleep for 11 seconds 00000100:00100000:1.0:1787780154.654354:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881680512 00000100:00100000:1.0:1787780154.654358:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881680512 00000100:00100000:1.0:1787780154.654373:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787780154.654379:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046f20d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+23:17239:x1874622881680512:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787780154.654386:0:17234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787780154.654394:0:17234:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0347e4a800/0xc8fc0a5179961ba1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc8fc0a5179961b9a expref: -99 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780154.654408:0:17234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0347e4a800/0xc8fc0a5179961ba1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc8fc0a5179961b9a expref: 24 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780154.654415:0:17234:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0347e4a800/0xc8fc0a5179961ba1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a5179961b9a expref: 24 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780154.654422:0:17234:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0347e4a800, rc 0) 00000100:00100000:1.0:1787780154.654448:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046f20d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+24:17239:x1874622881680512:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 69us (121us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780154.654454:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787780154.654480:0:17239:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0461bede00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17239:1874622881680512:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787780154.654489:0:17239:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff9c0347e4b200/0xc8fc0a5179961b9a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a5179961ba1 expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780154.654497:0:17239:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff9c0347e4b200/0xc8fc0a5179961b9a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc8fc0a5179961ba1 expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787780154.654538:0:17239:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0461bede00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17239:1874622881680640:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1787780154.654565:0:17239:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780154.654577:0:17239:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0346be2600 going to sleep for 11 seconds 00000100:00100000:1.0:1787780154.654587:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881680640 00000100:00100000:1.0:1787780154.654590:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881680640 00000100:00100000:1.0:1787780154.654621:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1787780154.654627:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046f20d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+24:17239:x1874622881680640:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787780154.654637:0:17234:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787780154.654647:0:17234:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787780154.654650:0:17234:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:1.0:1787780154.654723:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046f20d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+24:17239:x1874622881680640:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 95us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780154.654729:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1787780154.654756:0:17239:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0461bede00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17239:1874622881680640:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1787780154.654790:0:17239:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787780154.654796:0:17239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c0347e4b200/0xc8fc0a5179961b9a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a5179961ba1 expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780154.654803:0:17239:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff9c0347e4b200/0xc8fc0a5179961b9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a5179961ba1 expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780154.719068:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787780155.036466:0:17278:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787780155.165372:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787780155.165394:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0461bede00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881680768:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787780155.165455:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780155.165520:0:18752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881680768 00000100:00100000:1.0:1787780155.165527:0:18752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881680768 00000100:00100000:1.0:1787780155.165574:0:18752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787780155.165582:0:18752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0461bee580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881680768:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787780155.165612:0:18752:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1787780155.165651:0:18752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0461bee580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881680768:12345-0@lo:13:osp-pre-0-1.0 Request processed in 70us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780155.165657:0:18752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1787780155.165675:0:17238:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787780155.165705:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0461bede00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881680768:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1787780155.741134:0:17231:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787780156.188327:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787780156.188351:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348a08780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874622881680896:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787780156.188424:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787780156.188708:0:17247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881680896 00000100:00100000:2.0:1787780156.188716:0:17247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881680896 00000100:00100000:2.0:1787780156.188765:0:17247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787780156.188774:0:17247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03488e1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1874622881680896:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787780156.188819:0:17247:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1787780156.188896:0:17247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03488e1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1874622881680896:12345-0@lo:41:osp-pre-0-1.0 Request processed in 123us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780156.188903:0:17247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787780156.189057:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348a08780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874622881680896:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787780156.194369:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c03488e30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881681024:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787780156.194437:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780156.194564:0:18276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881681024 00000100:00100000:3.0:1787780156.194572:0:18276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881681024 00000100:00100000:3.0:1787780156.194632:0:18276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787780156.194641:0:18276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0461bed680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1874622881681024:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787780156.194670:0:18276:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787780156.194721:0:18276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0461bed680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1874622881681024:12345-0@lo:41:osp-pre-1-0.0 Request processed in 81us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780156.194728:0:18276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787780156.194885:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c03488e30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881681024:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1787780156.764293:0:18397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787780157.148713:0:17994:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787780157.796157:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787780158.751429:0:2253:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787780158.751437:0:2253:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787780158.751442:0:2253:0:(import.c:65:import_set_state_nolock()) ffff9c044963b000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787780158.751458:0:2253:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9c044963b000 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:2.0:1787780158.751487:0:2253:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c047785d2c0 x1874622881681536/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787780158.751524:0:2253:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787780158.751527:0:2253:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787780158.751529:0:2253:0:(import.c:65:import_set_state_nolock()) ffff9c0446172800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787780158.751533:0:2253:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9c0446172800 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:2.0:1787780158.751543:0:2253:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c047785ed00 x1874622881682048/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787780158.751634:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348a09a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881681280:0@lo:400:kworker.0 00000100:00100000:2.0:1787780158.751738:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787780158.751809:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047785e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881681920:0@lo:400:kworker.0 00000100:00100000:2.0:1787780158.751867:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787780158.751887:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047785f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1874622881682560:0@lo:400:kworker.0 00000100:00100000:2.0:1787780158.751921:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787780158.751950:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1787780158.751956:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348a0a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:3644:1874622881681152:0@lo:400:kworker.0 00000100:00100000:2.0:1787780158.752003:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787780158.752029:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047785f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881681792:0@lo:400:kworker.0 00000100:00100000:2.0:1787780158.752051:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787780158.752069:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047785de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1874622881682432:0@lo:400:kworker.0 00000100:00100000:2.0:1787780158.752089:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787780158.752119:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348a092c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881681408:0@lo:400:kworker.0 00000100:00100000:2.0:1787780158.752144:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787780158.752159:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047785d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874622881682176:0@lo:400:kworker.0 00000100:00100000:2.0:1787780158.752175:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787780158.752187:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047785fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1874622881682688:0@lo:400:kworker.0 00000100:00100000:2.0:1787780158.752208:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787780158.752217:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787780158.752221:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047785da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874622881681664:0@lo:400:kworker.0 00000100:00100000:2.0:1787780158.752236:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787780158.752244:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047785e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1874622881682304:0@lo:400:kworker.0 00000100:00100000:2.0:1787780158.752257:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787780158.752275:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047785d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1874622881681536:0@lo:8:kworker.0 00000100:00100000:2.0:1787780158.752294:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787780158.752308:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047785ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1874622881682048:0@lo:8:kworker.0 00000100:00100000:2.0:1787780158.752329:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787780158.752357:0:17248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881681280 00000100:00100000:2.0:1787780158.752366:0:17248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881681280 00000100:00100000:2.0:1787780158.752407:0:17248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881681792 00000100:00100000:2.0:1787780158.752409:0:17248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881681792 00000100:00100000:2.0:1787780158.752423:0:17248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787780158.752439:0:17248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346effc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881681280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787780158.752495:0:17248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346effc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881681280:12345-0@lo:400:kworker.0 Request processed in 58us (758us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780158.752503:0:17248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787780158.752520:0:17248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787780158.752525:0:17248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346efd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881681792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787780158.752544:0:17248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346efd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881681792:12345-0@lo:400:kworker.0 Request processed in 19us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780158.752549:0:17248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787780158.753410:0:19055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881681920 00000100:00100000:2.0:1787780158.753422:0:19055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881681920 00000100:00100000:2.0:1787780158.753482:0:19055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881681408 00000100:00100000:2.0:1787780158.753486:0:19055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881681408 00000100:00100000:2.0:1787780158.753499:0:19055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881681536 00000100:00100000:2.0:1787780158.753502:0:19055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881681536 00000100:00100000:2.0:1787780158.753512:0:19055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881682048 00000100:00100000:2.0:1787780158.753514:0:19055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881682048 00000100:00100000:2.0:1787780158.753526:0:19055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787780158.753534:0:19055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346eff0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881681920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787780158.753623:0:19055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346eff0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881681920:12345-0@lo:400:kworker.0 Request processed in 88us (1782us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780158.753630:0:19055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787780158.753645:0:19055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787780158.753653:0:19055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346efd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1874622881681408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787780158.753688:0:19055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346efd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1874622881681408:12345-0@lo:400:kworker.0 Request processed in 36us (1543us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780158.753694:0:19055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787780158.753720:0:19055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787780158.753930:0:19055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346eff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3640:x1874622881681536:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1787780158.753968:0:19055:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 566 last 0 00000020:00000080:2.0:1787780158.754004:0:19055:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc8fc0a5179961ba8 00002000:00100000:2.0:1787780158.754022:0:19055:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9c03479e1800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113939 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1787780158.754027:0:19055:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1787780158.754030:0:19055:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1787780158.754253:0:19055:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787780158.754284:0:19055:0:(import.c:65:import_set_state_nolock()) ffff9c03479e0800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787780158.754338:0:19055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346eff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3640:x1874622881681536:12345-0@lo:8:kworker.0 Request processed in 612us (2042us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780158.754345:0:19055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787780158.754363:0:19055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787780158.754368:0:19055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346efcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3640:x1874622881682048:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1787780158.754384:0:19055:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 566 last 0 00000020:00000080:2.0:1787780158.754405:0:19055:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xc8fc0a5179961baf 00002000:00100000:2.0:1787780158.754411:0:19055:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff9c03479e6000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113939 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:2.0:1787780158.754415:0:19055:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:2.0:1787780158.754417:0:19055:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1787780158.754440:0:19055:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:2.0:1787780158.754453:0:19055:0:(import.c:65:import_set_state_nolock()) ffff9c03479e3000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787780158.754483:0:19055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346efcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3640:x1874622881682048:12345-0@lo:8:kworker.0 Request processed in 113us (2152us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780158.754489:0:19055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787780158.754544:0:17242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881682560 00000100:00100000:2.0:1787780158.754550:0:17242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881682560 00000100:00100000:3.0:1787780158.754861:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881682432 00000100:00100000:3.0:1787780158.754868:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881682432 00000100:00100000:2.0:1787780158.755015:0:17242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881682176 00000100:00100000:2.0:1787780158.755019:0:17242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881682176 00000100:00100000:2.0:1787780158.755033:0:17242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881682688 00000100:00100000:2.0:1787780158.755036:0:17242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881682688 00000100:00100000:3.0:1787780158.756913:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881681664 00000100:00100000:3.0:1787780158.756928:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881681664 00000100:00100000:3.0:1787780158.756949:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881682304 00000100:00100000:3.0:1787780158.756952:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881682304 00000100:00100000:3.0:1787780158.756980:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787780158.756993:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346efc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1874622881682560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787780158.757031:0:17242:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1787780158.757044:0:17242:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1787780158.757111:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346efc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1874622881682560:12345-0@lo:400:kworker.0 Request processed in 120us (5187us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780158.757128:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787780158.757149:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787780158.757156:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346eff840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874622881682176:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1787780158.757218:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c047785d2c0 x1874622881681536/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787780183 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787780158.757240:0:3640:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1787780158.757250:0:3640:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787780158.757257:0:3640:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1787780158.757262:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9c044963b000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1787780158.757280:0:3640:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787780158.757289:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047785d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1874622881681536:0@lo:8:kworker.0 00000100:00100000:3.0:1787780158.758019:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346eff840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874622881682176:12345-0@lo:400:kworker.0 Request processed in 860us (5839us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780158.758029:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787780158.758053:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787780158.758061:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346efde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874622881682432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787780158.758103:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346efde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874622881682432:12345-0@lo:400:kworker.0 Request processed in 44us (6013us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780158.758109:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787780158.758122:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787780158.758128:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346efc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874622881681664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787780158.758155:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346efc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874622881681664:12345-0@lo:400:kworker.0 Request processed in 28us (5917us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780158.758160:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787780158.758170:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787780158.758175:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346efe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874622881682304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787780158.758203:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346efe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874622881682304:12345-0@lo:400:kworker.0 Request processed in 28us (5945us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780158.758209:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787780158.758221:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787780158.758227:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346efe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1874622881682688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787780158.758256:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346efe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1874622881682688:12345-0@lo:400:kworker.0 Request processed in 29us (6046us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780158.758271:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787780158.758317:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881681152 00000100:00100000:3.0:1787780158.758324:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881681152 00010000:00080000:2.0:1787780158.758346:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c047785ed00 x1874622881682048/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787780183 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787780158.758363:0:3640:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 2 00000100:00100000:3.0:1787780158.758371:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00080000:2.0:1787780158.758372:0:3640:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787780158.758379:0:3640:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00100000:3.0:1787780158.758382:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046f20f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+24:3644:x1874622881681152:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787780158.758395:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9c0446172800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1787780158.758421:0:3640:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787780158.758424:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046f20f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+24:3644:x1874622881681152:12345-0@lo:400:kworker.0 Request processed in 43us (6419us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780158.758429:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047785ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1874622881682048:0@lo:8:kworker.0 00000100:00100000:3.0:1787780158.758436:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000004:00080000:3.0:1787780158.758511:0:17269:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x6:0x0] 00000100:00100000:3.0:1787780158.758535:0:17269:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c03488e30c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17269:1874622881682944:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1787780158.758589:0:17269:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780158.758616:0:17269:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0341c610c0 going to sleep for 11 seconds 00000004:00080000:3.0:1787780158.758634:0:17268:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:2.0:1787780158.758715:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c03488e1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881682816:0@lo:13:osp-pre-1-0.0 00000004:00080000:3.0:1787780158.758757:0:17268:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 566762917160ns, next at 0ns, rc = 0 00080000:00080000:3.0:1787780158.758766:0:17268:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:2.0:1787780158.758767:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780158.758816:0:19055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881682944 00000100:00100000:2.0:1787780158.758819:0:18752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881682816 00000100:00100000:3.0:1787780158.758821:0:19055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881682944 00000100:00100000:2.0:1787780158.758826:0:18752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881682816 00000100:00100000:3.0:1787780158.758887:0:19055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787780158.758892:0:18752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787780158.758898:0:19055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347dade00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:17269:x1874622881682944:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1787780158.758906:0:18752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346efc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3642:x1874622881682816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787780158.758940:0:18752:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1787780158.758987:0:18752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346efc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3642:x1874622881682816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780158.758995:0:18752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1787780158.759025:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c03488e1a40 x1874622881682816/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787780174 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787780158.759043:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c03488e1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881682816:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1787780158.759245:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c047785da40 x1874622881681664/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787780174 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787780158.759257:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047785da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874622881681664:0@lo:400:kworker.0 00010000:00080000:2.0:1787780158.759269:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c047785e580 x1874622881682304/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787780174 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787780158.759277:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047785e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1874622881682304:0@lo:400:kworker.0 00000100:00100000:2.0:1787780158.759291:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348a092c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881681408:0@lo:400:kworker.0 00010000:00080000:2.0:1787780158.759306:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c047785d680 x1874622881682176/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787780174 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787780158.759315:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047785d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874622881682176:0@lo:400:kworker.0 00010000:00080000:2.0:1787780158.759329:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c047785fc00 x1874622881682688/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787780174 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787780158.759338:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047785fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1874622881682688:0@lo:400:kworker.0 00000004:00080000:1.0:1787780158.759376:0:17985:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1787780158.759385:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348a0a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:3644:1874622881681152:0@lo:400:kworker.0 00000100:00100000:1.0:1787780158.759401:0:17985:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0461bede00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17985:1874622881683200:0@lo:7:osp-pre-1-1.0 00000100:00100000:1.0:1787780158.759439:0:17985:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780158.759462:0:17985:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c047798e180 going to sleep for 11 seconds 00000100:00100000:2.0:1787780158.759475:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047785f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881681792:0@lo:400:kworker.0 00000004:00080000:1.0:1787780158.759482:0:17984:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00010000:00080000:2.0:1787780158.759490:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c047785de00 x1874622881682432/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787780174 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787780158.759499:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047785de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1874622881682432:0@lo:400:kworker.0 00000100:00100000:2.0:1787780158.759513:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348a09a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881681280:0@lo:400:kworker.0 00000100:00100000:2.0:1787780158.759527:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047785e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881681920:0@lo:400:kworker.0 00010000:00080000:2.0:1787780158.759540:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c047785f0c0 x1874622881682560/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787780174 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787780158.759548:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047785f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1874622881682560:0@lo:400:kworker.0 00000004:00080000:1.0:1787780158.759560:0:17984:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 566763720415ns, next at 0ns, rc = 0 00080000:00080000:1.0:1787780158.759569:0:17984:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:2.0:1787780158.759586:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787780158.759595:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0461becf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881683072:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787780158.759624:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787780158.759750:0:18752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881683072 00000100:00100000:2.0:1787780158.759757:0:18752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881683072 00000100:00100000:2.0:1787780158.759794:0:18752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787780158.759803:0:18752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346efcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3644:x1874622881683072:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787780158.759820:0:18752:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1787780158.759922:0:18752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346efcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3644:x1874622881683072:12345-0@lo:13:osp-pre-1-1.0 Request processed in 120us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780158.759930:0:18752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1787780158.759975:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0461becf00 x1874622881683072/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787780174 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787780158.759989:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0461becf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881683072:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1787780158.762933:0:17238:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787780158.762986:0:17238:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787780158.762991:0:17238:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787780158.762995:0:17238:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1787780158.763205:0:17222:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:2.0:1787780158.763435:0:18751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881683200 00000100:00100000:2.0:1787780158.763451:0:18751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881683200 00000100:00100000:2.0:1787780158.763518:0:18751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787780158.763532:0:18751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0461becb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17985:x1874622881683200:12345-0@lo:7:osp-pre-1-1.0 00000004:00080000:3.0:1787780158.772053:0:17974:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00002000:00080000:0.0:1787780158.772259:0:19055:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:0.0:1787780158.772272:0:19055:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:0.0:1787780158.772280:0:19055:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:7 to 0x2c0000401:33) 00002000:00080000:1.0:1787780158.774227:0:18751:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:1.0:1787780158.774240:0:18751:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x21:0x0] 00000100:00100000:1.0:1787780158.774363:0:18751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0461becb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17985:x1874622881683200:12345-0@lo:7:osp-pre-1-1.0 Request processed in 10828us (14916us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780158.774376:0:18751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:1.0:1787780158.774448:0:17985:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0461bede00 x1874622881683200/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787780174 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787780158.774477:0:17985:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0461bede00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17985:1874622881683200:0@lo:7:osp-pre-1-1.0 00000004:00080000:1.0:1787780158.774494:0:17985:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x21:0x0] 00000100:00100000:1.0:1787780158.774545:0:17985:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0461bede00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17985:1874622881683328:0@lo:5:osp-pre-1-1.0 00000100:00100000:1.0:1787780158.774626:0:17985:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780158.774656:0:17985:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c047798e180 going to sleep for 11 seconds 00000100:00100000:1.0:1787780158.774678:0:18748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881683328 00000100:00100000:1.0:1787780158.774685:0:18748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881683328 00000100:00100000:1.0:1787780158.774736:0:18748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787780158.774746:0:18748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0461bec780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17985:x1874622881683328:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:1.0:1787780158.774789:0:18748:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:1.0:1787780158.775013:0:18748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0461bec780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17985:x1874622881683328:12345-0@lo:5:osp-pre-1-1.0 Request processed in 267us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780158.775020:0:18748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:1.0:1787780158.775056:0:17985:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0461bede00 x1874622881683328/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787780174 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787780158.775066:0:17985:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0461bede00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17985:1874622881683328:0@lo:5:osp-pre-1-1.0 00000004:00080000:1.0:1787780158.775075:0:17985:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x21:0x0] from OST, last_created [0x2c0000400:0x21:0x0]last_used is [0x2c0000400:0x21:0x0] 00000100:00100000:1.0:1787780158.775103:0:17985:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0461bede00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17985:1874622881683456:0@lo:5:osp-pre-1-1.0 00000100:00100000:1.0:1787780158.775126:0:17985:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780158.775142:0:17985:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c047798e180 going to sleep for 11 seconds 00000100:00100000:1.0:1787780158.775153:0:18751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881683456 00000100:00100000:1.0:1787780158.775156:0:18751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881683456 00000100:00100000:1.0:1787780158.775176:0:18751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787780158.775182:0:18751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0461bef0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17985:x1874622881683456:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:1.0:1787780158.775222:0:18751:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 34 00002000:00010000:3.0:1787780158.799098:0:19055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787780158.799115:0:19055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001551b46d/0xc8fc0a5179961bb6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780158.799133:0:19055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=566s v=(0 0) 00010000:00010000:3.0:1787780158.799139:0:19055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787780158.799156:0:19055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001551b46d/0xc8fc0a5179961bb6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780158.799176:0:19055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001551b46d/0xc8fc0a5179961bb6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780158.799186:0:19055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001551b46d/0xc8fc0a5179961bb6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780158.799195:0:19055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001551b46d/0xc8fc0a5179961bb6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780158.799217:0:19055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787780158.799231:0:17231:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787780158.799236:0:17231:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001551b46d/0xc8fc0a5179961bb6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780158.799244:0:17231:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c04766dda00 already unused, calling callback (ffffffffc0d97420) 00010000:00010000:3.0:1787780158.799248:0:17231:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001551b46d/0xc8fc0a5179961bb6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780158.799257:0:17231:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001551b46d/0xc8fc0a5179961bb6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780158.799286:0:17231:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001551b46d/0xc8fc0a5179961bb6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780158.799306:0:17231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001551b46d/0xc8fc0a5179961bb6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780158.799330:0:17231:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787780158.799332:0:17231:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787780158.799334:0:17231:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787780158.800677:0:19055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787780158.800688:0:19055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054d1404c/0xc8fc0a5179961bbd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780158.800702:0:19055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=566s v=(0 0) 00010000:00010000:3.0:1787780158.800707:0:19055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787780158.800713:0:19055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000054d1404c/0xc8fc0a5179961bbd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780158.800727:0:19055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000054d1404c/0xc8fc0a5179961bbd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780158.800737:0:19055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054d1404c/0xc8fc0a5179961bbd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780158.800745:0:19055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000054d1404c/0xc8fc0a5179961bbd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780158.800766:0:19055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787780158.800777:0:18397:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787780158.800790:0:18397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000054d1404c/0xc8fc0a5179961bbd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780158.800797:0:18397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c04766dca00 already unused, calling callback (ffffffffc0d97420) 00010000:00010000:3.0:1787780158.800801:0:18397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000054d1404c/0xc8fc0a5179961bbd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780158.800811:0:18397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000054d1404c/0xc8fc0a5179961bbd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780158.801748:0:18397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000054d1404c/0xc8fc0a5179961bbd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780158.801758:0:18397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000054d1404c/0xc8fc0a5179961bbd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780158.801780:0:18397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787780158.801782:0:18397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787780158.801784:0:18397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787780158.802643:0:19055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787780158.802651:0:19055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000091bd699a/0xc8fc0a5179961bc4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780158.802663:0:19055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=566s v=(0 0) 00010000:00010000:3.0:1787780158.802668:0:19055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787780158.802675:0:19055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000091bd699a/0xc8fc0a5179961bc4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780158.802700:0:19055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000091bd699a/0xc8fc0a5179961bc4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780158.802710:0:19055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000091bd699a/0xc8fc0a5179961bc4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780158.802718:0:19055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000091bd699a/0xc8fc0a5179961bc4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780158.802740:0:19055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787780158.802752:0:17230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787780158.802757:0:17230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000091bd699a/0xc8fc0a5179961bc4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780158.802765:0:17230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c04766dd000 already unused, calling callback (ffffffffc0d97420) 00010000:00010000:3.0:1787780158.802769:0:17230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000091bd699a/0xc8fc0a5179961bc4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780158.802778:0:17230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000091bd699a/0xc8fc0a5179961bc4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780158.802789:0:17230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000091bd699a/0xc8fc0a5179961bc4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780158.802797:0:17230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000091bd699a/0xc8fc0a5179961bc4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780158.802896:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787780158.802899:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787780158.802900:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787780158.805016:0:19055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787780158.805028:0:19055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e7152357/0xc8fc0a5179961bcb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780158.805044:0:19055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=566s v=(0 0) 00010000:00010000:3.0:1787780158.805048:0:19055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787780158.805055:0:19055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e7152357/0xc8fc0a5179961bcb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780158.805684:0:19055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e7152357/0xc8fc0a5179961bcb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780158.805700:0:19055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e7152357/0xc8fc0a5179961bcb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780158.805708:0:19055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e7152357/0xc8fc0a5179961bcb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780158.805726:0:19055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787780158.805739:0:17231:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787780158.805745:0:17231:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e7152357/0xc8fc0a5179961bcb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780158.805764:0:17231:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0440030e00 already unused, calling callback (ffffffffc0d97420) 00010000:00010000:3.0:1787780158.805769:0:17231:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e7152357/0xc8fc0a5179961bcb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780158.805779:0:17231:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e7152357/0xc8fc0a5179961bcb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780158.805794:0:17231:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e7152357/0xc8fc0a5179961bcb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780158.805801:0:17231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e7152357/0xc8fc0a5179961bcb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780158.805902:0:17231:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787780158.805905:0:17231:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787780158.805906:0:17231:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787780158.806686:0:19055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787780158.806694:0:19055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a39f68a2/0xc8fc0a5179961bd2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780158.806706:0:19055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=566s v=(0 0) 00010000:00010000:3.0:1787780158.806710:0:19055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787780158.806717:0:19055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a39f68a2/0xc8fc0a5179961bd2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780158.806729:0:19055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a39f68a2/0xc8fc0a5179961bd2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780158.806746:0:19055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a39f68a2/0xc8fc0a5179961bd2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780158.806755:0:19055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a39f68a2/0xc8fc0a5179961bd2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780158.806771:0:19055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787780158.807333:0:18397:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787780158.807341:0:18397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a39f68a2/0xc8fc0a5179961bd2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780158.807352:0:18397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0440031600 already unused, calling callback (ffffffffc0d97420) 00010000:00010000:0.0:1787780158.807357:0:18397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a39f68a2/0xc8fc0a5179961bd2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780158.807366:0:18397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a39f68a2/0xc8fc0a5179961bd2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780158.807383:0:18397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a39f68a2/0xc8fc0a5179961bd2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780158.807390:0:18397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a39f68a2/0xc8fc0a5179961bd2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780158.807409:0:18397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787780158.807411:0:18397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787780158.807413:0:18397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787780158.811018:0:19055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787780158.811033:0:19055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b421e28a/0xc8fc0a5179961bd9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780158.811050:0:19055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=566s v=(0 0) 00010000:00010000:0.0:1787780158.811061:0:19055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787780158.811068:0:19055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b421e28a/0xc8fc0a5179961bd9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780158.811085:0:19055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b421e28a/0xc8fc0a5179961bd9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780158.811097:0:19055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b421e28a/0xc8fc0a5179961bd9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780158.811105:0:19055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b421e28a/0xc8fc0a5179961bd9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780158.811132:0:19055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787780158.811562:0:17230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787780158.811569:0:17230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b421e28a/0xc8fc0a5179961bd9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780158.811589:0:17230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0481373800 already unused, calling callback (ffffffffc0d97420) 00010000:00010000:3.0:1787780158.811593:0:17230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b421e28a/0xc8fc0a5179961bd9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780158.811601:0:17230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b421e28a/0xc8fc0a5179961bd9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780158.811618:0:17230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b421e28a/0xc8fc0a5179961bd9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780158.811626:0:17230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b421e28a/0xc8fc0a5179961bd9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780158.811651:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787780158.811660:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787780158.811662:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787780158.813694:0:19055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787780158.813704:0:19055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a07e46b3/0xc8fc0a5179961be0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780158.813719:0:19055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=566s v=(0 0) 00010000:00010000:0.0:1787780158.813724:0:19055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787780158.813729:0:19055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a07e46b3/0xc8fc0a5179961be0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780158.813742:0:19055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a07e46b3/0xc8fc0a5179961be0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780158.813751:0:19055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a07e46b3/0xc8fc0a5179961be0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780158.813766:0:19055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a07e46b3/0xc8fc0a5179961be0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780158.813783:0:19055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787780158.813965:0:18397:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787780158.813974:0:18397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a07e46b3/0xc8fc0a5179961be0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780158.813983:0:18397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0481373600 already unused, calling callback (ffffffffc0d97420) 00010000:00010000:3.0:1787780158.813988:0:18397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a07e46b3/0xc8fc0a5179961be0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780158.813997:0:18397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a07e46b3/0xc8fc0a5179961be0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780158.814016:0:18397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a07e46b3/0xc8fc0a5179961be0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780158.814024:0:18397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a07e46b3/0xc8fc0a5179961be0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780158.814060:0:18397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787780158.814063:0:18397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787780158.814065:0:18397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787780158.814943:0:19055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787780158.814950:0:19055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000006cab1d5/0xc8fc0a5179961be7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780158.814961:0:19055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=566s v=(0 0) 00010000:00010000:0.0:1787780158.814965:0:19055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787780158.814969:0:19055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000006cab1d5/0xc8fc0a5179961be7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780158.814979:0:19055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000006cab1d5/0xc8fc0a5179961be7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780158.814987:0:19055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000006cab1d5/0xc8fc0a5179961be7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780158.814994:0:19055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000006cab1d5/0xc8fc0a5179961be7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780158.815016:0:19055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000001:00080000:1.0:1787780158.815156:0:19563:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:1.0:1787780158.815174:0:19563:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:1.0:1787780158.815179:0:19563:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1787780158.815260:0:17230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1787780158.815321:0:18751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0461bef0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:17985:x1874622881683456:12345-0@lo:5:osp-pre-1-1.0 Request processed in 40134us (40189us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1787780158.815331:0:18751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:3.0:1787780158.815337:0:17230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000006cab1d5/0xc8fc0a5179961be7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780158.815348:0:17230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0481372400 already unused, calling callback (ffffffffc0d97420) 00010000:00010000:3.0:1787780158.815352:0:17230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000006cab1d5/0xc8fc0a5179961be7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780158.815368:0:17230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000006cab1d5/0xc8fc0a5179961be7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780158.815382:0:17230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000006cab1d5/0xc8fc0a5179961be7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787780158.815386:0:17985:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 2 00010000:00010000:3.0:1787780158.815393:0:17230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000006cab1d5/0xc8fc0a5179961be7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787780158.815399:0:17985:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0461bede00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17985:1874622881683456:0@lo:5:osp-pre-1-1.0 00000004:00080000:1.0:1787780158.815414:0:17985:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x21:0x0]-[0x2c0000400:0x41:0x0] 00000100:00100000:1.0:1787780158.815471:0:17985:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0461bede00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17985:1874622881683584:0@lo:900:osp-pre-1-1.0 00000100:00100000:1.0:1787780158.815516:0:17985:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780158.815538:0:17985:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c047798e180 going to sleep for 11 seconds 00002000:00010000:0.0:1787780158.815698:0:19055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787780158.815704:0:19055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000daa43216/0xc8fc0a5179961bee lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780158.815719:0:19055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=566s v=(0 0) 00010000:00010000:0.0:1787780158.815722:0:19055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787780158.815727:0:19055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000daa43216/0xc8fc0a5179961bee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780158.815737:0:19055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000daa43216/0xc8fc0a5179961bee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780158.815745:0:19055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000daa43216/0xc8fc0a5179961bee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780158.815751:0:19055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000daa43216/0xc8fc0a5179961bee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780158.815768:0:19055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787780158.815912:0:17230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787780158.815916:0:17230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000daa43216/0xc8fc0a5179961bee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780158.815923:0:17230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0481372200 already unused, calling callback (ffffffffc0d97420) 00010000:00010000:3.0:1787780158.815926:0:17230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000daa43216/0xc8fc0a5179961bee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780158.815935:0:17230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000daa43216/0xc8fc0a5179961bee lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780158.815947:0:17230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000daa43216/0xc8fc0a5179961bee lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780158.815954:0:17230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000daa43216/0xc8fc0a5179961bee lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780158.815983:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787780158.815986:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787780158.815988:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787780158.815991:0:17254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881683584 00000100:00100000:1.0:1787780158.815999:0:17254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881683584 00000100:00100000:1.0:1787780158.816046:0:17254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787780158.816056:0:17254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0461becf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17985:x1874622881683584:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:1.0:1787780158.816116:0:17254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0461becf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17985:x1874622881683584:12345-0@lo:900:osp-pre-1-1.0 Request processed in 61us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780158.816125:0:17254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1787780158.816169:0:17985:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0461bede00 x1874622881683584/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787780174 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787780158.816183:0:17985:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0461bede00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17985:1874622881683584:0@lo:900:osp-pre-1-1.0 00002000:00010000:0.0:1787780158.817747:0:19055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787780158.817758:0:19055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000937f61df/0xc8fc0a5179961bf5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780158.817772:0:19055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=566s v=(0 0) 00010000:00010000:0.0:1787780158.817777:0:19055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787780158.817783:0:19055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000937f61df/0xc8fc0a5179961bf5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780158.817795:0:19055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000937f61df/0xc8fc0a5179961bf5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780158.817827:0:19055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000937f61df/0xc8fc0a5179961bf5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780158.817835:0:19055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000937f61df/0xc8fc0a5179961bf5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780158.817875:0:19055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787780158.817884:0:17230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787780158.817889:0:17230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000937f61df/0xc8fc0a5179961bf5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780158.817897:0:17230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0481373000 already unused, calling callback (ffffffffc0d97420) 00010000:00010000:3.0:1787780158.817901:0:17230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000937f61df/0xc8fc0a5179961bf5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780158.817909:0:17230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000937f61df/0xc8fc0a5179961bf5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780158.817923:0:17230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000937f61df/0xc8fc0a5179961bf5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780158.818006:0:17230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000937f61df/0xc8fc0a5179961bf5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780158.818027:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787780158.818029:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787780158.818030:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787780158.818634:0:19055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787780158.818642:0:19055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003bdd5036/0xc8fc0a5179961bfc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780158.818651:0:19055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=566s v=(0 0) 00010000:00010000:0.0:1787780158.818655:0:19055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787780158.818660:0:19055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003bdd5036/0xc8fc0a5179961bfc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780158.818669:0:19055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003bdd5036/0xc8fc0a5179961bfc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780158.818677:0:19055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003bdd5036/0xc8fc0a5179961bfc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780158.818683:0:19055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003bdd5036/0xc8fc0a5179961bfc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780158.818716:0:19055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787780158.818754:0:17230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787780158.818759:0:17230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003bdd5036/0xc8fc0a5179961bfc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780158.818778:0:17230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0481373c00 already unused, calling callback (ffffffffc0d97420) 00010000:00010000:3.0:1787780158.818782:0:17230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003bdd5036/0xc8fc0a5179961bfc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780158.818790:0:17230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003bdd5036/0xc8fc0a5179961bfc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780158.818802:0:17230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003bdd5036/0xc8fc0a5179961bfc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780158.818810:0:17230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003bdd5036/0xc8fc0a5179961bfc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780158.818826:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787780158.818828:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787780158.818829:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787780158.820169:0:19055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787780158.820180:0:19055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000757da721/0xc8fc0a5179961c03 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780158.820194:0:19055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=566s v=(0 0) 00010000:00010000:0.0:1787780158.820198:0:19055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787780158.820203:0:19055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000757da721/0xc8fc0a5179961c03 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780158.820214:0:19055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000757da721/0xc8fc0a5179961c03 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780158.820224:0:19055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000757da721/0xc8fc0a5179961c03 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780158.820232:0:19055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000757da721/0xc8fc0a5179961c03 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780158.820256:0:19055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787780158.820329:0:17230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787780158.820337:0:17230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000757da721/0xc8fc0a5179961c03 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780158.820346:0:17230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0481372e00 already unused, calling callback (ffffffffc0d97420) 00010000:00010000:3.0:1787780158.820350:0:17230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000757da721/0xc8fc0a5179961c03 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780158.820359:0:17230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000757da721/0xc8fc0a5179961c03 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780158.820450:0:17230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000757da721/0xc8fc0a5179961c03 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780158.820459:0:17230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000757da721/0xc8fc0a5179961c03 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780158.820485:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787780158.820488:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787780158.820490:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787780158.821173:0:17231:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787780158.821181:0:18397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787780158.823884:0:19055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787780158.823899:0:19055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ed842b1e/0xc8fc0a5179961c0a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780158.823930:0:19055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=566s v=(0 0) 00010000:00010000:0.0:1787780158.823935:0:19055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787780158.823941:0:19055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ed842b1e/0xc8fc0a5179961c0a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780158.823958:0:19055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ed842b1e/0xc8fc0a5179961c0a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780158.823968:0:19055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ed842b1e/0xc8fc0a5179961c0a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780158.823975:0:19055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ed842b1e/0xc8fc0a5179961c0a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780158.823998:0:19055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787780158.824009:0:17230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787780158.824015:0:17230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ed842b1e/0xc8fc0a5179961c0a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780158.824023:0:17230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0481372c00 already unused, calling callback (ffffffffc0d97420) 00010000:00010000:3.0:1787780158.824027:0:17230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ed842b1e/0xc8fc0a5179961c0a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780158.824036:0:17230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ed842b1e/0xc8fc0a5179961c0a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780158.824051:0:17230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ed842b1e/0xc8fc0a5179961c0a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780158.824058:0:17230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ed842b1e/0xc8fc0a5179961c0a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780158.824348:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787780158.824350:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787780158.824352:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787780158.824962:0:19055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787780158.824970:0:19055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075c17888/0xc8fc0a5179961c11 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780158.824980:0:19055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=566s v=(0 0) 00010000:00010000:0.0:1787780158.824985:0:19055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787780158.824989:0:19055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000075c17888/0xc8fc0a5179961c11 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780158.825000:0:19055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000075c17888/0xc8fc0a5179961c11 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780158.825019:0:19055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075c17888/0xc8fc0a5179961c11 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780158.825026:0:19055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000075c17888/0xc8fc0a5179961c11 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780158.825040:0:19055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787780158.825153:0:17231:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787780158.825159:0:17231:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000075c17888/0xc8fc0a5179961c11 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780158.825167:0:17231:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0481372800 already unused, calling callback (ffffffffc0d97420) 00010000:00010000:0.0:1787780158.825172:0:17231:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000075c17888/0xc8fc0a5179961c11 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780158.825180:0:17231:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000075c17888/0xc8fc0a5179961c11 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780158.825191:0:17231:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000075c17888/0xc8fc0a5179961c11 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780158.825199:0:17231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075c17888/0xc8fc0a5179961c11 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780158.825216:0:17231:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787780158.825223:0:17231:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787780158.825225:0:17231:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787780158.825476:0:19055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787780158.825482:0:19055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f6f8db85/0xc8fc0a5179961c18 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780158.825491:0:19055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=566s v=(0 0) 00010000:00010000:0.0:1787780158.825494:0:19055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787780158.825498:0:19055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f6f8db85/0xc8fc0a5179961c18 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780158.825507:0:19055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f6f8db85/0xc8fc0a5179961c18 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780158.825515:0:19055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f6f8db85/0xc8fc0a5179961c18 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780158.825522:0:19055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f6f8db85/0xc8fc0a5179961c18 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780158.825535:0:19055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787780158.825628:0:18397:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787780158.825634:0:18397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f6f8db85/0xc8fc0a5179961c18 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780158.825643:0:18397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0481373200 already unused, calling callback (ffffffffc0d97420) 00010000:00010000:0.0:1787780158.825646:0:18397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6f8db85/0xc8fc0a5179961c18 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780158.825664:0:18397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6f8db85/0xc8fc0a5179961c18 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780158.825674:0:18397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f6f8db85/0xc8fc0a5179961c18 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780158.825680:0:18397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f6f8db85/0xc8fc0a5179961c18 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780158.825695:0:18397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787780158.825697:0:18397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787780158.825698:0:18397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787780158.826304:0:19055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787780158.826312:0:19055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f5cf51b8/0xc8fc0a5179961c1f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780158.826322:0:19055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=566s v=(0 0) 00010000:00010000:0.0:1787780158.826327:0:19055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787780158.826332:0:19055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f5cf51b8/0xc8fc0a5179961c1f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780158.826343:0:19055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f5cf51b8/0xc8fc0a5179961c1f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780158.826352:0:19055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f5cf51b8/0xc8fc0a5179961c1f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780158.826365:0:19055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f5cf51b8/0xc8fc0a5179961c1f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780158.826389:0:19055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787780158.826434:0:17230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787780158.826449:0:17230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f5cf51b8/0xc8fc0a5179961c1f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780158.826465:0:17230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0348c7be00 already unused, calling callback (ffffffffc0d97420) 00010000:00010000:2.0:1787780158.826471:0:17230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5cf51b8/0xc8fc0a5179961c1f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780158.826485:0:17230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5cf51b8/0xc8fc0a5179961c1f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780158.826515:0:17230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f5cf51b8/0xc8fc0a5179961c1f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780158.826524:0:17230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f5cf51b8/0xc8fc0a5179961c1f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780158.826579:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787780158.826582:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787780158.826584:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787780158.826879:0:19055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787780158.826887:0:19055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002b49de08/0xc8fc0a5179961c26 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780158.826898:0:19055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=566s v=(0 0) 00010000:00010000:0.0:1787780158.826902:0:19055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787780158.826907:0:19055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002b49de08/0xc8fc0a5179961c26 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780158.826919:0:19055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002b49de08/0xc8fc0a5179961c26 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780158.826928:0:19055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002b49de08/0xc8fc0a5179961c26 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780158.826937:0:19055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002b49de08/0xc8fc0a5179961c26 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780158.826957:0:19055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787780158.826971:0:17231:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787780158.826976:0:17231:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002b49de08/0xc8fc0a5179961c26 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780158.826992:0:17231:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0348c7a400 already unused, calling callback (ffffffffc0d97420) 00010000:00010000:0.0:1787780158.826998:0:17231:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002b49de08/0xc8fc0a5179961c26 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780158.827008:0:17231:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002b49de08/0xc8fc0a5179961c26 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780158.827023:0:17231:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002b49de08/0xc8fc0a5179961c26 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780158.827030:0:17231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002b49de08/0xc8fc0a5179961c26 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780158.827045:0:17231:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787780158.827046:0:17231:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787780158.827048:0:17231:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787780158.827367:0:19055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787780158.827374:0:19055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d493db32/0xc8fc0a5179961c2d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780158.827383:0:19055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=566s v=(0 0) 00010000:00010000:0.0:1787780158.827386:0:19055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787780158.827390:0:19055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d493db32/0xc8fc0a5179961c2d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780158.827658:0:19055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d493db32/0xc8fc0a5179961c2d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780158.827673:0:19055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d493db32/0xc8fc0a5179961c2d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780158.827680:0:19055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d493db32/0xc8fc0a5179961c2d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780158.827702:0:19055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787780158.827728:0:18397:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787780158.827736:0:18397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d493db32/0xc8fc0a5179961c2d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780158.827754:0:18397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0348c7b600 already unused, calling callback (ffffffffc0d97420) 00010000:00010000:1.0:1787780158.827759:0:18397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d493db32/0xc8fc0a5179961c2d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780158.827769:0:18397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d493db32/0xc8fc0a5179961c2d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780158.827785:0:18397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d493db32/0xc8fc0a5179961c2d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780158.827793:0:18397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d493db32/0xc8fc0a5179961c2d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780158.827813:0:18397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787780158.827816:0:18397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787780158.827818:0:18397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787780158.828109:0:19055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787780158.828115:0:19055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c51ddabd/0xc8fc0a5179961c34 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780158.828125:0:19055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=566s v=(0 0) 00010000:00010000:1.0:1787780158.828129:0:19055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787780158.828134:0:19055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c51ddabd/0xc8fc0a5179961c34 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780158.828143:0:19055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c51ddabd/0xc8fc0a5179961c34 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780158.828159:0:19055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c51ddabd/0xc8fc0a5179961c34 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780158.828167:0:19055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c51ddabd/0xc8fc0a5179961c34 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780158.828185:0:19055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787780158.828232:0:17230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787780158.828248:0:17230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c51ddabd/0xc8fc0a5179961c34 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780158.828285:0:17230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0347e4a000 already unused, calling callback (ffffffffc0d97420) 00010000:00010000:2.0:1787780158.828291:0:17230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c51ddabd/0xc8fc0a5179961c34 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780158.828302:0:17230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c51ddabd/0xc8fc0a5179961c34 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780158.828321:0:17230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c51ddabd/0xc8fc0a5179961c34 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780158.828329:0:17230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c51ddabd/0xc8fc0a5179961c34 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780158.828355:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787780158.828357:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787780158.828359:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787780158.828534:0:19055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787780158.828543:0:19055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009a1c82d7/0xc8fc0a5179961c3b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780158.828565:0:19055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=566s v=(0 0) 00010000:00010000:1.0:1787780158.828568:0:19055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787780158.828581:0:19055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009a1c82d7/0xc8fc0a5179961c3b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780158.828591:0:19055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009a1c82d7/0xc8fc0a5179961c3b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780158.828598:0:19055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009a1c82d7/0xc8fc0a5179961c3b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780158.828604:0:19055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009a1c82d7/0xc8fc0a5179961c3b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780158.828636:0:19055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787780158.829134:0:17231:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787780158.829142:0:17231:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009a1c82d7/0xc8fc0a5179961c3b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780158.829157:0:17231:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0347e4bc00 already unused, calling callback (ffffffffc0d97420) 00010000:00010000:0.0:1787780158.829162:0:17231:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009a1c82d7/0xc8fc0a5179961c3b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780158.829172:0:17231:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009a1c82d7/0xc8fc0a5179961c3b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780158.829186:0:17231:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009a1c82d7/0xc8fc0a5179961c3b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780158.829194:0:17231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009a1c82d7/0xc8fc0a5179961c3b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780158.829213:0:17231:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787780158.829223:0:17231:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787780158.829224:0:17231:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787780158.829771:0:19055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787780158.829778:0:19055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e7152357/0xc8fc0a5179961c42 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780158.829788:0:19055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=566s v=(0 0) 00010000:00010000:3.0:1787780158.829792:0:19055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787780158.829797:0:19055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e7152357/0xc8fc0a5179961c42 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780158.829807:0:19055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e7152357/0xc8fc0a5179961c42 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780158.829815:0:19055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e7152357/0xc8fc0a5179961c42 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780158.829823:0:19055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e7152357/0xc8fc0a5179961c42 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780158.830128:0:18397:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787780158.830135:0:18397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e7152357/0xc8fc0a5179961c42 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780158.830144:0:18397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0440030e00 already unused, calling callback (ffffffffc0d97420) 00010000:00010000:0.0:1787780158.830149:0:18397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e7152357/0xc8fc0a5179961c42 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780158.830158:0:18397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e7152357/0xc8fc0a5179961c42 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780158.830172:0:18397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e7152357/0xc8fc0a5179961c42 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780158.830182:0:18397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787780158.830185:0:18397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787780158.830186:0:18397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787780158.830320:0:19055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787780158.830325:0:19055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e7152357/0xc8fc0a5179961c42 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787780158.833117:0:19055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787780158.833138:0:19055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aed7ec73/0xc8fc0a5179961c49 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780158.833154:0:19055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=566s v=(0 0) 00010000:00010000:3.0:1787780158.833159:0:19055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787780158.833165:0:19055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aed7ec73/0xc8fc0a5179961c49 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780158.833180:0:19055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aed7ec73/0xc8fc0a5179961c49 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780158.833189:0:19055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aed7ec73/0xc8fc0a5179961c49 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780158.833197:0:19055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aed7ec73/0xc8fc0a5179961c49 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780158.833214:0:19055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787780158.835756:0:17230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787780158.835777:0:17230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aed7ec73/0xc8fc0a5179961c49 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780158.835797:0:17230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0440030000 already unused, calling callback (ffffffffc0d97420) 00010000:00010000:2.0:1787780158.835803:0:17230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aed7ec73/0xc8fc0a5179961c49 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780158.835817:0:17230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aed7ec73/0xc8fc0a5179961c49 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780158.835891:0:17230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aed7ec73/0xc8fc0a5179961c49 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780158.835901:0:17230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aed7ec73/0xc8fc0a5179961c49 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780158.835938:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787780158.835941:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787780158.835944:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787780158.836528:0:19055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787780158.836541:0:19055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ed6349b5/0xc8fc0a5179961c50 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780158.836567:0:19055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=566s v=(0 0) 00010000:00010000:3.0:1787780158.836579:0:19055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787780158.836586:0:19055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ed6349b5/0xc8fc0a5179961c50 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780158.836599:0:19055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ed6349b5/0xc8fc0a5179961c50 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780158.836619:0:19055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ed6349b5/0xc8fc0a5179961c50 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780158.836626:0:19055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ed6349b5/0xc8fc0a5179961c50 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780158.836653:0:19055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787780158.837010:0:17231:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787780158.837018:0:17231:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ed6349b5/0xc8fc0a5179961c50 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780158.837029:0:17231:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0440030200 already unused, calling callback (ffffffffc0d97420) 00010000:00010000:0.0:1787780158.837034:0:17231:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ed6349b5/0xc8fc0a5179961c50 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780158.837045:0:17231:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ed6349b5/0xc8fc0a5179961c50 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780158.837082:0:17231:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ed6349b5/0xc8fc0a5179961c50 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780158.837090:0:17231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ed6349b5/0xc8fc0a5179961c50 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780158.837109:0:17231:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787780158.837111:0:17231:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787780158.837112:0:17231:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787780158.837674:0:19055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787780158.837682:0:19055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3a89eb6/0xc8fc0a5179961c57 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780158.837692:0:19055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=566s v=(0 0) 00010000:00010000:3.0:1787780158.837696:0:19055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787780158.837701:0:19055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b3a89eb6/0xc8fc0a5179961c57 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780158.837712:0:19055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b3a89eb6/0xc8fc0a5179961c57 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780158.837720:0:19055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3a89eb6/0xc8fc0a5179961c57 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780158.837728:0:19055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b3a89eb6/0xc8fc0a5179961c57 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780158.837762:0:19055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787780158.837918:0:18397:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787780158.837924:0:18397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b3a89eb6/0xc8fc0a5179961c57 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780158.837932:0:18397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0440031a00 already unused, calling callback (ffffffffc0d97420) 00010000:00010000:0.0:1787780158.837937:0:18397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3a89eb6/0xc8fc0a5179961c57 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780158.837945:0:18397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3a89eb6/0xc8fc0a5179961c57 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780158.837956:0:18397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b3a89eb6/0xc8fc0a5179961c57 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780158.837964:0:18397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b3a89eb6/0xc8fc0a5179961c57 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780158.837990:0:18397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787780158.837992:0:18397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787780158.837994:0:18397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787780158.838402:0:19055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787780158.838409:0:19055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e7152357/0xc8fc0a5179961c5e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780158.838417:0:19055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=566s v=(0 0) 00010000:00010000:3.0:1787780158.838420:0:19055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787780158.838425:0:19055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e7152357/0xc8fc0a5179961c5e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780158.838434:0:19055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e7152357/0xc8fc0a5179961c5e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780158.838442:0:19055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e7152357/0xc8fc0a5179961c5e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780158.838449:0:19055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e7152357/0xc8fc0a5179961c5e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780158.838472:0:19055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787780158.839077:0:19055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787780158.839084:0:19055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e3382dbd/0xc8fc0a5179961c65 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780158.839094:0:19055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=566s v=(0 0) 00010000:00010000:3.0:1787780158.839104:0:19055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787780158.839110:0:19055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e3382dbd/0xc8fc0a5179961c65 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780158.839120:0:19055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e3382dbd/0xc8fc0a5179961c65 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780158.839128:0:19055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e3382dbd/0xc8fc0a5179961c65 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780158.839135:0:19055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e3382dbd/0xc8fc0a5179961c65 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780158.839155:0:19055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787780158.839396:0:17231:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787780158.839411:0:17231:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e7152357/0xc8fc0a5179961c5e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780158.839420:0:17231:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0440030e00 already unused, calling callback (ffffffffc0d97420) 00010000:00010000:0.0:1787780158.839425:0:17231:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e7152357/0xc8fc0a5179961c5e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780158.839440:0:17231:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e7152357/0xc8fc0a5179961c5e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780158.839454:0:17231:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e7152357/0xc8fc0a5179961c5e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780158.839461:0:17231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e7152357/0xc8fc0a5179961c5e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780158.839478:0:17231:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787780158.839481:0:17231:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e3382dbd/0xc8fc0a5179961c65 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780158.839486:0:17231:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0440031000 already unused, calling callback (ffffffffc0d97420) 00010000:00010000:0.0:1787780158.839496:0:17231:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e3382dbd/0xc8fc0a5179961c65 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780158.839505:0:17231:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e3382dbd/0xc8fc0a5179961c65 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780158.839515:0:17231:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e3382dbd/0xc8fc0a5179961c65 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780158.839522:0:17231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e3382dbd/0xc8fc0a5179961c65 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780158.839536:0:17231:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787780158.839538:0:17231:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787780158.839539:0:17231:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787780158.840342:0:19055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787780158.840350:0:19055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e3ee7153/0xc8fc0a5179961c6c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780158.840362:0:19055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=566s v=(0 0) 00010000:00010000:3.0:1787780158.840365:0:19055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787780158.840371:0:19055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e3ee7153/0xc8fc0a5179961c6c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780158.840395:0:19055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e3ee7153/0xc8fc0a5179961c6c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780158.840404:0:19055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e3ee7153/0xc8fc0a5179961c6c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780158.840420:0:19055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e3ee7153/0xc8fc0a5179961c6c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780158.840437:0:19055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:3.0:1787780158.840514:0:19055:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:6 00000100:00100000:3.0:1787780158.840630:0:19055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347dade00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:17269:x1874622881682944:12345-0@lo:5:osp-pre-1-0.0 Request processed in 81732us (82036us total) trans 0 rc 0/0 00010000:00010000:0.0:1787780158.840641:0:18397:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1787780158.840642:0:19055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00010000:0.0:1787780158.840650:0:18397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e3ee7153/0xc8fc0a5179961c6c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780158.840660:0:18397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0440031200 already unused, calling callback (ffffffffc0d97420) 00010000:00010000:0.0:1787780158.840664:0:18397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e3ee7153/0xc8fc0a5179961c6c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780158.840674:0:18397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e3ee7153/0xc8fc0a5179961c6c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780158.840690:0:18397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e3ee7153/0xc8fc0a5179961c6c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787780158.840704:0:17269:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c03488e30c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17269:1874622881682944:0@lo:5:osp-pre-1-0.0 00010000:00010000:0.0:1787780158.840706:0:18397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e3ee7153/0xc8fc0a5179961c6c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787780158.840726:0:17269:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x21:0x0] from OST, last_created [0x2c0000401:0x21:0x0]last_used is [0x2c0000401:0x6:0x0] 00010000:00010000:0.0:1787780158.840728:0:18397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787780158.840731:0:18397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787780158.840735:0:18397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787780158.840776:0:17269:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347dad2c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17269:1874622881683712:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1787780158.840827:0:17269:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780158.840890:0:17269:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0346915f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787780158.840918:0:18750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881683712 00000100:00100000:3.0:1787780158.840924:0:18750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881683712 00000100:00100000:3.0:1787780158.840973:0:18750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787780158.840985:0:18750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347dacf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:17269:x1874622881683712:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1787780158.841022:0:18750:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 34 00010000:00010000:2.0:1787780158.841951:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787780158.853219:0:18750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347dacf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:17269:x1874622881683712:12345-0@lo:5:osp-pre-1-0.0 Request processed in 12230us (12399us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1787780158.853232:0:18750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787780158.853526:0:17269:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347dad2c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17269:1874622881683712:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1787780158.853545:0:17269:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x21:0x0]-[0x2c0000401:0x41:0x0] 00000100:00100000:3.0:1787780159.260593:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c03489f43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881683840:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787780159.260657:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787780159.260746:0:18752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881683840 00000100:00100000:0.0:1787780159.260755:0:18752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881683840 00000100:00100000:0.0:1787780159.260809:0:18752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787780159.260819:0:18752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347dae940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881683840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787780159.260869:0:18752:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1787780159.260934:0:18752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347dae940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881683840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 117us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780159.260942:0:18752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787780159.260986:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c03489f43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881683840:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787780159.836247:0:17231:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787780160.283985:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0461bede00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881683968:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787780160.284063:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787780160.284413:0:18753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881683968 00000100:00100000:0.0:1787780160.284420:0:18753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881683968 00000100:00100000:0.0:1787780160.284472:0:18753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787780160.284482:0:18753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03489f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881683968:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787780160.284502:0:18753:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1787780160.284541:0:18753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03489f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881683968:12345-0@lo:13:osp-pre-0-1.0 Request processed in 61us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780160.284559:0:18753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787780160.284618:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0461bede00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881683968:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1787780160.284683:0:17238:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787780160.865094:0:18397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787780161.164789:0:19920:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg331-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1787780161.308183:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787780161.308216:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347dacb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881684096:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787780161.308306:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787780161.308483:0:17248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881684096 00000100:00100000:0.0:1787780161.308491:0:17248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881684096 00000100:00100000:0.0:1787780161.308539:0:17248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787780161.308547:0:17248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03489f43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881684096:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787780161.308598:0:17248:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1787780161.308645:0:17248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03489f43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881684096:12345-0@lo:41:osp-pre-0-1.0 Request processed in 99us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780161.308652:0:17248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787780161.308695:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347dacb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881684096:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787780161.312446:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787780161.312468:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347dafc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881684224:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787780161.312533:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780161.312605:0:17247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881684224 00000100:00100000:3.0:1787780161.312613:0:17247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881684224 00000100:00100000:3.0:1787780161.312662:0:17247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787780161.312671:0:17247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347dae580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881684224:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787780161.312704:0:17247:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787780161.312748:0:17247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347dae580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881684224:12345-0@lo:41:osp-pre-1-0.0 Request processed in 79us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780161.312755:0:17247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787780161.312810:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347dafc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881684224:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1787780161.889974:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787780162.210731:0:19973:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787780162.211001:0:19973:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787780162.908178:0:17231:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787780163.142251:0:20023:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787780163.142507:0:20023:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1787780163.543970:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787780163.550271:0:17237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863759744 00000100:00100000:0.0:1787780163.550287:0:17237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863759744 00000100:00100000:0.0:1787780163.550944:0:17237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 114 00000100:00100000:0.0:1787780163.550954:0:17237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046f20c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2407:x1874622863759744:12345-192.168.203.31@tcp:250:mount.lustre.0 00010000:00080000:0.0:1787780163.550984:0:17237:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from c6cfa51b-ab50-4fc0-ae19-b724d7d272e4@192.168.203.31@tcp t0 exp 0000000000000000 cur 571 last 0 00000020:00000080:0.0:1787780163.551017:0:17237:0:(genops.c:1385:class_connect()) connect: client c6cfa51b-ab50-4fc0-ae19-b724d7d272e4, cookie 0xc8fc0a5179961c73 00000100:00080000:0.0:1787780163.551162:0:17237:0:(import.c:65:import_set_state_nolock()) ffff9c0345e36000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787780163.551251:0:17237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046f20c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6cfa51b-ab50-4fc0-ae19-b724d7d272e4+5:2407:x1874622863759744:12345-192.168.203.31@tcp:250:mount.lustre.0 Request processed in 297us (7290us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780163.551279:0:17237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 114 00000100:00100000:1.0:1787780163.565977:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787780163.567129:0:17236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863759872 00000100:00100000:3.0:1787780163.567144:0:17236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863759872 00000100:00100000:3.0:1787780163.567213:0:17236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 115 00000100:00100000:3.0:1787780163.567223:0:17236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046f20f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6cfa51b-ab50-4fc0-ae19-b724d7d272e4+5:14953:x1874622863759872:12345-192.168.203.31@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787780163.567239:0:17236:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787780163.567257:0:17236:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0440031e00/0xc8fc0a5179961c7a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xf757128131ea218f expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780163.567284:0:17236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0440031e00/0xc8fc0a5179961c7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea218f expref: 6 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780163.567315:0:17236:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0440031e00/0xc8fc0a5179961c7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea218f expref: 6 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780163.567324:0:17236:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0440031e00, rc 0) 00000100:00100000:3.0:1787780163.567391:0:17236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046f20f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6cfa51b-ab50-4fc0-ae19-b724d7d272e4+6:14953:x1874622863759872:12345-192.168.203.31@tcp:101:mount.lustre.0 Request processed in 169us (1424us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780163.567398:0:17236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 115 00000100:00100000:1.0:1787780163.573202:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787780163.573287:0:17237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863760000 00000100:00100000:0.0:1787780163.573297:0:17237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863760000 00000100:00100000:0.0:1787780163.573351:0:17237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 116 00000100:00100000:0.0:1787780163.573362:0:17237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046f20e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6cfa51b-ab50-4fc0-ae19-b724d7d272e4+6:14953:x1874622863760000:12345-192.168.203.31@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787780163.573481:0:17237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046f20e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6cfa51b-ab50-4fc0-ae19-b724d7d272e4+6:14953:x1874622863760000:12345-192.168.203.31@tcp:501:mount.lustre.0 Request processed in 120us (287us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787780163.573490:0:17237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 116 00000100:00100000:0.0:1787780163.585217:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787780163.586010:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863760128 00000100:00100000:1.0:1787780163.586020:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863760128 00000100:00100000:1.0:1787780163.586078:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 117 00000100:00100000:1.0:1787780163.586088:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046f20fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6cfa51b-ab50-4fc0-ae19-b724d7d272e4+6:14953:x1874622863760128:12345-192.168.203.31@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787780163.586103:0:17234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787780163.586120:0:17234:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0347e4bc00/0xc8fc0a5179961c81 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xf757128131ea2196 expref: -99 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780163.586147:0:17234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0347e4bc00/0xc8fc0a5179961c81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea2196 expref: 7 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780163.586159:0:17234:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0347e4bc00/0xc8fc0a5179961c81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea2196 expref: 7 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780163.586167:0:17234:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0347e4bc00, rc 0) 00000100:00100000:1.0:1787780163.586229:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046f20fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6cfa51b-ab50-4fc0-ae19-b724d7d272e4+7:14953:x1874622863760128:12345-192.168.203.31@tcp:101:mount.lustre.0 Request processed in 144us (1023us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780163.586236:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 117 00000100:00100000:1.0:1787780163.595215:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787780163.595318:0:17236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863760256 00000100:00100000:3.0:1787780163.595329:0:17236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863760256 00000100:00100000:3.0:1787780163.595385:0:17236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 118 00000100:00100000:3.0:1787780163.595395:0:17236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046f20ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6cfa51b-ab50-4fc0-ae19-b724d7d272e4+7:14953:x1874622863760256:12345-192.168.203.31@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787780163.595567:0:17236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046f20ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6cfa51b-ab50-4fc0-ae19-b724d7d272e4+8:14953:x1874622863760256:12345-192.168.203.31@tcp:501:mount.lustre.0 Request processed in 172us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780163.595575:0:17236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 118 00000100:00100000:3.0:1787780163.601981:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787780163.602342:0:17237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863760384 00000100:00100000:0.0:1787780163.602352:0:17237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863760384 00000100:00100000:0.0:1787780163.602415:0:17237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 119 00000100:00100000:0.0:1787780163.602424:0:17237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0468599450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6cfa51b-ab50-4fc0-ae19-b724d7d272e4+8:14953:x1874622863760384:12345-192.168.203.31@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787780163.602589:0:17237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0468599450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6cfa51b-ab50-4fc0-ae19-b724d7d272e4+8:14953:x1874622863760384:12345-192.168.203.31@tcp:503:mount.lustre.0 Request processed in 165us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780163.602598:0:17237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 119 00000100:00100000:0.0:1787780163.610918:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787780163.611285:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863760512 00000100:00100000:1.0:1787780163.611309:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863760512 00000100:00100000:1.0:1787780163.611367:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 120 00000100:00100000:1.0:1787780163.611378:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046859b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6cfa51b-ab50-4fc0-ae19-b724d7d272e4+8:14971:x1874622863760512:12345-192.168.203.31@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787780163.611549:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046859b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6cfa51b-ab50-4fc0-ae19-b724d7d272e4+8:14971:x1874622863760512:12345-192.168.203.31@tcp:502:llog_process_th.0 Request processed in 163us (632us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780163.611558:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 120 00000100:00100000:1.0:1787780163.647931:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787780163.648063:0:17236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863760640 00000100:00100000:3.0:1787780163.648074:0:17236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863760640 00000100:00100000:3.0:1787780163.648131:0:17236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 121 00000100:00100000:3.0:1787780163.648141:0:17236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046859a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6cfa51b-ab50-4fc0-ae19-b724d7d272e4+8:14971:x1874622863760640:12345-192.168.203.31@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787780163.648317:0:17236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046859a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6cfa51b-ab50-4fc0-ae19-b724d7d272e4+8:14971:x1874622863760640:12345-192.168.203.31@tcp:502:llog_process_th.0 Request processed in 176us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780163.648325:0:17236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 121 00000100:00100000:3.0:1787780163.682325:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787780163.682458:0:17237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863760768 00000100:00100000:0.0:1787780163.682473:0:17237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863760768 00000100:00100000:0.0:1787780163.682559:0:17237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 122 00000100:00100000:0.0:1787780163.682569:0:17237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0468599050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6cfa51b-ab50-4fc0-ae19-b724d7d272e4+8:14971:x1874622863760768:12345-192.168.203.31@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787780163.682736:0:17237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0468599050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6cfa51b-ab50-4fc0-ae19-b724d7d272e4+8:14971:x1874622863760768:12345-192.168.203.31@tcp:502:llog_process_th.0 Request processed in 168us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780163.682745:0:17237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 122 00000100:00100000:0.0:1787780163.686770:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787780163.686876:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863760896 00000100:00100000:1.0:1787780163.686896:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863760896 00000100:00100000:1.0:1787780163.686952:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 123 00000100:00100000:1.0:1787780163.686961:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0468598850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6cfa51b-ab50-4fc0-ae19-b724d7d272e4+8:14953:x1874622863760896:12345-192.168.203.31@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787780163.686977:0:17234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787780163.686995:0:17234:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0347e4ae00/0xc8fc0a5179961c88 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf757128131ea21c7 expref: -99 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780163.687023:0:17234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0347e4ae00/0xc8fc0a5179961c88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea21c7 expref: 9 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780163.687035:0:17234:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0347e4ae00/0xc8fc0a5179961c88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea21c7 expref: 9 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780163.687044:0:17234:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0347e4ae00, rc 0) 00000100:00100000:1.0:1787780163.687101:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0468598850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6cfa51b-ab50-4fc0-ae19-b724d7d272e4+9:14953:x1874622863760896:12345-192.168.203.31@tcp:101:mount.lustre.0 Request processed in 140us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780163.687109:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 123 00000100:00100000:1.0:1787780163.707430:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787780163.707584:0:17236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863761024 00000100:00100000:3.0:1787780163.707600:0:17236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863761024 00000100:00100000:3.0:1787780163.707664:0:17236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 124 00000100:00100000:3.0:1787780163.707673:0:17236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046859a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6cfa51b-ab50-4fc0-ae19-b724d7d272e4+9:14953:x1874622863761024:12345-192.168.203.31@tcp:256:mount.lustre.0 20000000:01000000:3.0:1787780163.707708:0:17236:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1787780163.707727:0:17236:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1787780163.707731:0:17236:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1787780163.707734:0:17236:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1787780163.707736:0:17236:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1787780163.707739:0:17236:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:2.0:1787780163.714442:0:17236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046859a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6cfa51b-ab50-4fc0-ae19-b724d7d272e4+9:14953:x1874622863761024:12345-192.168.203.31@tcp:256:mount.lustre.0 Request processed in 6758us (7009us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780163.714458:0:17236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 124 00000100:00100000:0.0:1787780163.723933:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787780163.724034:0:17237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863761152 00000100:00100000:3.0:1787780163.724047:0:17237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863761152 00000100:00100000:0.0:1787780163.724243:0:17237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 125 00000100:00100000:0.0:1787780163.724255:0:17237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0468598450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6cfa51b-ab50-4fc0-ae19-b724d7d272e4+9:14953:x1874622863761152:12345-192.168.203.31@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787780163.724278:0:17237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787780163.724302:0:17237:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0348c7ae00/0xc8fc0a5179961c8f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf757128131ea21ce expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780163.724340:0:17237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0348c7ae00/0xc8fc0a5179961c8f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea21ce expref: 10 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780163.724353:0:17237:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0348c7ae00/0xc8fc0a5179961c8f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea21ce expref: 10 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780163.724364:0:17237:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0348c7ae00, rc 0) 00000100:00100000:0.0:1787780163.724439:0:17237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0468598450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6cfa51b-ab50-4fc0-ae19-b724d7d272e4+10:14953:x1874622863761152:12345-192.168.203.31@tcp:101:mount.lustre.0 Request processed in 186us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780163.724448:0:17237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 125 00000100:00100000:1.0:1787780163.726813:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787780163.729983:0:17236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863761280 00000100:00100000:2.0:1787780163.730000:0:17236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863761280 00000100:00100000:2.0:1787780163.730074:0:17236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 126 00000100:00100000:2.0:1787780163.730084:0:17236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0468598050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6cfa51b-ab50-4fc0-ae19-b724d7d272e4+10:14953:x1874622863761280:12345-192.168.203.31@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787780163.730268:0:17236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0468598050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6cfa51b-ab50-4fc0-ae19-b724d7d272e4+10:14953:x1874622863761280:12345-192.168.203.31@tcp:501:mount.lustre.0 Request processed in 185us (3469us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780163.730276:0:17236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 126 00000100:00100000:3.0:1787780163.738135:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787780163.738455:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863761408 00000100:00100000:1.0:1787780163.738468:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863761408 00000100:00100000:1.0:1787780163.738556:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 127 00000100:00100000:1.0:1787780163.738568:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0468599850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6cfa51b-ab50-4fc0-ae19-b724d7d272e4+10:14953:x1874622863761408:12345-192.168.203.31@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787780163.738790:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0468599850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6cfa51b-ab50-4fc0-ae19-b724d7d272e4+10:14953:x1874622863761408:12345-192.168.203.31@tcp:503:mount.lustre.0 Request processed in 225us (670us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780163.738799:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 127 00000100:00100000:1.0:1787780163.747514:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787780163.751300:0:17236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863761536 00000100:00100000:2.0:1787780163.751324:0:17236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863761536 00000100:00100000:2.0:1787780163.751415:0:17236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 128 00000100:00100000:2.0:1787780163.751428:0:17236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c044502e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6cfa51b-ab50-4fc0-ae19-b724d7d272e4+10:14978:x1874622863761536:12345-192.168.203.31@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787780163.762110:0:17236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c044502e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6cfa51b-ab50-4fc0-ae19-b724d7d272e4+10:14978:x1874622863761536:12345-192.168.203.31@tcp:502:llog_process_th.0 Request processed in 10667us (14599us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780163.762160:0:17236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 128 00000100:00100000:2.0:1787780163.787020:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787780163.787208:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863761664 00000100:00100000:1.0:1787780163.787222:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863761664 00000100:00100000:1.0:1787780163.787296:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 129 00000100:00100000:1.0:1787780163.787307:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c044502f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6cfa51b-ab50-4fc0-ae19-b724d7d272e4+10:14978:x1874622863761664:12345-192.168.203.31@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787780163.787518:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c044502f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6cfa51b-ab50-4fc0-ae19-b724d7d272e4+10:14978:x1874622863761664:12345-192.168.203.31@tcp:502:llog_process_th.0 Request processed in 212us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780163.787527:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 129 00000100:00100000:1.0:1787780163.793135:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787780163.793183:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787780163.796745:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863761792 00000100:00100000:3.0:1787780163.796762:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863761792 00000100:00100000:3.0:1787780163.796813:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863762048 00000100:00100000:3.0:1787780163.796816:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863762048 00000100:00100000:3.0:1787780163.796864:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 7 00000100:00100000:3.0:1787780163.796873:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0461bede00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2407:x1874622863761792:12345-192.168.203.31@tcp:38:mount.lustre.0 00010000:00080000:3.0:1787780163.796904:0:17244:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 6e302a01-7f05-4001-b9ff-8e623671b6e0@192.168.203.31@tcp t0 exp 0000000000000000 cur 571 last 0 00000100:00100000:2.0:1787780163.796946:0:17242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 8 00000100:00100000:2.0:1787780163.796959:0:17242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346da43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2407:x1874622863762048:12345-192.168.203.31@tcp:38:mount.lustre.0 00000020:00000080:3.0:1787780163.796964:0:17244:0:(genops.c:1385:class_connect()) connect: client 6e302a01-7f05-4001-b9ff-8e623671b6e0, cookie 0xc8fc0a5179961c96 00000004:00100000:3.0:1787780163.796993:0:17244:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00010000:00080000:2.0:1787780163.796999:0:17242:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 6e302a01-7f05-4001-b9ff-8e623671b6e0@192.168.203.31@tcp t0 exp 0000000000000000 cur 571 last 0 00000020:00000080:2.0:1787780163.797065:0:17242:0:(genops.c:1385:class_connect()) connect: client 6e302a01-7f05-4001-b9ff-8e623671b6e0, cookie 0xc8fc0a5179961c9d 00000004:00100000:2.0:1787780163.797096:0:17242:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1787780163.797398:0:17244:0:(import.c:65:import_set_state_nolock()) ffff9c0341c0f000 : changing import state from RECOVER to FULL 00000100:00080000:2.0:1787780163.797451:0:17242:0:(import.c:65:import_set_state_nolock()) ffff9c047117a800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787780163.797486:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0461bede00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e302a01-7f05-4001-b9ff-8e623671b6e0+6:2407:x1874622863761792:12345-192.168.203.31@tcp:38:mount.lustre.0 Request processed in 609us (4362us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780163.797498:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 7 00000100:00100000:2.0:1787780163.797514:0:17242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346da43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e302a01-7f05-4001-b9ff-8e623671b6e0+6:2407:x1874622863762048:12345-192.168.203.31@tcp:38:mount.lustre.0 Request processed in 553us (4326us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780163.797525:0:17242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 8 00000100:00100000:0.0:1787780163.812298:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787780163.812340:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787780163.812376:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787780163.812460:0:17243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863762304 00000100:00100000:3.0:1787780163.812469:0:17243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863762304 00000100:00100000:3.0:1787780163.812546:0:17243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863762176 00000100:00100000:3.0:1787780163.812562:0:17243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863762176 00000100:00100000:3.0:1787780163.812584:0:17243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863761920 00000100:00100000:3.0:1787780163.812599:0:17243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863761920 00000100:00100000:3.0:1787780163.812616:0:17243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 9 00000100:00100000:3.0:1787780163.812626:0:17243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346cff0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e302a01-7f05-4001-b9ff-8e623671b6e0+7:14953:x1874622863762304:12345-192.168.203.31@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787780163.812665:0:17243:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1787780163.812751:0:17243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346cff0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e302a01-7f05-4001-b9ff-8e623671b6e0+7:14953:x1874622863762304:12345-192.168.203.31@tcp:41:mount.lustre.0 Request processed in 126us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780163.812758:0:17243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 9 00000100:00100000:3.0:1787780163.812791:0:17243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 10 00000100:00100000:3.0:1787780163.812799:0:17243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346cfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e302a01-7f05-4001-b9ff-8e623671b6e0+6:0:x1874622863762176:12345-192.168.203.31@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787780163.812816:0:17243:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787780163.812881:0:17243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346cfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e302a01-7f05-4001-b9ff-8e623671b6e0+6:0:x1874622863762176:12345-192.168.203.31@tcp:41:mount.lustre.0 Request processed in 83us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780163.812898:0:17243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 10 00000100:00100000:3.0:1787780163.812911:0:17243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 11 00000100:00100000:3.0:1787780163.812918:0:17243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04618e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e302a01-7f05-4001-b9ff-8e623671b6e0+6:0:x1874622863761920:12345-192.168.203.31@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787780163.812945:0:17243:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1787780163.812970:0:17243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04618e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e302a01-7f05-4001-b9ff-8e623671b6e0+6:0:x1874622863761920:12345-192.168.203.31@tcp:41:mount.lustre.0 Request processed in 52us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780163.812976:0:17243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 11 00000100:00080000:0.0:1787780163.813815:0:17238:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787780163.813821:0:17238:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787780163.821969:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787780163.822097:0:17243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863762432 00000100:00100000:0.0:1787780163.822108:0:17243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863762432 00000100:00100000:0.0:1787780163.822207:0:17243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 12 00000100:00100000:0.0:1787780163.822220:0:17243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347dafc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e302a01-7f05-4001-b9ff-8e623671b6e0+6:14953:x1874622863762432:12345-192.168.203.31@tcp:40:mount.lustre.0 00000100:00100000:0.0:1787780163.822311:0:17243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347dafc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e302a01-7f05-4001-b9ff-8e623671b6e0+6:14953:x1874622863762432:12345-192.168.203.31@tcp:40:mount.lustre.0 Request processed in 95us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780163.822331:0:17243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 12 00000100:00100000:1.0:1787780163.827163:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787780163.827255:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787780163.827289:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787780163.827369:0:18751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863762560 00000100:00100000:3.0:1787780163.827379:0:18751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863762560 00000100:00100000:3.0:1787780163.827418:0:18751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863762688 00000100:00100000:3.0:1787780163.827422:0:18751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863762688 00000100:00100000:3.0:1787780163.827462:0:18751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 22 00000100:00100000:3.0:1787780163.827469:0:18751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346da7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2407:x1874622863762560:12345-192.168.203.31@tcp:8:mount.lustre.0 00010000:00080000:3.0:1787780163.827507:0:18751:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 6e302a01-7f05-4001-b9ff-8e623671b6e0@192.168.203.31@tcp t0 exp 0000000000000000 cur 571 last 0 00000020:00000080:3.0:1787780163.827535:0:18751:0:(genops.c:1385:class_connect()) connect: client 6e302a01-7f05-4001-b9ff-8e623671b6e0, cookie 0xc8fc0a5179961ca4 00002000:00100000:3.0:1787780163.827557:0:18751:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 6e302a01-7f05-4001-b9ff-8e623671b6e0/ffff9c0341c0b800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113939 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787780163.827574:0:18751:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787780163.827755:0:18751:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787780163.827791:0:18751:0:(import.c:65:import_set_state_nolock()) ffff9c0341c0a800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787780163.827882:0:18751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346da7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e302a01-7f05-4001-b9ff-8e623671b6e0+6:2407:x1874622863762560:12345-192.168.203.31@tcp:8:mount.lustre.0 Request processed in 411us (624us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780163.827890:0:18751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 22 00000100:00100000:3.0:1787780163.827909:0:18751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 23 00000100:00100000:3.0:1787780163.827914:0:18751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346da61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2407:x1874622863762688:12345-192.168.203.31@tcp:8:mount.lustre.0 00010000:00080000:3.0:1787780163.827930:0:18751:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 6e302a01-7f05-4001-b9ff-8e623671b6e0@192.168.203.31@tcp t0 exp 0000000000000000 cur 571 last 0 00000020:00000080:3.0:1787780163.827947:0:18751:0:(genops.c:1385:class_connect()) connect: client 6e302a01-7f05-4001-b9ff-8e623671b6e0, cookie 0xc8fc0a5179961cab 00002000:00100000:3.0:1787780163.827953:0:18751:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 6e302a01-7f05-4001-b9ff-8e623671b6e0/ffff9c0341c0f800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113939 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787780163.827963:0:18751:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787780163.828063:0:18751:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787780163.828078:0:18751:0:(import.c:65:import_set_state_nolock()) ffff9c0341c08000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787780163.828103:0:18751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346da61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e302a01-7f05-4001-b9ff-8e623671b6e0+6:2407:x1874622863762688:12345-192.168.203.31@tcp:8:mount.lustre.0 Request processed in 187us (813us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780163.828110:0:18751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 23 00000100:00100000:2.0:1787780163.831288:0:17254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863762816 00000100:00100000:2.0:1787780163.831302:0:17254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863762816 00000100:00100000:2.0:1787780163.831361:0:17254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 3 00000100:00100000:2.0:1787780163.831370:0:17254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346da6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:6e302a01-7f05-4001-b9ff-8e623671b6e0+6:14953:x1874622863762816:12345-192.168.203.31@tcp:900:mount.lustre.0 00000100:00100000:2.0:1787780163.831457:0:17254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346da6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:6e302a01-7f05-4001-b9ff-8e623671b6e0+6:14953:x1874622863762816:12345-192.168.203.31@tcp:900:mount.lustre.0 Request processed in 88us (4303us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780163.831466:0:17254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 3 00000001:00100000:1.0:1787780163.832224:0:19563:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6e302a01-7f05-4001-b9ff-8e623671b6e0 00000001:00080000:1.0:1787780163.832238:0:19563:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00000100:00100000:1.0:1787780163.841486:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787780163.841836:0:17245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863762944 00000100:00100000:0.0:1787780163.841940:0:17245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863762944 00000100:00100000:1.0:1787780163.842087:0:17245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 0 00000100:00100000:1.0:1787780163.842097:0:17245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346da5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e302a01-7f05-4001-b9ff-8e623671b6e0+6:14953:x1874622863762944:12345-192.168.203.31@tcp:33:mount.lustre.0 00000004:00080000:3.0:1787780163.846026:0:17245:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 3827us 00000004:00200000:0.0:1787780163.863212:0:17245:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1787780163.863493:0:17245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346da5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e302a01-7f05-4001-b9ff-8e623671b6e0+6:14953:x1874622863762944:12345-192.168.203.31@tcp:33:mount.lustre.0 Request processed in 21390us (22011us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780163.863515:0:17245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 0 00000100:00100000:2.0:1787780163.868864:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787780163.868897:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346efe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881684352:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787780163.868960:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787780163.869019:0:18753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881684352 00000100:00100000:2.0:1787780163.869025:0:18753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881684352 00000100:00100000:2.0:1787780163.869079:0:18753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787780163.869088:0:18753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346efed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881684352:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787780163.869120:0:18753:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1787780163.869157:0:18753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346efed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881684352:12345-0@lo:13:osp-pre-1-1.0 Request processed in 70us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780163.869163:0:18753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:2.0:1787780163.869186:0:17238:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787780163.869214:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346efe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881684352:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787780163.869351:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346efe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:3641:1874622881684480:0@lo:400:kworker.0 00000100:00100000:2.0:1787780163.869384:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787780163.869403:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348a0a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874622881684992:0@lo:400:kworker.0 00000100:00100000:2.0:1787780163.869425:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787780163.869442:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c03488e1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1874622881685504:0@lo:400:kworker.0 00000100:00100000:2.0:1787780163.869458:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787780163.869473:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1787780163.869478:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346efda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881684608:0@lo:400:kworker.0 00000100:00100000:2.0:1787780163.869497:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787780163.869511:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348a092c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881685120:0@lo:400:kworker.0 00000100:00100000:2.0:1787780163.869526:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787780163.869556:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047785f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1874622881685632:0@lo:400:kworker.0 00000100:00100000:2.0:1787780163.869574:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787780163.869601:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881684992 00000100:00100000:2.0:1787780163.869605:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881684992 00000100:00100000:2.0:1787780163.869627:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881685504 00000100:00100000:2.0:1787780163.869630:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881685504 00000100:00100000:2.0:1787780163.869648:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881685632 00000100:00100000:2.0:1787780163.869651:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881685632 00000100:00100000:2.0:1787780163.869665:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787780163.869680:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c047785f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874622881684992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787780163.869718:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c047785f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874622881684992:12345-0@lo:400:kworker.0 Request processed in 38us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780163.869723:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787780163.869737:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787780163.869742:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c047785fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874622881685504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787780163.869764:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c047785fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874622881685504:12345-0@lo:400:kworker.0 Request processed in 23us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780163.869769:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787780163.869779:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787780163.869784:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c047785da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1874622881685632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787780163.869806:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c047785da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1874622881685632:12345-0@lo:400:kworker.0 Request processed in 22us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780163.869811:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787780163.869828:0:18276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881684608 00000100:00100000:2.0:1787780163.869831:0:18276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881684608 00000100:00100000:2.0:1787780163.869872:0:18276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881685120 00000100:00100000:2.0:1787780163.869876:0:18276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881685120 00000100:00100000:2.0:1787780163.869888:0:18276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787780163.869893:0:18276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c047785d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1874622881684608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787780163.869922:0:18276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c047785d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1874622881684608:12345-0@lo:400:kworker.0 Request processed in 29us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780163.869928:0:18276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787780163.869939:0:18276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787780163.869944:0:18276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c047785e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881685120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787780163.869969:0:18276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c047785e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881685120:12345-0@lo:400:kworker.0 Request processed in 26us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780163.869982:0:18276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:2.0:1787780163.870001:0:17238:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787780163.870004:0:17238:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787780163.870012:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348a08780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881684736:0@lo:400:kworker.0 00000100:00100000:2.0:1787780163.870042:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787780163.870061:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c03488e12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881685248:0@lo:400:kworker.0 00000100:00100000:2.0:1787780163.870080:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787780163.870097:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047785e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1874622881685760:0@lo:400:kworker.0 00000100:00100000:2.0:1787780163.870121:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787780163.870138:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1787780163.870143:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0348a09a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881684864:0@lo:400:kworker.0 00000100:00100000:2.0:1787780163.870162:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787780163.870185:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c03488e30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874622881685376:0@lo:400:kworker.0 00000100:00100000:2.0:1787780163.870202:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787780163.870216:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047785de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1874622881685888:0@lo:400:kworker.0 00000100:00100000:2.0:1787780163.870235:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787780163.870254:0:18750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881684736 00000100:00100000:2.0:1787780163.870257:0:18750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881684736 00000100:00100000:2.0:1787780163.870285:0:18750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881685248 00000100:00100000:2.0:1787780163.870287:0:18750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881685248 00000100:00100000:2.0:1787780163.870300:0:18750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881684864 00000100:00100000:2.0:1787780163.870302:0:18750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881684864 00000100:00100000:2.0:1787780163.870314:0:18750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787780163.870319:0:18750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c047785ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881684736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787780163.870352:0:18750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c047785ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881684736:12345-0@lo:400:kworker.0 Request processed in 33us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780163.870367:0:18750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787780163.870382:0:18750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787780163.870388:0:18750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c047785d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881685248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787780163.870416:0:18750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c047785d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881685248:12345-0@lo:400:kworker.0 Request processed in 28us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780163.870422:0:18750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787780163.870432:0:18750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787780163.870438:0:18750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046215de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881684864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787780163.870465:0:18750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046215de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881684864:12345-0@lo:400:kworker.0 Request processed in 26us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780163.870470:0:18750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787780163.870486:0:19793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881685760 00000100:00100000:2.0:1787780163.870489:0:19793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881685760 00000100:00100000:2.0:1787780163.870505:0:19793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881685376 00000100:00100000:2.0:1787780163.870507:0:19793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881685376 00000100:00100000:2.0:1787780163.870515:0:19793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881685888 00000100:00100000:2.0:1787780163.870518:0:19793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881685888 00000100:00100000:2.0:1787780163.870529:0:19793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787780163.870534:0:19793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046215fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1874622881685760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787780163.870595:0:19793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046215fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1874622881685760:12345-0@lo:400:kworker.0 Request processed in 60us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780163.870600:0:19793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787780163.870613:0:19793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787780163.870619:0:19793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046215f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1874622881685376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787780163.870643:0:19793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046215f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1874622881685376:12345-0@lo:400:kworker.0 Request processed in 25us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780163.870658:0:19793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787780163.870670:0:19793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787780163.870677:0:19793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046215f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1874622881685888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787780163.870705:0:19793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046215f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1874622881685888:12345-0@lo:400:kworker.0 Request processed in 29us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780163.870710:0:19793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:2.0:1787780163.870724:0:17238:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787780163.870726:0:17238:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787780163.870728:0:17238:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787780163.870730:0:17238:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787780163.870754:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346efda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881684608:0@lo:400:kworker.0 00000100:00100000:2.0:1787780163.870765:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348a092c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881685120:0@lo:400:kworker.0 00010000:00080000:2.0:1787780163.870777:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c047785f0c0 x1874622881685632/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787780179 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787780163.870787:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047785f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1874622881685632:0@lo:400:kworker.0 00010000:00080000:2.0:1787780163.870797:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0348a0a580 x1874622881684992/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787780179 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787780163.870806:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348a0a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874622881684992:0@lo:400:kworker.0 00010000:00080000:2.0:1787780163.870817:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c03488e1a40 x1874622881685504/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787780179 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787780163.870828:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c03488e1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1874622881685504:0@lo:400:kworker.0 00000100:00100000:2.0:1787780163.870883:0:3643:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:2.0:1787780163.870893:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348a09a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881684864:0@lo:400:kworker.0 00010000:00080000:2.0:1787780163.870913:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c03488e30c0 x1874622881685376/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787780179 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787780163.870920:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c03488e30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874622881685376:0@lo:400:kworker.0 00010000:00080000:2.0:1787780163.870927:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c047785de00 x1874622881685888/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787780179 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787780163.870934:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047785de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1874622881685888:0@lo:400:kworker.0 00000100:00100000:2.0:1787780163.870942:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0348a08780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881684736:0@lo:400:kworker.0 00000100:00100000:2.0:1787780163.870949:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c03488e12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881685248:0@lo:400:kworker.0 00010000:00080000:2.0:1787780163.870956:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c047785e1c0 x1874622881685760/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787780179 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787780163.870965:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047785e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1874622881685760:0@lo:400:kworker.0 00000100:00100000:0.0:1787780163.871758:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787780163.871784:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04618ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881686016:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787780163.871870:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787780163.871927:0:18753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881686016 00000100:00100000:0.0:1787780163.871933:0:18753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881686016 00000100:00100000:0.0:1787780163.871970:0:18753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787780163.871979:0:18753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04618eb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1874622881686016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787780163.871997:0:18753:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1787780163.872042:0:18753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04618eb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1874622881686016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780163.872049:0:18753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787780163.872105:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04618ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881686016:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787780163.872139:0:17237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881684480 00000100:00100000:0.0:1787780163.872143:0:17237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881684480 00000100:00100000:0.0:1787780163.872171:0:17237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1787780163.872177:0:17237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c044502c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+24:3641:x1874622881684480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787780163.872210:0:17237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c044502c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+24:3641:x1874622881684480:12345-0@lo:400:kworker.0 Request processed in 33us (2826us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780163.872217:0:17237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1787780163.874331:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346efe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:3641:1874622881684480:0@lo:400:kworker.0 00010000:00010000:1.0:1787780163.932592:0:18397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787780164.066721:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787780164.066909:0:19793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863763072 00000100:00100000:2.0:1787780164.066923:0:19793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863763072 00000100:00100000:2.0:1787780164.067008:0:19793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 13 00000100:00100000:2.0:1787780164.067017:0:19793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347dac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e302a01-7f05-4001-b9ff-8e623671b6e0+6:15001:x1874622863763072:12345-192.168.203.31@tcp:101:mkdir.0 00010000:00010000:2.0:1787780164.067036:0:19793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787780164.067061:0:19793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71000/0xc8fc0a5179961cb2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea21ff expref: -99 pid: 19793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780164.067125:0:19793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70800/0xc8fc0a5179961cb9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780164.067158:0:19793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70800/0xc8fc0a5179961cb9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780164.067172:0:19793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70800/0xc8fc0a5179961cb9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787780164.067228:0:19793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787780164.067691:0:19793:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787780164.067901:0:19793:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70800/0xc8fc0a5179961cb9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780164.067933:0:19793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71000/0xc8fc0a5179961cb2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea21ff expref: 8 pid: 19793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780164.067951:0:19793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70800/0xc8fc0a5179961cb9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea21ff expref: 7 pid: 19793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780164.067961:0:19793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c0347a4e300) 00010000:00010000:2.0:1787780164.067964:0:19793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787780164.067967:0:19793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0477a70800, rc 0) 00000100:00100000:2.0:1787780164.068092:0:19793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347dac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e302a01-7f05-4001-b9ff-8e623671b6e0+7:15001:x1874622863763072:12345-192.168.203.31@tcp:101:mkdir.0 Request processed in 1074us (1385us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780164.068100:0:19793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 13 00000100:00100000:3.0:1787780164.381872:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787780164.381897:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04618ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881686144:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787780164.381961:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787780164.382188:0:18753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881686144 00000100:00100000:0.0:1787780164.382196:0:18753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881686144 00000100:00100000:0.0:1787780164.382246:0:18753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787780164.382255:0:18753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347dac3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874622881686144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787780164.382277:0:18753:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1787780164.382326:0:18753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347dac3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874622881686144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780164.382334:0:18753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787780164.382409:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04618ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881686144:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787780164.956451:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787780165.277044:0:17278:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787780165.404176:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346da7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881686272:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787780165.404253:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787780165.404867:0:18753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881686272 00000100:00100000:0.0:1787780165.404876:0:18753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881686272 00000100:00080000:2.0:1787780165.404995:0:17238:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787780165.405210:0:18753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787780165.405222:0:18753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046215e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881686272:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787780165.405252:0:18753:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1787780165.405314:0:18753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046215e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881686272:12345-0@lo:13:osp-pre-0-1.0 Request processed in 96us (1061us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780165.405321:0:18753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787780165.405394:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346da7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881686272:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1787780165.981541:0:17231:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787780166.181551:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787780166.181660:0:17242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863763200 00000100:00100000:2.0:1787780166.181669:0:17242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863763200 00000100:00100000:2.0:1787780166.181756:0:17242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 14 00000100:00100000:2.0:1787780166.181777:0:17242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346da6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e302a01-7f05-4001-b9ff-8e623671b6e0+7:15053:x1874622863763200:12345-192.168.203.31@tcp:41:lfs.0 00000004:00000024:2.0:1787780166.181815:0:17242:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1787780166.181940:0:17242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346da6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e302a01-7f05-4001-b9ff-8e623671b6e0+7:15053:x1874622863763200:12345-192.168.203.31@tcp:41:lfs.0 Request processed in 174us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780166.181948:0:17242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 14 00000100:00080000:0.0:1787780166.182076:0:17238:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787780166.185941:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787780166.186044:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863763328 00000100:00100000:0.0:1787780166.186053:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863763328 00000100:00100000:0.0:1787780166.186128:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 15 00000100:00100000:0.0:1787780166.186139:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346da52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e302a01-7f05-4001-b9ff-8e623671b6e0+6:15053:x1874622863763328:12345-192.168.203.31@tcp:41:lfs.0 00000004:00000024:0.0:1787780166.186176:0:17244:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787780166.186278:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346da52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e302a01-7f05-4001-b9ff-8e623671b6e0+6:15053:x1874622863763328:12345-192.168.203.31@tcp:41:lfs.0 Request processed in 141us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780166.186285:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 15 00000100:00080000:2.0:1787780166.188351:0:17238:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787780166.191089:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787780166.191277:0:18752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863763456 00000100:00100000:1.0:1787780166.191285:0:18752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863763456 00000100:00100000:1.0:1787780166.191349:0:18752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 13 00000100:00100000:1.0:1787780166.191359:0:18752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347dad2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6e302a01-7f05-4001-b9ff-8e623671b6e0+6:15053:x1874622863763456:12345-192.168.203.31@tcp:13:lfs.0 00002000:00000024:1.0:1787780166.191383:0:18752:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1787780166.191461:0:18752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347dad2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6e302a01-7f05-4001-b9ff-8e623671b6e0+6:15053:x1874622863763456:12345-192.168.203.31@tcp:13:lfs.0 Request processed in 103us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780166.191469:0:18752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 13 00000100:00080000:2.0:1787780166.191542:0:17238:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787780166.195445:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787780166.196883:0:18752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863763584 00000100:00100000:1.0:1787780166.196895:0:18752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863763584 00000100:00100000:1.0:1787780166.196978:0:18752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 14 00000100:00100000:1.0:1787780166.196989:0:18752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347dacb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6e302a01-7f05-4001-b9ff-8e623671b6e0+5:15053:x1874622863763584:12345-192.168.203.31@tcp:13:lfs.0 00002000:00000024:1.0:1787780166.197034:0:18752:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1787780166.197129:0:18752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347dacb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6e302a01-7f05-4001-b9ff-8e623671b6e0+5:15053:x1874622863763584:12345-192.168.203.31@tcp:13:lfs.0 Request processed in 142us (1693us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780166.197137:0:18752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 14 00000100:00080000:2.0:1787780166.197631:0:17238:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787780166.390020:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787780166.390158:0:17236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863763712 00000100:00100000:2.0:1787780166.390167:0:17236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863763712 00000100:00100000:2.0:1787780166.390227:0:17236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 131 00000100:00100000:2.0:1787780166.390238:0:17236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c044502f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6cfa51b-ab50-4fc0-ae19-b724d7d272e4+10:15085:x1874622863763712:12345-192.168.203.31@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787780166.390255:0:17236:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787780166.390271:0:17236:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0477a71000/0xc8fc0a5179961cc0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xf757128131ea2206 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780166.390299:0:17236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0477a71000/0xc8fc0a5179961cc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea2206 expref: 11 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780166.390311:0:17236:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0477a71000/0xc8fc0a5179961cc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea2206 expref: 11 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780166.390320:0:17236:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0477a71000, rc 0) 00000100:00100000:2.0:1787780166.390376:0:17236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c044502f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6cfa51b-ab50-4fc0-ae19-b724d7d272e4+11:15085:x1874622863763712:12345-192.168.203.31@tcp:101:mount.lustre.0 Request processed in 140us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780166.390401:0:17236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 131 00000100:00100000:3.0:1787780166.398120:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787780166.398294:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863763840 00000100:00100000:0.0:1787780166.398305:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863763840 00000100:00100000:0.0:1787780166.398360:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 132 00000100:00100000:0.0:1787780166.398369:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c044502d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6cfa51b-ab50-4fc0-ae19-b724d7d272e4+11:15085:x1874622863763840:12345-192.168.203.31@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787780166.398545:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c044502d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6cfa51b-ab50-4fc0-ae19-b724d7d272e4+11:15085:x1874622863763840:12345-192.168.203.31@tcp:501:mount.lustre.0 Request processed in 175us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780166.398553:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 132 00000100:00100000:3.0:1787780166.407688:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787780166.408008:0:17237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863763968 00000100:00100000:0.0:1787780166.408018:0:17237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863763968 00000100:00100000:0.0:1787780166.408078:0:17237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 133 00000100:00100000:0.0:1787780166.408089:0:17237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c044502d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6cfa51b-ab50-4fc0-ae19-b724d7d272e4+11:15085:x1874622863763968:12345-192.168.203.31@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787780166.408230:0:17237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c044502d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6cfa51b-ab50-4fc0-ae19-b724d7d272e4+11:15085:x1874622863763968:12345-192.168.203.31@tcp:503:mount.lustre.0 Request processed in 143us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780166.408239:0:17237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 133 00000100:00100000:1.0:1787780166.428741:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787780166.429010:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787780166.429030:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04618ea1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881686528:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787780166.429096:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787780166.429155:0:18276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881686528 00000100:00100000:0.0:1787780166.429162:0:18276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881686528 00000100:00100000:0.0:1787780166.429206:0:18276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787780166.429215:0:18276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04618e9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1874622881686528:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787780166.429240:0:18276:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787780166.429285:0:18276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04618e9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1874622881686528:12345-0@lo:41:osp-pre-1-0.0 Request processed in 71us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780166.429292:0:18276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787780166.429336:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04618ea1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881686528:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787780166.432679:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477840780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881686400:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787780166.432753:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787780166.432938:0:17248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881686400 00000100:00100000:2.0:1787780166.432947:0:17248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881686400 00000100:00100000:2.0:1787780166.432990:0:17248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787780166.432999:0:17248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346da7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881686400:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787780166.433026:0:17248:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1787780166.433079:0:17248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346da7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881686400:12345-0@lo:41:osp-pre-0-1.0 Request processed in 81us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780166.433086:0:17248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787780166.433207:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477840780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881686400:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787780166.435045:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787780166.435230:0:17236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863764096 00000100:00100000:2.0:1787780166.435237:0:17236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863764096 00000100:00100000:2.0:1787780166.435290:0:17236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 134 00000100:00100000:2.0:1787780166.435300:0:17236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c044502e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6cfa51b-ab50-4fc0-ae19-b724d7d272e4+11:15092:x1874622863764096:12345-192.168.203.31@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787780166.435442:0:17236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c044502e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6cfa51b-ab50-4fc0-ae19-b724d7d272e4+11:15092:x1874622863764096:12345-192.168.203.31@tcp:502:llog_process_th.0 Request processed in 131us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780166.435450:0:17236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 134 00000100:00100000:3.0:1787780166.494280:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787780166.494479:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863764224 00000100:00100000:1.0:1787780166.494489:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863764224 00000100:00100000:1.0:1787780166.494566:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 135 00000100:00100000:1.0:1787780166.494576:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0478633850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6cfa51b-ab50-4fc0-ae19-b724d7d272e4+11:15092:x1874622863764224:12345-192.168.203.31@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787780166.494720:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0478633850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6cfa51b-ab50-4fc0-ae19-b724d7d272e4+11:15092:x1874622863764224:12345-192.168.203.31@tcp:502:llog_process_th.0 Request processed in 145us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780166.494728:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 135 00000100:00100000:3.0:1787780166.501952:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787780166.502209:0:17237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863764352 00000100:00100000:0.0:1787780166.502218:0:17237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863764352 00000100:00100000:0.0:1787780166.502277:0:17237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 136 00000100:00100000:0.0:1787780166.502288:0:17237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0478632c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6cfa51b-ab50-4fc0-ae19-b724d7d272e4+11:15092:x1874622863764352:12345-192.168.203.31@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787780166.502434:0:17237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0478632c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6cfa51b-ab50-4fc0-ae19-b724d7d272e4+11:15092:x1874622863764352:12345-192.168.203.31@tcp:502:llog_process_th.0 Request processed in 147us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780166.502442:0:17237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 136 00000100:00100000:3.0:1787780166.519610:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787780166.519715:0:17236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863764480 00000100:00100000:2.0:1787780166.519724:0:17236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863764480 00000100:00100000:2.0:1787780166.519788:0:17236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 137 00000100:00100000:2.0:1787780166.519799:0:17236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0478633c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6cfa51b-ab50-4fc0-ae19-b724d7d272e4+11:15085:x1874622863764480:12345-192.168.203.31@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787780166.519817:0:17236:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787780166.519834:0:17236:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0477a70400/0xc8fc0a5179961cc7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf757128131ea2237 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780166.519895:0:17236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0477a70400/0xc8fc0a5179961cc7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea2237 expref: 12 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780166.519922:0:17236:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0477a70400/0xc8fc0a5179961cc7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea2237 expref: 12 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780166.519946:0:17236:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0477a70400, rc 0) 00000100:00100000:2.0:1787780166.520004:0:17236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0478633c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6cfa51b-ab50-4fc0-ae19-b724d7d272e4+12:15085:x1874622863764480:12345-192.168.203.31@tcp:101:mount.lustre.0 Request processed in 206us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780166.520011:0:17236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 137 00000100:00100000:3.0:1787780166.524544:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787780166.524640:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863764608 00000100:00100000:1.0:1787780166.524649:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863764608 00000100:00100000:1.0:1787780166.524704:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 138 00000100:00100000:1.0:1787780166.524724:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0478632850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6cfa51b-ab50-4fc0-ae19-b724d7d272e4+12:15085:x1874622863764608:12345-192.168.203.31@tcp:256:mount.lustre.0 20000000:01000000:1.0:1787780166.524750:0:17234:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1787780166.524785:0:17234:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1787780166.524791:0:17234:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1787780166.524794:0:17234:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1787780166.524797:0:17234:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1787780166.524799:0:17234:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:1.0:1787780166.530751:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0478632850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6cfa51b-ab50-4fc0-ae19-b724d7d272e4+12:15085:x1874622863764608:12345-192.168.203.31@tcp:256:mount.lustre.0 Request processed in 6019us (6208us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780166.531420:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 138 00000100:00100000:3.0:1787780166.533674:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787780166.533771:0:17237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863764736 00000100:00100000:0.0:1787780166.533781:0:17237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863764736 00000100:00100000:0.0:1787780166.533833:0:17237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 139 00000100:00100000:0.0:1787780166.533866:0:17237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0478633450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6cfa51b-ab50-4fc0-ae19-b724d7d272e4+12:15085:x1874622863764736:12345-192.168.203.31@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787780166.533896:0:17237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787780166.533916:0:17237:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0348c7b200/0xc8fc0a5179961cce lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xf757128131ea223e expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780166.533958:0:17237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0348c7b200/0xc8fc0a5179961cce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea223e expref: 13 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780166.533969:0:17237:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0348c7b200/0xc8fc0a5179961cce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea223e expref: 13 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780166.533979:0:17237:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0348c7b200, rc 0) 00000100:00100000:0.0:1787780166.534033:0:17237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0478633450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6cfa51b-ab50-4fc0-ae19-b724d7d272e4+13:15085:x1874622863764736:12345-192.168.203.31@tcp:101:mount.lustre.0 Request processed in 169us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780166.534041:0:17237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 139 00000100:00100000:3.0:1787780166.539470:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787780166.539573:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863764864 00000100:00100000:1.0:1787780166.539583:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863764864 00000100:00100000:1.0:1787780166.539639:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 140 00000100:00100000:1.0:1787780166.539649:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0478630850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6cfa51b-ab50-4fc0-ae19-b724d7d272e4+13:15085:x1874622863764864:12345-192.168.203.31@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787780166.539995:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0478630850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6cfa51b-ab50-4fc0-ae19-b724d7d272e4+13:15085:x1874622863764864:12345-192.168.203.31@tcp:501:mount.lustre.0 Request processed in 346us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780166.540004:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 140 00000100:00100000:3.0:1787780166.542423:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787780166.542508:0:17236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863764992 00000100:00100000:2.0:1787780166.542525:0:17236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863764992 00000100:00100000:2.0:1787780166.542579:0:17236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 141 00000100:00100000:2.0:1787780166.542590:0:17236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0478633050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6cfa51b-ab50-4fc0-ae19-b724d7d272e4+13:15085:x1874622863764992:12345-192.168.203.31@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787780166.542719:0:17236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0478633050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6cfa51b-ab50-4fc0-ae19-b724d7d272e4+13:15085:x1874622863764992:12345-192.168.203.31@tcp:503:mount.lustre.0 Request processed in 130us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780166.542727:0:17236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 141 00000100:00100000:3.0:1787780166.545471:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787780166.545925:0:17237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863765120 00000100:00100000:0.0:1787780166.546129:0:17237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863765120 00000100:00100000:0.0:1787780166.546204:0:17237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 142 00000100:00100000:0.0:1787780166.546213:0:17237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0478631050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6cfa51b-ab50-4fc0-ae19-b724d7d272e4+13:15098:x1874622863765120:12345-192.168.203.31@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787780166.546397:0:17237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0478631050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6cfa51b-ab50-4fc0-ae19-b724d7d272e4+13:15098:x1874622863765120:12345-192.168.203.31@tcp:502:llog_process_th.0 Request processed in 185us (936us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780166.546406:0:17237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 142 00000100:00100000:3.0:1787780166.563435:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787780166.563590:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863765248 00000100:00100000:1.0:1787780166.563615:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863765248 00000100:00100000:1.0:1787780166.563674:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 143 00000100:00100000:1.0:1787780166.563684:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0478631850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6cfa51b-ab50-4fc0-ae19-b724d7d272e4+13:15098:x1874622863765248:12345-192.168.203.31@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787780166.563872:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0478631850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6cfa51b-ab50-4fc0-ae19-b724d7d272e4+13:15098:x1874622863765248:12345-192.168.203.31@tcp:502:llog_process_th.0 Request processed in 154us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780166.563882:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 143 00000100:00100000:3.0:1787780166.594607:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787780166.594647:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787780166.594681:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787780166.594718:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787780166.594734:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787780166.594776:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787780166.594909:0:17242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863765376 00000100:00100000:2.0:1787780166.594917:0:17242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863765376 00000100:00100000:2.0:1787780166.594946:0:17242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863765504 00000100:00100000:2.0:1787780166.594949:0:17242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863765504 00000100:00100000:2.0:1787780166.594971:0:17242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863765632 00000100:00100000:2.0:1787780166.594974:0:17242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863765632 00000100:00100000:2.0:1787780166.594986:0:17242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863766144 00000100:00100000:2.0:1787780166.594988:0:17242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863766144 00000100:00100000:2.0:1787780166.595000:0:17242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 36 00000100:00100000:2.0:1787780166.595009:0:17242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477842580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e302a01-7f05-4001-b9ff-8e623671b6e0+7:2410:x1874622863765504:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1787780166.595091:0:17242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477842580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e302a01-7f05-4001-b9ff-8e623671b6e0+7:2410:x1874622863765504:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 83us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780166.595108:0:17242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 36 00000100:00100000:2.0:1787780166.595123:0:17242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 37 00000100:00100000:2.0:1787780166.595127:0:17242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477842940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e302a01-7f05-4001-b9ff-8e623671b6e0+6:2410:x1874622863765632:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1787780166.595146:0:17242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477842940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e302a01-7f05-4001-b9ff-8e623671b6e0+6:2410:x1874622863765632:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 19us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780166.595149:0:17242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 37 00000100:00100000:2.0:1787780166.595155:0:17242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 16 00000100:00100000:2.0:1787780166.595158:0:17242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477841e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2407:x1874622863765376:12345-192.168.203.31@tcp:38:mount.lustre.0 00010000:00080000:2.0:1787780166.595174:0:17242:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from eeb4a73f-1001-4fdb-898b-e22b5d3f1459@192.168.203.31@tcp t0 exp 0000000000000000 cur 574 last 0 00000020:00000080:2.0:1787780166.595198:0:17242:0:(genops.c:1385:class_connect()) connect: client eeb4a73f-1001-4fdb-898b-e22b5d3f1459, cookie 0xc8fc0a5179961cd5 00000004:00100000:2.0:1787780166.595218:0:17242:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1787780166.595283:0:17242:0:(import.c:65:import_set_state_nolock()) ffff9c0348819800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787780166.595303:0:17242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477841e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eeb4a73f-1001-4fdb-898b-e22b5d3f1459+6:2407:x1874622863765376:12345-192.168.203.31@tcp:38:mount.lustre.0 Request processed in 144us (718us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780166.595307:0:17242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 16 00000100:00100000:2.0:1787780166.595316:0:17242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 17 00000100:00100000:2.0:1787780166.595318:0:17242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477841680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2407:x1874622863766144:12345-192.168.203.31@tcp:38:mount.lustre.0 00010000:00080000:2.0:1787780166.595328:0:17242:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from eeb4a73f-1001-4fdb-898b-e22b5d3f1459@192.168.203.31@tcp t0 exp 0000000000000000 cur 574 last 0 00000020:00000080:2.0:1787780166.595341:0:17242:0:(genops.c:1385:class_connect()) connect: client eeb4a73f-1001-4fdb-898b-e22b5d3f1459, cookie 0xc8fc0a5179961cdc 00000004:00100000:2.0:1787780166.595349:0:17242:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1787780166.595377:0:17242:0:(import.c:65:import_set_state_nolock()) ffff9c034881a000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787780166.595391:0:17242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477841680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eeb4a73f-1001-4fdb-898b-e22b5d3f1459+6:2407:x1874622863766144:12345-192.168.203.31@tcp:38:mount.lustre.0 Request processed in 72us (616us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780166.595402:0:17242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 17 00000100:00100000:2.0:1787780166.595419:0:18751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863765760 00000100:00100000:2.0:1787780166.595422:0:18751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863765760 00000100:00100000:2.0:1787780166.595450:0:18751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863765888 00000100:00100000:2.0:1787780166.595452:0:18751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863765888 00000100:00100000:2.0:1787780166.595463:0:18751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 9 00000100:00100000:2.0:1787780166.595466:0:18751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477841a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e302a01-7f05-4001-b9ff-8e623671b6e0+6:2410:x1874622863765760:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1787780166.595484:0:18751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477841a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e302a01-7f05-4001-b9ff-8e623671b6e0+6:2410:x1874622863765760:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 18us (805us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780166.595487:0:18751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 9 00000100:00100000:2.0:1787780166.595494:0:18751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 10 00000100:00100000:2.0:1787780166.595497:0:18751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477843840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e302a01-7f05-4001-b9ff-8e623671b6e0+5:2410:x1874622863765888:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1787780166.595508:0:18751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477843840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e302a01-7f05-4001-b9ff-8e623671b6e0+5:2410:x1874622863765888:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 11us (774us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780166.595511:0:18751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 10 00000100:00100000:3.0:1787780166.605063:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787780166.605206:0:17242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863766272 00000100:00100000:2.0:1787780166.605216:0:17242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863766272 00000100:00100000:2.0:1787780166.605295:0:17242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 18 00000100:00100000:2.0:1787780166.605304:0:17242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477843c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eeb4a73f-1001-4fdb-898b-e22b5d3f1459+6:0:x1874622863766272:12345-192.168.203.31@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787780166.605336:0:17242:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1787780166.605436:0:17242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477843c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eeb4a73f-1001-4fdb-898b-e22b5d3f1459+6:0:x1874622863766272:12345-192.168.203.31@tcp:41:mount.lustre.0 Request processed in 125us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780166.605444:0:17242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 18 00000100:00080000:0.0:1787780166.605621:0:17238:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787780166.612563:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787780166.612637:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787780166.612810:0:17243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863766016 00000100:00100000:0.0:1787780166.612823:0:17243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863766016 00000100:00100000:0.0:1787780166.613179:0:17243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863766400 00000100:00100000:0.0:1787780166.613184:0:17243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863766400 00000100:00100000:0.0:1787780166.613209:0:17243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 19 00000100:00100000:0.0:1787780166.613219:0:17243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04778421c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eeb4a73f-1001-4fdb-898b-e22b5d3f1459+7:0:x1874622863766016:12345-192.168.203.31@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787780166.613259:0:17243:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1787780166.613453:0:19793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 20 00000100:00100000:1.0:1787780166.613465:0:19793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477840f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eeb4a73f-1001-4fdb-898b-e22b5d3f1459+7:15085:x1874622863766400:12345-192.168.203.31@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787780166.613479:0:19793:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1787780166.613536:0:19793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477840f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eeb4a73f-1001-4fdb-898b-e22b5d3f1459+7:15085:x1874622863766400:12345-192.168.203.31@tcp:41:mount.lustre.0 Request processed in 74us (899us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780166.613544:0:19793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 20 00000100:00100000:0.0:1787780166.614401:0:17243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04778421c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eeb4a73f-1001-4fdb-898b-e22b5d3f1459+6:0:x1874622863766016:12345-192.168.203.31@tcp:41:mount.lustre.0 Request processed in 758us (1428us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780166.614416:0:17243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 19 00000100:00080000:2.0:1787780166.615656:0:17238:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787780166.617659:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787780166.617802:0:19793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863766528 00000100:00100000:2.0:1787780166.617832:0:19793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863766528 00000100:00100000:2.0:1787780166.617942:0:19793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 21 00000100:00100000:2.0:1787780166.617955:0:19793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0458b89680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eeb4a73f-1001-4fdb-898b-e22b5d3f1459+6:15085:x1874622863766528:12345-192.168.203.31@tcp:40:mount.lustre.0 00000100:00100000:2.0:1787780166.618083:0:19793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0458b89680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eeb4a73f-1001-4fdb-898b-e22b5d3f1459+6:15085:x1874622863766528:12345-192.168.203.31@tcp:40:mount.lustre.0 Request processed in 131us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780166.618092:0:19793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 21 00000100:00100000:1.0:1787780166.620624:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787780166.620666:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787780166.620707:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787780166.620813:0:19055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863766656 00000100:00100000:0.0:1787780166.620825:0:19055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863766656 00000100:00100000:0.0:1787780166.620903:0:19055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863766784 00000100:00100000:0.0:1787780166.620906:0:19055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863766784 00000100:00100000:0.0:1787780166.620928:0:19055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 24 00000100:00100000:0.0:1787780166.620937:0:19055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347fab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2407:x1874622863766656:12345-192.168.203.31@tcp:8:mount.lustre.0 00010000:00080000:0.0:1787780166.621039:0:19055:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from eeb4a73f-1001-4fdb-898b-e22b5d3f1459@192.168.203.31@tcp t0 exp 0000000000000000 cur 574 last 0 00000020:00000080:0.0:1787780166.621084:0:19055:0:(genops.c:1385:class_connect()) connect: client eeb4a73f-1001-4fdb-898b-e22b5d3f1459, cookie 0xc8fc0a5179961ce3 00002000:00100000:0.0:1787780166.621100:0:19055:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli eeb4a73f-1001-4fdb-898b-e22b5d3f1459/ffff9c0345e35800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113939 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787780166.621114:0:19055:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787780166.621235:0:19055:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787780166.621273:0:19055:0:(import.c:65:import_set_state_nolock()) ffff9c0345e37000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787780166.621563:0:18748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 25 00000100:00100000:1.0:1787780166.621571:0:18748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347faa580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2407:x1874622863766784:12345-192.168.203.31@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787780166.621592:0:18748:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from eeb4a73f-1001-4fdb-898b-e22b5d3f1459@192.168.203.31@tcp t0 exp 0000000000000000 cur 574 last 0 00000020:00000080:1.0:1787780166.621613:0:18748:0:(genops.c:1385:class_connect()) connect: client eeb4a73f-1001-4fdb-898b-e22b5d3f1459, cookie 0xc8fc0a5179961cea 00002000:00100000:1.0:1787780166.621619:0:18748:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli eeb4a73f-1001-4fdb-898b-e22b5d3f1459/ffff9c03412d6000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113939 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787780166.621626:0:18748:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787780166.621690:0:18748:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00100000:3.0:1787780166.622115:0:17254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863766912 00000100:00100000:3.0:1787780166.622123:0:17254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863766912 00000100:00100000:3.0:1787780166.622173:0:17254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 4 00000100:00100000:3.0:1787780166.622180:0:17254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347faad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:eeb4a73f-1001-4fdb-898b-e22b5d3f1459+6:15085:x1874622863766912:12345-192.168.203.31@tcp:900:mount.lustre.0 00000100:00100000:0.0:1787780166.622284:0:19055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347fab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eeb4a73f-1001-4fdb-898b-e22b5d3f1459+6:2407:x1874622863766656:12345-192.168.203.31@tcp:8:mount.lustre.0 Request processed in 1345us (1670us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780166.622294:0:19055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 24 00000100:00080000:1.0:1787780166.624963:0:18748:0:(import.c:65:import_set_state_nolock()) ffff9c03412d3000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787780166.625106:0:18748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347faa580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eeb4a73f-1001-4fdb-898b-e22b5d3f1459+6:2407:x1874622863766784:12345-192.168.203.31@tcp:8:mount.lustre.0 Request processed in 3528us (4392us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780166.625119:0:18748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 25 00000100:00100000:3.0:1787780166.627437:0:17254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347faad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:eeb4a73f-1001-4fdb-898b-e22b5d3f1459+6:15085:x1874622863766912:12345-192.168.203.31@tcp:900:mount.lustre.0 Request processed in 5240us (6753us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780166.627455:0:17254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 4 00000100:00100000:3.0:1787780166.636092:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787780166.636232:0:17246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863767040 00000100:00100000:1.0:1787780166.636245:0:17246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863767040 00000100:00100000:1.0:1787780166.636308:0:17246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 1 00000100:00100000:1.0:1787780166.636319:0:17246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477843480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:eeb4a73f-1001-4fdb-898b-e22b5d3f1459+6:15085:x1874622863767040:12345-192.168.203.31@tcp:33:mount.lustre.0 00000004:00200000:1.0:1787780166.636448:0:17246:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1787780166.636562:0:17246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477843480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:eeb4a73f-1001-4fdb-898b-e22b5d3f1459+6:15085:x1874622863767040:12345-192.168.203.31@tcp:33:mount.lustre.0 Request processed in 244us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780166.636570:0:17246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 1 00000100:00100000:0.0:1787780166.779244:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787780166.779417:0:17242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863767168 00000100:00100000:3.0:1787780166.779430:0:17242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863767168 00000100:00100000:3.0:1787780166.779550:0:17242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 22 00000100:00100000:3.0:1787780166.779562:0:17242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04618ea1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eeb4a73f-1001-4fdb-898b-e22b5d3f1459+6:15121:x1874622863767168:12345-192.168.203.31@tcp:101:mkdir.0 00010000:00010000:3.0:1787780166.779592:0:17242:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787780166.779623:0:17242:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0440031200/0xc8fc0a5179961cf1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea226f expref: -99 pid: 17242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780166.779712:0:17242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0440030400/0xc8fc0a5179961cf8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780166.779727:0:17242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0440030400/0xc8fc0a5179961cf8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780166.779743:0:17242:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0440030400/0xc8fc0a5179961cf8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787780166.779821:0:17242:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787780166.779825:0:17242:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787780166.779891:0:17242:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c0440030400/0xc8fc0a5179961cf8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780166.779955:0:17242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0440031200/0xc8fc0a5179961cf1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea226f expref: 8 pid: 17242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780166.779977:0:17242:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0440030400/0xc8fc0a5179961cf8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea226f expref: 7 pid: 17242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780166.779986:0:17242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c0347a4e300) 00010000:00010000:3.0:1787780166.779989:0:17242:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787780166.779993:0:17242:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0440030400, rc 0) 00000100:00100000:3.0:1787780166.780265:0:17242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04618ea1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eeb4a73f-1001-4fdb-898b-e22b5d3f1459+7:15121:x1874622863767168:12345-192.168.203.31@tcp:101:mkdir.0 Request processed in 704us (1035us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780166.780275:0:17242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 22 00010000:00010000:1.0:1787780167.004740:0:18397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787780167.388750:0:17994:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787780168.029368:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787780168.988130:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787780168.988155:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04618e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881686656:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787780168.988226:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780168.988381:0:18752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881686656 00000100:00100000:1.0:1787780168.988389:0:18752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881686656 00000100:00100000:1.0:1787780168.988464:0:18752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787780168.988475:0:18752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477840000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874622881686656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787780168.988515:0:18752:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1787780168.988575:0:18752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477840000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874622881686656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780168.988582:0:18752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787780168.988877:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04618e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874622881686656:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1787780168.989018:0:17238:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787780168.989295:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347fa9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881686912:0@lo:400:kworker.0 00000100:00100000:1.0:1787780168.989329:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780168.989358:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347faa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881687424:0@lo:400:kworker.0 00000100:00100000:1.0:1787780168.989380:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780168.989409:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0461955680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1874622881687936:0@lo:400:kworker.0 00000100:00100000:1.0:1787780168.989433:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780168.989463:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1787780168.989469:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347faa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:3644:1874622881686784:0@lo:400:kworker.0 00000100:00100000:1.0:1787780168.989495:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780168.989524:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347fa8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881687296:0@lo:400:kworker.0 00000100:00100000:1.0:1787780168.989545:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780168.989559:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0461954b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1874622881687808:0@lo:400:kworker.0 00000100:00100000:1.0:1787780168.989592:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780168.989617:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347fa9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1874622881687168:0@lo:400:kworker.0 00000100:00100000:1.0:1787780168.989638:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780168.989664:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0461957840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1874622881687680:0@lo:400:kworker.0 00000100:00100000:1.0:1787780168.989685:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780168.989699:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0461954000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1874622881688192:0@lo:400:kworker.0 00000100:00100000:1.0:1787780168.989724:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780168.990110:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1787780168.990118:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347fa8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881687040:0@lo:400:kworker.0 00000100:00100000:1.0:1787780168.990146:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780168.990163:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04619543c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874622881687552:0@lo:400:kworker.0 00000100:00100000:1.0:1787780168.990184:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780168.990198:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04619552c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1874622881688064:0@lo:400:kworker.0 00000100:00100000:1.0:1787780168.990220:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780168.990244:0:17247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881686912 00000100:00100000:1.0:1787780168.990251:0:17247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881686912 00000100:00100000:1.0:1787780168.990284:0:17247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881687296 00000100:00100000:1.0:1787780168.990287:0:17247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881687296 00000100:00100000:1.0:1787780168.990301:0:17247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787780168.990309:0:17247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0461957c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881686912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787780168.990366:0:17247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0461957c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881686912:12345-0@lo:400:kworker.0 Request processed in 58us (1036us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780168.990374:0:17247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787780168.990392:0:17247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787780168.990398:0:17247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04619561c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881687296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787780168.990425:0:17247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04619561c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881687296:12345-0@lo:400:kworker.0 Request processed in 28us (878us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780168.990431:0:17247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787780168.990450:0:19793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881687936 00000100:00100000:1.0:1787780168.990453:0:19793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881687936 00000100:00100000:1.0:1787780168.990478:0:19793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881687808 00000100:00100000:1.0:1787780168.990481:0:19793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881687808 00000100:00100000:1.0:1787780168.990492:0:19793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881687168 00000100:00100000:1.0:1787780168.990494:0:19793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881687168 00000100:00100000:1.0:1787780168.990515:0:19793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881687680 00000100:00100000:1.0:1787780168.990518:0:19793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881687680 00000100:00100000:1.0:1787780168.990529:0:19793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881688192 00000100:00100000:1.0:1787780168.990532:0:19793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881688192 00000100:00100000:1.0:1787780168.990543:0:19793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881688064 00000100:00100000:1.0:1787780168.990545:0:19793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881688064 00000100:00100000:1.0:1787780168.990556:0:19793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787780168.991010:0:17242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787780168.991021:0:17242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0461955e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1874622881687808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787780168.991058:0:17242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0461955e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1874622881687808:12345-0@lo:400:kworker.0 Request processed in 41us (1464us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780168.991064:0:17242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787780168.991079:0:17242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787780168.991085:0:17242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0461954f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1874622881687168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787780168.991118:0:17242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0461954f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1874622881687168:12345-0@lo:400:kworker.0 Request processed in 33us (1479us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780168.991131:0:17242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787780168.991143:0:17242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787780168.991149:0:17242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04619570c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1874622881687680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787780168.991173:0:17242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04619570c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1874622881687680:12345-0@lo:400:kworker.0 Request processed in 24us (1488us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780168.991178:0:17242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787780168.991187:0:17242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787780168.991247:0:17243:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:0.0:1787780168.991255:0:17243:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:0.0:1787780168.991271:0:19055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881687424 00000100:00100000:0.0:1787780168.991276:0:19055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881687424 00000100:00100000:0.0:1787780168.991304:0:19055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881687040 00000100:00100000:0.0:1787780168.991306:0:19055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881687040 00000100:00100000:0.0:1787780168.991316:0:19055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881687552 00000100:00100000:0.0:1787780168.991318:0:19055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881687552 00000100:00100000:0.0:1787780168.991331:0:19055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787780168.991337:0:19055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0461956940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881687424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787780168.991368:0:19055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0461956940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881687424:12345-0@lo:400:kworker.0 Request processed in 32us (1987us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780168.991374:0:19055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787780168.991386:0:19055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787780168.991391:0:19055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477af03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3642:x1874622881687040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787780168.991428:0:19055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477af03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3642:x1874622881687040:12345-0@lo:400:kworker.0 Request processed in 36us (1281us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780168.991433:0:19055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787780168.991444:0:19055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787780168.991449:0:19055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046e8be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1874622881687552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787780168.991482:0:19055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046e8be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1874622881687552:12345-0@lo:400:kworker.0 Request processed in 33us (1296us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780168.991488:0:19055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:0.0:1787780168.991706:0:17238:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787780168.991710:0:17238:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787780168.991712:0:17238:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787780168.991714:0:17238:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787780168.991766:0:19793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0461957480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874622881687936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787780168.991800:0:19793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0461957480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874622881687936:12345-0@lo:400:kworker.0 Request processed in 1238us (2366us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780168.991807:0:19793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787780168.991822:0:19793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787780168.991828:0:19793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477af2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1874622881688064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787780168.991872:0:19793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477af2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1874622881688064:12345-0@lo:400:kworker.0 Request processed in 45us (1650us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780168.991884:0:19793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787780168.991927:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347fa8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881687296:0@lo:400:kworker.0 00000100:00100000:1.0:1787780168.991941:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0461954b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1874622881687808:0@lo:400:kworker.0 00000100:00100000:1.0:1787780168.991950:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347fa9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881686912:0@lo:400:kworker.0 00000100:00100000:1.0:1787780168.991959:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347faa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881687424:0@lo:400:kworker.0 00010000:00080000:1.0:1787780168.991970:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0461955680 x1874622881687936/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787780184 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787780168.991981:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0461955680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1874622881687936:0@lo:400:kworker.0 00000100:00100000:1.0:1787780168.992011:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787780168.992021:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477840b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881688320:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787780168.992046:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780168.992075:0:18752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881688320 00000100:00100000:1.0:1787780168.992079:0:18752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881688320 00000100:00100000:1.0:1787780168.992105:0:18752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787780168.992112:0:18752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477af2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881688320:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787780168.992126:0:18752:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1787780168.992158:0:18752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477af2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881688320:12345-0@lo:13:osp-pre-1-1.0 Request processed in 47us (111us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780168.992164:0:18752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787780168.992191:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477840b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881688320:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787780168.992387:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347fa8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881687040:0@lo:400:kworker.0 00000100:00100000:1.0:1787780168.992397:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04619543c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874622881687552:0@lo:400:kworker.0 00000100:00100000:1.0:1787780168.992416:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04619552c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1874622881688064:0@lo:400:kworker.0 00000100:00100000:1.0:1787780168.992426:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347fa9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1874622881687168:0@lo:400:kworker.0 00000100:00100000:1.0:1787780168.992437:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0461957840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1874622881687680:0@lo:400:kworker.0 00000100:00100000:2.0:1787780168.992720:0:17236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881686784 00000100:00100000:2.0:1787780168.992735:0:17236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881686784 00000100:00100000:2.0:1787780168.992771:0:17236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1787780168.992778:0:17236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0478632450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+24:3644:x1874622881686784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787780168.992823:0:17236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0478632450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+24:3644:x1874622881686784:12345-0@lo:400:kworker.0 Request processed in 46us (3327us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780168.992829:0:17236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1787780168.992890:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347faa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:3644:1874622881686784:0@lo:400:kworker.0 00000100:00100000:3.0:1787780168.993475:0:17242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477af2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1874622881688192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787780168.993543:0:17242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477af2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1874622881688192:12345-0@lo:400:kworker.0 Request processed in 2349us (3818us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780168.993549:0:17242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:1.0:1787780168.993644:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0461954000 x1874622881688192/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787780184 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787780168.994051:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0461954000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1874622881688192:0@lo:400:kworker.0 00010000:00010000:0.0:1787780169.052307:0:17231:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787780169.501239:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04618ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881688448:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787780169.501305:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787780169.501363:0:18752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881688448 00000100:00100000:0.0:1787780169.501371:0:18752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881688448 00000100:00100000:0.0:1787780169.501415:0:18752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787780169.501423:0:18752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04618eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881688448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787780169.501452:0:18752:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1787780169.501492:0:18752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04618eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881688448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780169.501511:0:18752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787780169.501563:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04618ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881688448:0@lo:13:osp-pre-0-0.0 00000001:00100000:0.0:1787780170.018394:0:18745:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of eeb4a73f-1001-4fdb-898b-e22b5d3f1459 00000001:00100000:0.0:1787780170.018409:0:18745:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6e302a01-7f05-4001-b9ff-8e623671b6e0 00000001:00100000:0.0:1787780170.019234:0:17222:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of eeb4a73f-1001-4fdb-898b-e22b5d3f1459 00000001:00100000:0.0:1787780170.019243:0:17222:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 6e302a01-7f05-4001-b9ff-8e623671b6e0 00000001:00100000:3.0:1787780170.019751:0:17974:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of eeb4a73f-1001-4fdb-898b-e22b5d3f1459 00000001:00100000:3.0:1787780170.019765:0:17974:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 6e302a01-7f05-4001-b9ff-8e623671b6e0 00010000:00010000:1.0:1787780170.080239:0:18397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787780170.190988:0:20122:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:2.0:1787780170.524862:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787780170.524885:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477af0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874622881688576:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787780170.524955:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787780170.525095:0:18752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881688576 00000100:00100000:0.0:1787780170.525103:0:18752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881688576 00000100:00100000:0.0:1787780170.525168:0:18752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787780170.525179:0:18752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046215da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1874622881688576:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787780170.525213:0:18752:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1787780170.525267:0:18752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046215da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1874622881688576:12345-0@lo:13:osp-pre-0-1.0 Request processed in 90us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780170.525274:0:18752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:2.0:1787780170.525336:0:17238:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787780170.525436:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477af0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874622881688576:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1787780171.101256:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787780171.549737:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04618ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881688704:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787780171.549809:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780171.549921:0:17247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881688704 00000100:00100000:3.0:1787780171.549928:0:17247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881688704 00000100:00100000:3.0:1787780171.553188:0:17247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787780171.553209:0:17247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04778412c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1874622881688704:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787780171.553250:0:17247:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787780171.553331:0:17247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04778412c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1874622881688704:12345-0@lo:41:osp-pre-1-0.0 Request processed in 131us (3521us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780171.553338:0:17247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787780171.553395:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04618ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881688704:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787780171.554834:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477af12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881688832:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787780171.554915:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780171.554946:0:17248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881688832 00000100:00100000:3.0:1787780171.554955:0:17248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881688832 00000100:00100000:3.0:1787780171.555126:0:17248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787780171.555137:0:17248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477af0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881688832:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787780171.555172:0:17248:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1787780171.555215:0:17248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477af0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881688832:12345-0@lo:41:osp-pre-0-1.0 Request processed in 80us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780171.555222:0:17248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787780171.555425:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477af12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881688832:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787780171.680060:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787780171.680104:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787780171.680140:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787780171.680162:0:17237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863767296 00000100:00100000:0.0:1787780171.680172:0:17237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863767296 00000100:00100000:3.0:1787780171.680177:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787780171.680226:0:17237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 145 00000100:00100000:0.0:1787780171.680236:0:17237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0478630050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6cfa51b-ab50-4fc0-ae19-b724d7d272e4+13:2410:x1874622863767296:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1787780171.680237:0:19055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863767808 00000100:00100000:2.0:1787780171.680240:0:19055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863767808 00000100:00100000:2.0:1787780171.680279:0:19055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 14 00000100:00100000:2.0:1787780171.680286:0:19055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04778403c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e302a01-7f05-4001-b9ff-8e623671b6e0+5:2410:x1874622863767808:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1787780171.680299:0:17237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0478630050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6cfa51b-ab50-4fc0-ae19-b724d7d272e4+13:2410:x1874622863767296:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 65us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780171.680306:0:17237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 145 00000100:00100000:2.0:1787780171.680310:0:19055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04778403c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e302a01-7f05-4001-b9ff-8e623671b6e0+5:2410:x1874622863767808:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 27us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780171.680316:0:19055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 14 00000100:00080000:2.0:1787780171.680332:0:17238:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787780171.680471:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787780171.680509:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787780171.680544:0:18748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863768320 00000100:00100000:2.0:1787780171.680548:0:18748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863768320 00000100:00100000:2.0:1787780171.680575:0:18748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 15 00000100:00100000:2.0:1787780171.680581:0:18748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477840b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eeb4a73f-1001-4fdb-898b-e22b5d3f1459+6:2410:x1874622863768320:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1787780171.680609:0:18748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477840b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eeb4a73f-1001-4fdb-898b-e22b5d3f1459+6:2410:x1874622863768320:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 28us (139us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780171.680615:0:18748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 15 00000100:00080000:2.0:1787780171.680632:0:17238:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787780171.691036:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787780171.691062:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787780171.697168:0:19793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863767552 00000100:00100000:1.0:1787780171.697186:0:19793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863767552 00000100:00100000:0.0:1787780171.698130:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863768064 00000100:00100000:0.0:1787780171.698141:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863768064 00000100:00100000:0.0:1787780171.698240:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863767424 00000100:00100000:0.0:1787780171.698244:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863767424 00000100:00100000:0.0:1787780171.698279:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 44 00000100:00100000:0.0:1787780171.698292:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477842d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eeb4a73f-1001-4fdb-898b-e22b5d3f1459+5:2410:x1874622863768064:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1787780171.698379:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477842d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eeb4a73f-1001-4fdb-898b-e22b5d3f1459+5:2410:x1874622863768064:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 90us (18200us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780171.698387:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 44 00000100:00100000:0.0:1787780171.698407:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 45 00000100:00100000:0.0:1787780171.698415:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477841a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e302a01-7f05-4001-b9ff-8e623671b6e0+6:2410:x1874622863767424:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1787780171.698441:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477841a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e302a01-7f05-4001-b9ff-8e623671b6e0+6:2410:x1874622863767424:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 27us (17932us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780171.698465:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 45 00000100:00080000:0.0:1787780171.698624:0:17238:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787780171.698628:0:17238:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787780171.699165:0:19793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 46 00000100:00100000:1.0:1787780171.699174:0:19793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04778430c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e302a01-7f05-4001-b9ff-8e623671b6e0+5:2410:x1874622863767552:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1787780171.699229:0:19793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04778430c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e302a01-7f05-4001-b9ff-8e623671b6e0+5:2410:x1874622863767552:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 56us (19125us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780171.699237:0:19793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 46 00000100:00080000:0.0:1787780171.699712:0:17238:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787780171.702081:0:19055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863767680 00000100:00100000:2.0:1787780171.702096:0:19055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863767680 00000100:00100000:2.0:1787780171.702178:0:19055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 16 00000100:00100000:2.0:1787780171.702189:0:19055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477843840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e302a01-7f05-4001-b9ff-8e623671b6e0+5:2410:x1874622863767680:12345-192.168.203.31@tcp:400:kworker.0 00000100:00080000:0.0:1787780171.705170:0:17238:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787780171.705378:0:19055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477843840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e302a01-7f05-4001-b9ff-8e623671b6e0+5:2410:x1874622863767680:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 3185us (14344us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780171.705390:0:19055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 16 00000100:00100000:2.0:1787780171.710565:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787780171.710910:0:18748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863768192 00000100:00100000:3.0:1787780171.710919:0:18748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863768192 00000100:00100000:3.0:1787780171.710979:0:18748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 17 00000100:00100000:3.0:1787780171.710990:0:18748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046215c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eeb4a73f-1001-4fdb-898b-e22b5d3f1459+5:2410:x1874622863768192:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1787780171.711061:0:18748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046215c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eeb4a73f-1001-4fdb-898b-e22b5d3f1459+5:2410:x1874622863768192:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 74us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780171.711069:0:18748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 17 00000100:00080000:1.0:1787780171.711195:0:17238:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787780171.712981:0:17242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863767936 00000100:00100000:0.0:1787780171.712993:0:17242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863767936 00000100:00100000:0.0:1787780171.713067:0:17242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 47 00000100:00100000:0.0:1787780171.713076:0:17242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477840780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eeb4a73f-1001-4fdb-898b-e22b5d3f1459+6:2410:x1874622863767936:12345-192.168.203.31@tcp:400:kworker.0 00000100:00080000:1.0:1787780171.713124:0:17238:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787780171.713154:0:17242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477840780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eeb4a73f-1001-4fdb-898b-e22b5d3f1459+6:2410:x1874622863767936:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 79us (22090us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780171.713162:0:17242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 47 00000001:00100000:3.0:1787780172.062435:0:19563:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of eeb4a73f-1001-4fdb-898b-e22b5d3f1459 00010000:00010000:0.0:1787780172.126417:0:17231:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787780173.155830:0:18397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787780174.108958:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347ee0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881688960:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787780174.109058:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780174.109178:0:18752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881688960 00000100:00100000:3.0:1787780174.109187:0:18752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881688960 00000100:00100000:3.0:1787780174.109257:0:18752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787780174.109269:0:18752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347ee0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881688960:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787780174.109307:0:18752:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1787780174.109360:0:18752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347ee0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881688960:12345-0@lo:13:osp-pre-1-1.0 Request processed in 94us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780174.109369:0:18752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787780174.109428:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347ee0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881688960:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1787780174.109762:0:17238:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787780174.109782:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787780174.109796:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477af0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881689088:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787780174.109836:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780174.109900:0:18752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881689088 00000100:00100000:1.0:1787780174.109906:0:18752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881689088 00000100:00100000:1.0:1787780174.109942:0:18752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787780174.109949:0:18752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477af12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1874622881689088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787780174.109962:0:18752:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1787780174.109997:0:18752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477af12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1874622881689088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 49us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780174.110003:0:18752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:1.0:1787780174.110020:0:17238:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787780174.110042:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477af0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881689088:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787780174.121183:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787780174.121214:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347ee0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:3641:1874622881689216:0@lo:400:kworker.0 00000100:00100000:3.0:1787780174.121318:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780174.121390:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881689216 00000100:00100000:3.0:1787780174.121400:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881689216 00000100:00100000:3.0:1787780174.121458:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1787780174.121479:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0478631c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+24:3641:x1874622881689216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787780174.121544:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0478631c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+24:3641:x1874622881689216:12345-0@lo:400:kworker.0 Request processed in 77us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780174.121552:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1787780174.122009:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c046215e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881689344:0@lo:400:kworker.0 00000100:00100000:2.0:1787780174.122054:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787780174.122110:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787780174.122117:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c046215de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881689472:0@lo:400:kworker.0 00000100:00100000:2.0:1787780174.122145:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787780174.122177:0:18750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881689472 00000100:00100000:2.0:1787780174.122182:0:18750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881689472 00000100:00100000:2.0:1787780174.122231:0:18750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787780174.122239:0:18750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046215ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881689472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787780174.122280:0:18750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046215ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881689472:12345-0@lo:400:kworker.0 Request processed in 43us (134us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780174.122302:0:18750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:2.0:1787780174.122326:0:17238:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787780174.122365:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c046215de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881689472:0@lo:400:kworker.0 00000100:00100000:2.0:1787780174.122428:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c03488e30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881689856:0@lo:400:kworker.0 00000100:00100000:2.0:1787780174.122455:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787780174.122512:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787780174.122518:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047785cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874622881689984:0@lo:400:kworker.0 00000100:00100000:2.0:1787780174.122547:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787780174.122591:0:20085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881689984 00000100:00100000:2.0:1787780174.122595:0:20085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881689984 00000100:00100000:3.0:1787780174.122994:0:17248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881689344 00000100:00100000:3.0:1787780174.123000:0:17248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881689344 00000100:00100000:3.0:1787780174.123030:0:17248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787780174.123038:0:17248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046215d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881689344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787780174.123090:0:17248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046215d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881689344:12345-0@lo:400:kworker.0 Request processed in 53us (1035us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780174.123096:0:17248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787780174.123118:0:18748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881689856 00000100:00100000:3.0:1787780174.123131:0:18748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881689856 00000100:00100000:3.0:1787780174.123167:0:18748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787780174.123173:0:18748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03488e1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881689856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787780174.123204:0:18748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03488e1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881689856:12345-0@lo:400:kworker.0 Request processed in 32us (749us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780174.123211:0:18748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787780174.123240:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c03488e30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881689856:0@lo:400:kworker.0 00000100:00100000:3.0:1787780174.123251:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c046215e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881689344:0@lo:400:kworker.0 00000100:00080000:3.0:1787780174.123272:0:17238:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787780174.123290:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c046215de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874622881689600:0@lo:400:kworker.0 00000100:00100000:3.0:1787780174.123320:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780174.123347:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347ee0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:3641:1874622881689216:0@lo:400:kworker.0 00000100:00100000:3.0:1787780174.123363:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787780174.123368:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c03488e12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881689728:0@lo:400:kworker.0 00000100:00100000:3.0:1787780174.123392:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780174.123419:0:17243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881689600 00000100:00100000:3.0:1787780174.123423:0:17243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881689600 00000100:00100000:3.0:1787780174.123444:0:17243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787780174.123450:0:17243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c047785e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1874622881689984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787780174.123501:0:17243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c047785e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1874622881689984:12345-0@lo:400:kworker.0 Request processed in 51us (953us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780174.123508:0:17243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787780174.123522:0:17243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787780174.123528:0:17243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347ee0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874622881689600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787780174.123557:0:17243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347ee0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874622881689600:12345-0@lo:400:kworker.0 Request processed in 29us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780174.123571:0:17243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787780174.123590:0:17247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881689728 00000100:00100000:3.0:1787780174.123594:0:17247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881689728 00000100:00100000:3.0:1787780174.123615:0:17247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787780174.123621:0:17247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347ee0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881689728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787780174.124508:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047785cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874622881689984:0@lo:400:kworker.0 00000100:00100000:0.0:1787780174.124550:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c046215de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874622881689600:0@lo:400:kworker.0 00000100:00100000:0.0:1787780174.126104:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047785c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1874622881690112:0@lo:400:kworker.0 00000100:00100000:0.0:1787780174.126194:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780174.130135:0:17247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347ee0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881689728:12345-0@lo:400:kworker.0 Request processed in 6502us (6730us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780174.130153:0:17247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787780174.130377:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047785ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1874622881690240:0@lo:400:kworker.0 00000100:00100000:2.0:1787780174.130450:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780174.130604:0:17243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881690112 00000100:00100000:3.0:1787780174.130615:0:17243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881690112 00000100:00100000:3.0:1787780174.130943:0:17243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881690240 00000100:00100000:3.0:1787780174.130948:0:17243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881690240 00000100:00080000:1.0:1787780174.131049:0:17238:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787780174.131054:0:17238:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787780174.131136:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c03488e12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881689728:0@lo:400:kworker.0 00000100:00100000:0.0:1787780174.131174:0:19793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787780174.131186:0:19793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04618e8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874622881690112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787780174.131264:0:19793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04618e8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874622881690112:12345-0@lo:400:kworker.0 Request processed in 80us (5069us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780174.131271:0:19793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787780174.134049:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047785c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1874622881690112:0@lo:400:kworker.0 00000100:00100000:3.0:1787780174.134550:0:17243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787780174.134565:0:17243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c047785d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1874622881690240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787780174.135960:0:17243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c047785d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1874622881690240:12345-0@lo:400:kworker.0 Request processed in 1391us (5501us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780174.135976:0:17243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:3.0:1787780174.136057:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c047785ed00 x1874622881690240/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787780190 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787780174.136073:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047785ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1874622881690240:0@lo:400:kworker.0 00000100:00100000:1.0:1787780174.136925:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347ee3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1874622881690368:0@lo:400:kworker.0 00000100:00100000:1.0:1787780174.136986:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780174.137017:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787780174.137022:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347ee1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1874622881690496:0@lo:400:kworker.0 00000100:00100000:1.0:1787780174.137041:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780174.137067:0:19793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881690368 00000100:00100000:1.0:1787780174.137074:0:19793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881690368 00000100:00100000:1.0:1787780174.137125:0:19793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881690496 00000100:00100000:1.0:1787780174.137129:0:19793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881690496 00000100:00100000:1.0:1787780174.137153:0:19793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787780174.137162:0:19793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477af0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1874622881690368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787780174.137231:0:19793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477af0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1874622881690368:12345-0@lo:400:kworker.0 Request processed in 69us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780174.137239:0:19793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787780174.137255:0:19793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787780174.137260:0:19793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477af3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1874622881690496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787780174.137288:0:19793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477af3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1874622881690496:12345-0@lo:400:kworker.0 Request processed in 28us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780174.137293:0:19793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:1.0:1787780174.137310:0:17238:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787780174.137314:0:17238:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787780174.137336:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0347ee1a40 x1874622881690496/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787780190 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787780174.137349:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347ee1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1874622881690496:0@lo:400:kworker.0 00000100:00100000:1.0:1787780174.137360:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347ee3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1874622881690368:0@lo:400:kworker.0 00010000:00010000:3.0:1787780174.173809:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787780174.620015:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787780174.620069:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04618eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881690624:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787780174.620163:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787780174.620939:0:18752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881690624 00000100:00100000:0.0:1787780174.620952:0:18752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881690624 00000100:00100000:0.0:1787780174.621016:0:18752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787780174.621025:0:18752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04618e83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1874622881690624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787780174.621065:0:18752:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1787780174.621134:0:18752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04618e83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1874622881690624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (972us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780174.621142:0:18752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787780174.621206:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04618eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881690624:0@lo:13:osp-pre-0-0.0 00000020:00000080:3.0:1787780174.630501:0:20269:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff6b441850 20000000:00000080:3.0:1787780174.630525:0:20269:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9c04711a9400 uarg=0000000000000000 20000000:01000000:3.0:1787780174.630781:0:20269:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1787780174.630789:0:20269:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1787780174.630794:0:20269:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1787780174.634105:0:20270:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:0.0:1787780174.634340:0:20269:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1787780174.651704:0:20269:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787780174.651767:0:20269:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c0348c7ac00/0xc8fc0a5179961cff lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780174.651792:0:20269:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c0481373a00/0xc8fc0a5179961994 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a517996198d expref: 23 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780174.651801:0:20269:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c0481373e00/0xc8fc0a51799619a2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a517996199b expref: 23 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780174.651807:0:20269:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c0481373400/0xc8fc0a51799619e1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a51799619da expref: 23 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780174.651814:0:20269:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c0477a71200/0xc8fc0a5179961b46 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a5179961b3f expref: 23 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780174.651826:0:20269:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c0348c7ae00/0xc8fc0a5179961c8f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea21ce expref: 12 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780174.652013:0:20269:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c0348c7b200/0xc8fc0a5179961cce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea223e expref: 12 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780174.652022:0:20269:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c0348c7ac00/0xc8fc0a5179961cff lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 20269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780174.652082:0:20269:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c0348c7b200/0xc8fc0a5179961cce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea223e expref: 12 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780174.652102:0:20269:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c0348c7b200/0xc8fc0a5179961cce lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea223e expref: 12 pid: 17237 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787780174.652120:0:20269:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04618eb0c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20269:1874622881690752:192.168.203.31@tcp:104: 00010000:00010000:0.0:1787780174.652401:0:20269:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c0348c7ae00/0xc8fc0a5179961c8f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea21ce expref: 12 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780174.652410:0:20269:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c0348c7ae00/0xc8fc0a5179961c8f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea21ce expref: 12 pid: 17237 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787780174.652418:0:20269:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04618ebc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20269:1874622881690880:192.168.203.31@tcp:104: 00010000:00010000:0.0:1787780174.652453:0:20269:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c0477a71200/0xc8fc0a5179961b46 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc8fc0a5179961b3f expref: 23 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780174.652473:0:20269:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c0477a71200/0xc8fc0a5179961b46 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc8fc0a5179961b3f expref: 23 pid: 17236 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787780174.652481:0:20269:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04618ea580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20269:1874622881691008:0@lo:104: 00000100:00100000:0.0:1787780174.652530:0:20269:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787780174.652603:0:17226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881691008 00000100:00100000:0.0:1787780174.652611:0:17226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881691008 00000100:00100000:0.0:1787780174.652679:0:17226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787780174.652688:0:17226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04618e8b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+3:20269:x1874622881691008:12345-0@lo:104: 00010000:00010000:1.0:1787780174.657077:0:20269:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c0481373400/0xc8fc0a51799619e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc8fc0a51799619da expref: 23 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780174.657101:0:20269:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c0481373400/0xc8fc0a51799619e1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc8fc0a51799619da expref: 23 pid: 17234 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787780174.657120:0:20269:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477af1680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20269:1874622881691136:0@lo:104: 00000100:00100000:1.0:1787780174.657208:0:20269:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787780174.657250:0:20269:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c0481373e00/0xc8fc0a51799619a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc8fc0a517996199b expref: 23 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780174.657259:0:20269:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c0481373e00/0xc8fc0a51799619a2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc8fc0a517996199b expref: 23 pid: 17234 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787780174.657283:0:20269:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477af0f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20269:1874622881691264:0@lo:104: 00000100:00100000:1.0:1787780174.657307:0:20269:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787780174.657328:0:20269:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c0481373a00/0xc8fc0a5179961994 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc8fc0a517996198d expref: 23 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780174.657335:0:20269:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c0481373a00/0xc8fc0a5179961994 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc8fc0a517996198d expref: 23 pid: 17234 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787780174.657342:0:20269:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477af0000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20269:1874622881691392:0@lo:104: 00000100:00100000:1.0:1787780174.657360:0:20269:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780174.657371:0:20269:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c045848be40 going to sleep for 11 seconds 00000100:00100000:1.0:1787780174.657418:0:17225:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:1.0:1787780174.657428:0:17225:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00000100:00100000:1.0:1787780174.657590:0:17225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881691136 00000100:00100000:1.0:1787780174.657598:0:17225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881691136 00000100:00100000:1.0:1787780174.657643:0:17225:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:1.0:1787780174.657650:0:17225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881691264 00000100:00100000:1.0:1787780174.657653:0:17225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881691264 00000100:00100000:1.0:1787780174.657662:0:17225:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:1.0:1787780174.657666:0:17225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881691392 00000100:00100000:1.0:1787780174.657669:0:17225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881691392 00000100:00100000:1.0:1787780174.657783:0:20271:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787780174.657794:0:20271:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477af3c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+6:20269:x1874622881691136:12345-0@lo:104: 00010000:00010000:0.0:1787780174.657863:0:17226:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff9c04766dd400/0xc8fc0a5179961b3f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc8fc0a5179961b46 expref: -99 pid: 19562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780174.657939:0:17226:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787780174.657946:0:17226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04618e8b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+6:20269:x1874622881691008:12345-0@lo:104: Request processed in 5259us (5416us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780174.657954:0:17226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787780174.657982:0:17226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787780174.657989:0:17226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477af1e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+5:20269:x1874622881691264:12345-0@lo:104: 00010000:00010000:1.0:1787780174.658186:0:20271:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff9c04766dcc00/0xc8fc0a51799619da lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc8fc0a51799619e1 expref: -99 pid: 18744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787780174.658232:0:20269:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04618ea580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20269:1874622881691008:0@lo:104: 00000100:00100000:1.0:1787780174.658287:0:20269:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477af1680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20269:1874622881691136:0@lo:104: 00010000:00010000:1.0:1787780174.658314:0:20271:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787780174.658320:0:20271:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477af3c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+5:20269:x1874622881691136:12345-0@lo:104: Request processed in 529us (1112us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780174.658327:0:20271:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:1.0:1787780174.658346:0:18397:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787780174.658353:0:18397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff9c04766dd400/0xc8fc0a5179961b3f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc8fc0a5179961b46 expref: -99 pid: 19562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780174.658362:0:18397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c04766dd400 already unused, calling callback (ffffffffc139ac20) 10000000:00010000:1.0:1787780174.658366:0:18397:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff9c04766dd400/0xc8fc0a5179961b3f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xc8fc0a5179961b46 expref: -99 pid: 19562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780174.658376:0:18397:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff9c04766dd400/0xc8fc0a5179961b3f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xc8fc0a5179961b46 expref: -99 pid: 19562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787780174.658383:0:18397:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff9c04766dd400/0xc8fc0a5179961b3f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xc8fc0a5179961b46 expref: -99 pid: 19562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787780174.658390:0:18397:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787780174.658426:0:18397:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff9c04766dd400/0xc8fc0a5179961b3f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a5179961b46 expref: -99 pid: 19562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780174.658432:0:18397:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787780174.658455:0:18397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff9c04766dd400/0xc8fc0a5179961b3f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a5179961b46 expref: -99 pid: 19562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780174.658472:0:18397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff9c04766dd400/0xc8fc0a5179961b3f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a5179961b46 expref: -99 pid: 19562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780174.658485:0:18397:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787780174.658494:0:18397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff9c04766dcc00/0xc8fc0a51799619da lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc8fc0a51799619e1 expref: -99 pid: 18744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780174.658500:0:18397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c04766dcc00 already unused, calling callback (ffffffffc139ac20) 10000000:00010000:1.0:1787780174.658503:0:18397:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff9c04766dcc00/0xc8fc0a51799619da lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc8fc0a51799619e1 expref: -99 pid: 18744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780174.658511:0:18397:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff9c04766dcc00/0xc8fc0a51799619da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc8fc0a51799619e1 expref: -99 pid: 18744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787780174.658517:0:18397:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff9c04766dcc00/0xc8fc0a51799619da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc8fc0a51799619e1 expref: -99 pid: 18744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787780174.658522:0:18397:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787780174.658539:0:18397:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff9c04766dcc00/0xc8fc0a51799619da lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a51799619e1 expref: -99 pid: 18744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780174.658544:0:18397:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787780174.658572:0:18397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff9c04766dcc00/0xc8fc0a51799619da lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a51799619e1 expref: -99 pid: 18744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780174.658580:0:18397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff9c04766dcc00/0xc8fc0a51799619da lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a51799619e1 expref: -99 pid: 18744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780174.658590:0:18397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787780174.658592:0:18397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787780174.658593:0:18397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787780174.658619:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477af30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:3643:1874622881691648:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787780174.658654:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780174.658763:0:20271:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787780174.658775:0:20271:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477af21c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+4:20269:x1874622881691392:12345-0@lo:104: 00010000:00010000:1.0:1787780174.658791:0:20271:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff9c0444c19200/0xc8fc0a517996198d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc8fc0a5179961994 expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787780174.658862:0:20269:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477af0000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20269:1874622881691392:0@lo:104: 00010000:00010000:1.0:1787780174.658887:0:20271:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787780174.658892:0:20271:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477af21c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+4:20269:x1874622881691392:12345-0@lo:104: Request processed in 121us (1531us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780174.658899:0:20271:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787780174.658937:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477af1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:3642:1874622881691520:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787780174.658964:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787780174.658994:0:17231:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787780174.658999:0:17231:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff9c0444c19200/0xc8fc0a517996198d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc8fc0a5179961994 expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780174.659007:0:17231:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0444c19200 already unused, calling callback (ffffffffc139ac20) 10000000:00010000:1.0:1787780174.659010:0:17231:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff9c0444c19200/0xc8fc0a517996198d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc8fc0a5179961994 expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780174.659018:0:17231:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff9c0444c19200/0xc8fc0a517996198d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc8fc0a5179961994 expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787780174.659024:0:17231:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff9c0444c19200/0xc8fc0a517996198d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc8fc0a5179961994 expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787780174.659030:0:17231:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787780174.659066:0:17231:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff9c0444c19200/0xc8fc0a517996198d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a5179961994 expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780174.659073:0:17231:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787780174.659092:0:17231:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff9c0444c19200/0xc8fc0a517996198d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a5179961994 expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780174.659100:0:17231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff9c0444c19200/0xc8fc0a517996198d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a5179961994 expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780174.659111:0:17231:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787780174.659113:0:17231:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787780174.659115:0:17231:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787780174.659130:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0481622940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:3644:1874622881691776:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787780174.659157:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780174.659216:0:17229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881691648 00000100:00100000:1.0:1787780174.659223:0:17229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881691648 00010000:00010000:1.0:1787780174.659261:0:17229:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c0481373400/0xc8fc0a51799619e1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc8fc0a51799619da expref: 24 pid: 17234 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787780174.659287:0:17229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881691520 00000100:00100000:1.0:1787780174.659290:0:17229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881691520 00010000:00010000:1.0:1787780174.659302:0:17229:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c0477a71200/0xc8fc0a5179961b46 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc8fc0a5179961b3f expref: 25 pid: 17236 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787780174.659313:0:17229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881691776 00000100:00100000:1.0:1787780174.659315:0:17229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881691776 00010000:00010000:1.0:1787780174.659323:0:17229:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c0481373a00/0xc8fc0a5179961994 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc8fc0a517996198d expref: 26 pid: 17234 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787780174.659334:0:17229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787780174.659339:0:17229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477af3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+26:3643:x1874622881691648:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787780174.659354:0:17229:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787780174.659358:0:17229:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c0481373400/0xc8fc0a51799619e1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc8fc0a51799619da expref: 26 pid: 17234 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780174.659375:0:17229:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c0481373400/0xc8fc0a51799619e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc8fc0a51799619da expref: 26 pid: 17234 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780174.659391:0:17229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c0481373400/0xc8fc0a51799619e1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc8fc0a51799619da expref: 26 pid: 17234 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780174.659413:0:17229:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787780174.659443:0:17229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477af3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+25:3643:x1874622881691648:12345-0@lo:103:ldlm_bl.0 Request processed in 103us (788us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780174.659450:0:17229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787780174.659479:0:17229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787780174.659485:0:17229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477af03c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+24:3642:x1874622881691520:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787780174.659493:0:17229:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787780174.659497:0:17229:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c0477a71200/0xc8fc0a5179961b46 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc8fc0a5179961b3f expref: 24 pid: 17236 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780174.659504:0:17229:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c0477a71200/0xc8fc0a5179961b46 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc8fc0a5179961b3f expref: 24 pid: 17236 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780174.659514:0:17229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c0477a71200/0xc8fc0a5179961b46 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc8fc0a5179961b3f expref: 24 pid: 17236 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780174.659522:0:17229:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787780174.659546:0:17229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477af03c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+23:3642:x1874622881691520:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780174.659552:0:17229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787780174.659563:0:17229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787780174.659569:0:17229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0481623840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+22:3644:x1874622881691776:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787780174.659583:0:17229:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787780174.659588:0:17229:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c0481373a00/0xc8fc0a5179961994 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc8fc0a517996198d expref: 22 pid: 17234 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780174.659597:0:17229:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c0481373a00/0xc8fc0a5179961994 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc8fc0a517996198d expref: 22 pid: 17234 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780174.659607:0:17229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c0481373a00/0xc8fc0a5179961994 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc8fc0a517996198d expref: 22 pid: 17234 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780174.659617:0:17229:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787780174.659643:0:17229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0481623840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+21:3644:x1874622881691776:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780174.659650:0:17229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787780174.659676:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477af30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:3643:1874622881691648:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787780174.659992:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787780174.661863:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0481622940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:3644:1874622881691776:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787780174.661952:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477af1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:3642:1874622881691520:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787780174.662198:0:17226:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff9c04766dc200/0xc8fc0a517996199b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc8fc0a51799619a2 expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780174.662354:0:17226:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787780174.662362:0:17226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477af1e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+3:20269:x1874622881691264:12345-0@lo:104: Request processed in 4373us (5053us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780174.662375:0:17226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:2.0:1787780174.662455:0:18397:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787780174.662472:0:18397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff9c04766dc200/0xc8fc0a517996199b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc8fc0a51799619a2 expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780174.662480:0:18397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c04766dc200 already unused, calling callback (ffffffffc139ac20) 10000000:00010000:2.0:1787780174.662485:0:18397:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff9c04766dc200/0xc8fc0a517996199b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc8fc0a51799619a2 expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780174.662497:0:18397:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff9c04766dc200/0xc8fc0a517996199b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc8fc0a51799619a2 expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787780174.662505:0:18397:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff9c04766dc200/0xc8fc0a517996199b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc8fc0a51799619a2 expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787780174.662511:0:18397:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787780174.662598:0:18397:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff9c04766dc200/0xc8fc0a517996199b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a51799619a2 expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780174.662607:0:18397:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787780174.662637:0:18397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff9c04766dc200/0xc8fc0a517996199b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a51799619a2 expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780174.662645:0:18397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff9c04766dc200/0xc8fc0a517996199b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc8fc0a51799619a2 expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780174.662664:0:18397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787780174.662666:0:18397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787780174.662668:0:18397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787780174.662674:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787780174.662687:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047785de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:3642:1874622881691904:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787780174.663062:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787780174.663150:0:17229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881691904 00000100:00100000:0.0:1787780174.663157:0:17229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881691904 00010000:00010000:0.0:1787780174.663190:0:17229:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c0481373e00/0xc8fc0a51799619a2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc8fc0a517996199b expref: 21 pid: 17234 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787780174.663224:0:17229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787780174.663234:0:17229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c047785f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+21:3642:x1874622881691904:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787780174.663247:0:17229:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787780174.663262:0:17229:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c0481373e00/0xc8fc0a51799619a2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc8fc0a517996199b expref: 21 pid: 17234 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780174.663272:0:17229:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c0481373e00/0xc8fc0a51799619a2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc8fc0a517996199b expref: 21 pid: 17234 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780174.663292:0:17229:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787780174.663329:0:17229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c047785f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+21:3642:x1874622881691904:12345-0@lo:103:ldlm_bl.0 Request processed in 96us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780174.663336:0:17229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787780174.663427:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047785de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:3642:1874622881691904:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787780174.664421:0:20269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c0481373e00/0xc8fc0a51799619a2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc8fc0a517996199b expref: 20 pid: 17234 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787780174.664451:0:20269:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477af0f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20269:1874622881691264:0@lo:104: 00000100:00100000:1.0:1787780174.666991:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787780174.667036:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787780174.667173:0:17228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863768448 00000100:00100000:3.0:1787780174.667183:0:17228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863768448 00010000:00010000:3.0:1787780174.667232:0:17228:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c0348c7b200/0xc8fc0a5179961cce lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea223e expref: 13 pid: 17237 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787780174.667274:0:17228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863768576 00000100:00100000:3.0:1787780174.667278:0:17228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863768576 00010000:00010000:3.0:1787780174.667291:0:17228:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c0348c7ae00/0xc8fc0a5179961c8f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea21ce expref: 14 pid: 17237 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787780174.667317:0:17228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 13 00000100:00100000:3.0:1787780174.667328:0:17228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0341d4a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c6cfa51b-ab50-4fc0-ae19-b724d7d272e4+14:2411:x1874622863768448:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787780174.667346:0:17228:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787780174.667352:0:17228:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c0348c7b200/0xc8fc0a5179961cce lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea223e expref: 14 pid: 17237 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780174.667367:0:17228:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c0348c7b200/0xc8fc0a5179961cce lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea223e expref: 14 pid: 17237 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780174.667396:0:17228:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787780174.667473:0:17228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0341d4a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c6cfa51b-ab50-4fc0-ae19-b724d7d272e4+14:2411:x1874622863768448:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 135us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780174.667482:0:17228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 13 00000100:00100000:3.0:1787780174.667539:0:17228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 14 00000100:00100000:3.0:1787780174.667545:0:17228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0481622940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c6cfa51b-ab50-4fc0-ae19-b724d7d272e4+13:2411:x1874622863768576:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787780174.667553:0:17228:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787780174.667558:0:17228:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c0348c7ae00/0xc8fc0a5179961c8f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea21ce expref: 13 pid: 17237 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780174.667591:0:17228:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c0348c7ae00/0xc8fc0a5179961c8f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea21ce expref: 13 pid: 17237 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780174.667605:0:17228:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c0348c7ac00/0xc8fc0a5179961cff lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 20269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780174.667615:0:17228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0348c7ac00/0xc8fc0a5179961cff lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 20269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780174.667635:0:17228:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c0348c7ac00/0xc8fc0a5179961cff lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780174.667643:0:17228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c0348c7ac00/0xc8fc0a5179961cff lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780174.667650:0:17228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c0348c7ac00/0xc8fc0a5179961cff lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780174.667657:0:17228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c0348c7ac00/0xc8fc0a5179961cff lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780174.667662:0:17228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0348c7ac00 already unused, calling callback (ffffffffc0d97420) 00010000:00010000:3.0:1787780174.667667:0:17228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c0348c7ac00/0xc8fc0a5179961cff lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780174.667675:0:17228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c0348c7ac00/0xc8fc0a5179961cff lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 20269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780174.667684:0:17228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c0348c7ac00/0xc8fc0a5179961cff lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780174.667719:0:17228:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787780174.667741:0:17228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0481622940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c6cfa51b-ab50-4fc0-ae19-b724d7d272e4+13:2411:x1874622863768576:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 196us (705us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780174.667748:0:17228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 14 00010000:00010000:2.0:1787780174.671071:0:20269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c0348c7b200/0xc8fc0a5179961cce lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea223e expref: 12 pid: 17237 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787780174.671102:0:20269:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04618eb0c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20269:1874622881690752:192.168.203.31@tcp:104: 00010000:00010000:2.0:1787780174.671118:0:20269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c0348c7ae00/0xc8fc0a5179961c8f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea21ce expref: 11 pid: 17237 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787780174.671127:0:20269:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04618ebc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20269:1874622881690880:192.168.203.31@tcp:104: 00010000:00010000:2.0:1787780174.671175:0:20269:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c0348c7ac00/0xc8fc0a5179961cff lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780174.671186:0:20269:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c0348c7ac00/0xc8fc0a5179961cff lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780174.671215:0:20269:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c0348c7ac00/0xc8fc0a5179961cff lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780174.671221:0:20269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c0348c7ac00/0xc8fc0a5179961cff lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780175.196064:0:17231:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787780175.526287:0:17278:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787780175.650622:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047785e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874622881692032:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787780175.650736:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787780175.650828:0:18752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881692032 00000100:00100000:2.0:1787780175.650854:0:18752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881692032 00000100:00100000:2.0:1787780175.650918:0:18752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787780175.650928:0:18752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c047785de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1874622881692032:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787780175.650958:0:18752:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1787780175.651017:0:18752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c047785de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1874622881692032:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780175.651026:0:18752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787780175.651088:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047785e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874622881692032:0@lo:13:osp-pre-0-1.0 10000000:01000000:1.0:1787780175.777717:0:17239:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787780175.777728:0:17239:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c046e01c800 from 13 10000000:01000000:1.0:1787780175.777736:0:17239:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787780175.777826:0:17239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c0347e4b600/0xc8fc0a5179961d06 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780175.777861:0:17239:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff9c0347e4b600/0xc8fc0a5179961d06 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780175.777886:0:17239:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff9c0347e4b600/0xc8fc0a5179961d06 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787780175.777921:0:17239:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04816203c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17239:1874622881692160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787780175.778021:0:17239:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780175.778082:0:17236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881692160 00000100:00100000:1.0:1787780175.778082:0:17239:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0445fd3e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787780175.778092:0:17236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881692160 00000100:00100000:3.0:1787780175.778162:0:17236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1787780175.778173:0:17236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0478630c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+20:17239:x1874622881692160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787780175.778191:0:17236:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787780175.778208:0:17236:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0440031200/0xc8fc0a5179961d0d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc8fc0a5179961d06 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780175.778237:0:17236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0440031200/0xc8fc0a5179961d0d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc8fc0a5179961d06 expref: 21 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780175.778248:0:17236:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0440031200/0xc8fc0a5179961d0d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a5179961d06 expref: 21 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780175.778259:0:17236:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0440031200, rc 0) 00000100:00100000:3.0:1787780175.778312:0:17236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0478630c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+21:17239:x1874622881692160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 140us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780175.778320:0:17236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1787780175.778387:0:17239:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04816203c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17239:1874622881692160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787780175.778404:0:17239:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff9c0347e4b600/0xc8fc0a5179961d06 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a5179961d0d expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780175.778414:0:17239:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff9c0347e4b600/0xc8fc0a5179961d06 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc8fc0a5179961d0d expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787780175.778514:0:17239:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04816203c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17239:1874622881692288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787780175.778541:0:17239:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780175.778565:0:17239:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0445fd3e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787780175.778599:0:17237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881692288 00000100:00100000:1.0:1787780175.778603:0:17237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881692288 00000100:00100000:1.0:1787780175.778630:0:17237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1787780175.778637:0:17237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0478631450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+21:17239:x1874622881692288:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787780175.778776:0:17237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0478631450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+21:17239:x1874622881692288:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 138us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780175.778793:0:17237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1787780175.778834:0:17239:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04816203c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17239:1874622881692288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787780175.778901:0:17239:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04816203c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17239:1874622881692416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787780175.778943:0:17239:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780175.778963:0:17239:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0445fd3e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787780175.778974:0:17237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881692416 00000100:00100000:1.0:1787780175.778978:0:17237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881692416 00000100:00100000:1.0:1787780175.778999:0:17237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1787780175.779005:0:17237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0478630450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+21:17239:x1874622881692416:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787780175.779165:0:17237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0478630450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+21:17239:x1874622881692416:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 159us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780175.779172:0:17237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1787780175.779217:0:17239:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04816203c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17239:1874622881692416:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787780175.779999:0:20296:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1787780175.780472:0:17239:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1787780175.780497:0:17239:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787780175.780509:0:17239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c0347e4b600/0xc8fc0a5179961d06 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a5179961d0d expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780175.780521:0:17239:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff9c0347e4b600/0xc8fc0a5179961d06 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a5179961d0d expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787780175.780531:0:17239:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787780175.780534:0:17239:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c0446175800 from 13 10000000:01000000:0.0:1787780175.780537:0:17239:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787780175.780577:0:17239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c0348c7a800/0xc8fc0a5179961d14 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780175.780586:0:17239:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff9c0348c7a800/0xc8fc0a5179961d14 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780175.780600:0:17239:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff9c0348c7a800/0xc8fc0a5179961d14 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787780175.780622:0:17239:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04618e8f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17239:1874622881692544:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787780175.780692:0:17239:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787780175.780732:0:17239:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0471259b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787780175.781433:0:17237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881692544 00000100:00100000:1.0:1787780175.781443:0:17237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881692544 00000100:00100000:1.0:1787780175.781509:0:17237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1787780175.781520:0:17237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0478632050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+21:17239:x1874622881692544:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787780175.781538:0:17237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787780175.781555:0:17237:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0347e4a000/0xc8fc0a5179961d1b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc8fc0a5179961d14 expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780175.781599:0:17237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0347e4a000/0xc8fc0a5179961d1b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc8fc0a5179961d14 expref: 22 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780175.781627:0:17237:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0347e4a000/0xc8fc0a5179961d1b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a5179961d14 expref: 22 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780175.781636:0:17237:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0347e4a000, rc 0) 00000100:00100000:1.0:1787780175.785204:0:17237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0478632050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+22:17239:x1874622881692544:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 3667us (4494us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780175.785222:0:17237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1787780175.797162:0:17239:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04618e8f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17239:1874622881692544:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787780175.797210:0:17239:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff9c0348c7a800/0xc8fc0a5179961d14 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a5179961d1b expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780175.797227:0:17239:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff9c0348c7a800/0xc8fc0a5179961d14 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc8fc0a5179961d1b expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787780175.798036:0:17239:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047785e1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17239:1874622881692672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787780175.798127:0:17239:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787780175.798182:0:17239:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c047116ed80 going to sleep for 11 seconds 00000100:00100000:3.0:1787780175.798260:0:17236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881692672 00000100:00100000:3.0:1787780175.798269:0:17236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881692672 00000100:00100000:3.0:1787780175.798330:0:17236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1787780175.798354:0:17236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0478636c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+22:17239:x1874622881692672:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787780175.798532:0:17236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0478636c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+22:17239:x1874622881692672:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 191us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780175.798541:0:17236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1787780175.798639:0:17239:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047785e1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17239:1874622881692672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787780175.798683:0:17239:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047785e1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17239:1874622881692800:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787780175.798738:0:17239:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787780175.798768:0:17239:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c047116ed80 going to sleep for 11 seconds 00000100:00100000:1.0:1787780175.798789:0:17237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881692800 00000100:00100000:1.0:1787780175.798796:0:17237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881692800 00000100:00100000:1.0:1787780175.798836:0:17237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1787780175.798882:0:17237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0478637c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+22:17239:x1874622881692800:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787780175.798985:0:17237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0478637c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+22:17239:x1874622881692800:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 114us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780175.798993:0:17237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1787780175.799014:0:17239:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047785e1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17239:1874622881692800:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787780175.801427:0:20297:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1787780175.802367:0:17239:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1787780175.802406:0:17239:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787780175.802423:0:17239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c0348c7a800/0xc8fc0a5179961d14 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a5179961d1b expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780175.802439:0:17239:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff9c0348c7a800/0xc8fc0a5179961d14 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a5179961d1b expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787780175.802464:0:17239:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787780175.802468:0:17239:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c0477821800 from 13 10000000:01000000:1.0:1787780175.802471:0:17239:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787780175.802525:0:17239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c0347e4ac00/0xc8fc0a5179961d22 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780175.802553:0:17239:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff9c0347e4ac00/0xc8fc0a5179961d22 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780175.802566:0:17239:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff9c0347e4ac00/0xc8fc0a5179961d22 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787780175.802614:0:17239:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04816203c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17239:1874622881692928:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787780175.802828:0:17239:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780175.802962:0:17239:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0445fd3600 going to sleep for 11 seconds 00000100:00100000:3.0:1787780175.805123:0:17236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881692928 00000100:00100000:3.0:1787780175.805141:0:17236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881692928 00000100:00100000:3.0:1787780175.805211:0:17236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1787780175.805222:0:17236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0478636850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+22:17239:x1874622881692928:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787780175.805243:0:17236:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787780175.805266:0:17236:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0440031000/0xc8fc0a5179961d29 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc8fc0a5179961d22 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780175.805303:0:17236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0440031000/0xc8fc0a5179961d29 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc8fc0a5179961d22 expref: 23 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780175.805316:0:17236:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0440031000/0xc8fc0a5179961d29 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a5179961d22 expref: 23 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780175.805327:0:17236:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0440031000, rc 0) 00000100:00100000:3.0:1787780175.805414:0:17236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0478636850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+23:17239:x1874622881692928:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 194us (2587us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780175.805421:0:17236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1787780175.805498:0:17239:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04816203c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17239:1874622881692928:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787780175.805541:0:17239:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff9c0347e4ac00/0xc8fc0a5179961d22 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a5179961d29 expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780175.805553:0:17239:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff9c0347e4ac00/0xc8fc0a5179961d22 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc8fc0a5179961d29 expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787780175.805647:0:17239:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347ee2940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17239:1874622881693056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787780175.805682:0:17239:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780175.805710:0:17237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881693056 00000100:00100000:3.0:1787780175.805714:0:17237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881693056 00000100:00100000:3.0:1787780175.805739:0:17237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1787780175.805747:0:17237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0478637450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+23:17239:x1874622881693056:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787780175.807582:0:17237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0478637450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+23:17239:x1874622881693056:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1825us (1889us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780175.807600:0:17237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1787780175.808337:0:17239:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c046ef9c300 going to sleep for 11 seconds 00000100:00100000:3.0:1787780175.808369:0:17239:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347ee2940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17239:1874622881693056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787780175.808434:0:17239:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347ee2940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17239:1874622881693184:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787780175.808511:0:17239:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780175.808545:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881693184 00000100:00100000:3.0:1787780175.808551:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881693184 00000100:00100000:3.0:1787780175.808593:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1787780175.808602:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0478634850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+23:17239:x1874622881693184:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787780175.808712:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0478634850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+23:17239:x1874622881693184:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 110us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780175.808730:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1787780175.808774:0:17239:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c046ef9c300 going to sleep for 11 seconds 00000100:00100000:3.0:1787780175.808787:0:17239:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347ee2940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17239:1874622881693184:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787780175.812720:0:20299:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1787780175.821007:0:17239:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1787780175.821065:0:17239:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787780175.821080:0:17239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c0347e4ac00/0xc8fc0a5179961d22 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a5179961d29 expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780175.821095:0:17239:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff9c0347e4ac00/0xc8fc0a5179961d22 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a5179961d29 expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787780175.821111:0:17239:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787780175.821114:0:17239:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c0447266000 from 13 10000000:01000000:3.0:1787780175.821117:0:17239:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787780175.821174:0:17239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c0440030e00/0xc8fc0a5179961d30 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780175.821182:0:17239:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff9c0440030e00/0xc8fc0a5179961d30 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780175.821194:0:17239:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff9c0440030e00/0xc8fc0a5179961d30 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787780175.821225:0:17239:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347ee2940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17239:1874622881693312:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787780175.821320:0:17239:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780175.821937:0:17239:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0450ccd000 going to sleep for 11 seconds 00000100:00100000:0.0:1787780175.824525:0:17236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881693312 00000100:00100000:0.0:1787780175.824547:0:17236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881693312 00000100:00100000:0.0:1787780175.824670:0:17236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1787780175.824682:0:17236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0478637050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+23:17239:x1874622881693312:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787780175.824706:0:17236:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787780175.824730:0:17236:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0348c7b000/0xc8fc0a5179961d37 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc8fc0a5179961d30 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780175.824767:0:17236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0348c7b000/0xc8fc0a5179961d37 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc8fc0a5179961d30 expref: 24 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780175.824781:0:17236:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0348c7b000/0xc8fc0a5179961d37 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc8fc0a5179961d30 expref: 24 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780175.824793:0:17236:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0348c7b000, rc 0) 00000100:00100000:0.0:1787780175.824929:0:17236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0478637050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+24:17239:x1874622881693312:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 249us (3609us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780175.824937:0:17236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1787780175.827035:0:17239:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347ee2940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17239:1874622881693312:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787780175.827079:0:17239:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff9c0440030e00/0xc8fc0a5179961d30 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a5179961d37 expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780175.827095:0:17239:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff9c0440030e00/0xc8fc0a5179961d30 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc8fc0a5179961d37 expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787780175.827222:0:17239:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0481620f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17239:1874622881693440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787780175.827299:0:17239:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780175.835918:0:17239:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0445fd30c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787780175.837922:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881693440 00000100:00100000:3.0:1787780175.837942:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881693440 00000100:00100000:3.0:1787780175.838022:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1787780175.838043:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0478635050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+24:17239:x1874622881693440:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787780175.838284:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0478635050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+24:17239:x1874622881693440:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 243us (10985us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780175.838294:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1787780175.838320:0:17239:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0481620f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17239:1874622881693440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787780175.838385:0:17239:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0481620f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17239:1874622881693568:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787780175.838441:0:17239:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780175.838489:0:17239:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0445fd30c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787780175.838925:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881693568 00000100:00100000:3.0:1787780175.838932:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881693568 00000100:00100000:3.0:1787780175.838972:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1787780175.838980:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0478635850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+24:17239:x1874622881693568:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787780175.839095:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0478635850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+24:17239:x1874622881693568:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 115us (653us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780175.839102:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1787780175.839689:0:17239:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0481620f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:17239:1874622881693568:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787780175.841396:0:20302:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1787780175.841764:0:17239:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1787780175.841802:0:17239:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787780175.841817:0:17239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9c0440030e00/0xc8fc0a5179961d30 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a5179961d37 expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780175.841830:0:17239:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff9c0440030e00/0xc8fc0a5179961d30 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc8fc0a5179961d37 expref: -99 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780176.221321:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787780176.341354:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787780176.341403:0:17237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863768704 00000100:00100000:1.0:1787780176.341416:0:17237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863768704 00000100:00100000:1.0:1787780176.341490:0:17237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 159 00000100:00100000:1.0:1787780176.341501:0:17237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0478636450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6cfa51b-ab50-4fc0-ae19-b724d7d272e4+11:14967:x1874622863768704:12345-192.168.203.31@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787780176.341522:0:17237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787780176.341546:0:17237:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0347e4ba00/0xc8fc0a5179961d3e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf757128131ea2276 expref: -99 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780176.341584:0:17237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0347e4ba00/0xc8fc0a5179961d3e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea2276 expref: 12 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780176.341598:0:17237:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0347e4ba00/0xc8fc0a5179961d3e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea2276 expref: 12 pid: 17237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780176.341611:0:17237:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0347e4ba00, rc 0) 00000100:00100000:1.0:1787780176.341883:0:17237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0478636450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6cfa51b-ab50-4fc0-ae19-b724d7d272e4+12:14967:x1874622863768704:12345-192.168.203.31@tcp:101:ll_cfg_requeue.0 Request processed in 382us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780176.341891:0:17237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 159 00000100:00100000:3.0:1787780176.362582:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787780176.365890:0:17236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863768832 00000100:00100000:0.0:1787780176.365913:0:17236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863768832 00000100:00100000:0.0:1787780176.365995:0:17236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 160 00000100:00100000:0.0:1787780176.366008:0:17236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0478634050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6cfa51b-ab50-4fc0-ae19-b724d7d272e4+12:14967:x1874622863768832:12345-192.168.203.31@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787780176.366220:0:17236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0478634050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6cfa51b-ab50-4fc0-ae19-b724d7d272e4+12:14967:x1874622863768832:12345-192.168.203.31@tcp:501:ll_cfg_requeue.0 Request processed in 213us (3647us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780176.366229:0:17236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 160 00000100:00100000:1.0:1787780176.371595:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787780176.372993:0:17237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863768960 00000100:00100000:3.0:1787780176.373012:0:17237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863768960 00000100:00100000:3.0:1787780176.373099:0:17237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 161 00000100:00100000:3.0:1787780176.373120:0:17237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0478635c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6cfa51b-ab50-4fc0-ae19-b724d7d272e4+12:14967:x1874622863768960:12345-192.168.203.31@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787780176.373319:0:17237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0478635c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6cfa51b-ab50-4fc0-ae19-b724d7d272e4+12:14967:x1874622863768960:12345-192.168.203.31@tcp:503:ll_cfg_requeue.0 Request processed in 209us (1737us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780176.373329:0:17237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 161 00000100:00100000:1.0:1787780176.382934:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787780176.383170:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863769088 00000100:00100000:3.0:1787780176.383182:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863769088 00000100:00100000:3.0:1787780176.383252:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 162 00000100:00100000:3.0:1787780176.383263:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0478634c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6cfa51b-ab50-4fc0-ae19-b724d7d272e4+12:14967:x1874622863769088:12345-192.168.203.31@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787780176.383286:0:17234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787780176.383316:0:17234:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0440031a00/0xc8fc0a5179961d45 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xf757128131ea227d expref: -99 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780176.383352:0:17234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0440031a00/0xc8fc0a5179961d45 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea227d expref: 13 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780176.383366:0:17234:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0440031a00/0xc8fc0a5179961d45 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea227d expref: 13 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780176.383378:0:17234:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0440031a00, rc 0) 00000100:00100000:3.0:1787780176.383443:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0478634c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6cfa51b-ab50-4fc0-ae19-b724d7d272e4+13:14967:x1874622863769088:12345-192.168.203.31@tcp:101:ll_cfg_requeue.0 Request processed in 181us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780176.383464:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 162 00000100:00100000:3.0:1787780176.390889:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787780176.390937:0:17236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863769216 00000100:00100000:1.0:1787780176.390969:0:17236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863769216 00000100:00100000:1.0:1787780176.391047:0:17236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 163 00000100:00100000:1.0:1787780176.391059:0:17236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0478635450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6cfa51b-ab50-4fc0-ae19-b724d7d272e4+13:14967:x1874622863769216:12345-192.168.203.31@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787780176.391259:0:17236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0478635450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6cfa51b-ab50-4fc0-ae19-b724d7d272e4+13:14967:x1874622863769216:12345-192.168.203.31@tcp:501:ll_cfg_requeue.0 Request processed in 201us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780176.391268:0:17236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 163 00000100:00100000:1.0:1787780176.396553:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787780176.396627:0:17237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863769344 00000100:00100000:3.0:1787780176.396641:0:17237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863769344 00000100:00100000:3.0:1787780176.396718:0:17237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 164 00000100:00100000:3.0:1787780176.396732:0:17237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0478634450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6cfa51b-ab50-4fc0-ae19-b724d7d272e4+13:14967:x1874622863769344:12345-192.168.203.31@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787780176.397315:0:17237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0478634450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6cfa51b-ab50-4fc0-ae19-b724d7d272e4+13:14967:x1874622863769344:12345-192.168.203.31@tcp:503:ll_cfg_requeue.0 Request processed in 584us (770us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780176.397327:0:17237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 164 00000100:00100000:1.0:1787780176.672646:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04618ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881693696:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787780176.672761:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780176.672910:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787780176.672917:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0481622580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881693824:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787780176.672943:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780176.672999:0:17247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881693696 00000100:00100000:3.0:1787780176.673010:0:17247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881693696 00000100:00100000:3.0:1787780176.673075:0:17247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881693824 00000100:00100000:3.0:1787780176.673079:0:17247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881693824 00000100:00100000:1.0:1787780176.673151:0:17248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787780176.673265:0:17248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0481620780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881693696:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787780176.673312:0:17248:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787780176.673368:0:17248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0481620780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881693696:12345-0@lo:41:osp-pre-1-0.0 Request processed in 207us (607us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780176.673376:0:17248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787780176.673429:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04618ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881693696:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787780176.674990:0:17247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787780176.675007:0:17247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0481621a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881693824:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787780176.675048:0:17247:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1787780176.675279:0:17247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0481621a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1874622881693824:12345-0@lo:41:osp-pre-0-1.0 Request processed in 277us (2334us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780176.675288:0:17247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787780176.675399:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0481622580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874622881693824:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787780176.797173:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787780176.797230:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787780176.797310:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787780176.797336:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787780176.797403:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863769472 00000100:00100000:1.0:1787780176.797416:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863769472 00000100:00100000:1.0:1787780176.797492:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 165 00000100:00100000:1.0:1787780176.797504:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0478636050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6cfa51b-ab50-4fc0-ae19-b724d7d272e4+13:2409:x1874622863769472:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1787780176.797597:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0478636050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6cfa51b-ab50-4fc0-ae19-b724d7d272e4+13:2409:x1874622863769472:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 95us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780176.797626:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 165 00000100:00100000:0.0:1787780176.805602:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787780176.805639:0:19055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863769984 00000100:00100000:0.0:1787780176.805651:0:19055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863769984 00000100:00100000:0.0:1787780176.805737:0:19055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863770496 00000100:00100000:0.0:1787780176.805741:0:19055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863770496 00000100:00100000:0.0:1787780176.805769:0:19055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 20 00000100:00100000:0.0:1787780176.805968:0:19055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04618e8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e302a01-7f05-4001-b9ff-8e623671b6e0+5:2409:x1874622863769984:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1787780176.806061:0:19055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04618e8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e302a01-7f05-4001-b9ff-8e623671b6e0+5:2409:x1874622863769984:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 100us (8750us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780176.806070:0:19055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 20 00000100:00100000:0.0:1787780176.806092:0:19055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 21 00000100:00100000:0.0:1787780176.806099:0:19055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04618eb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eeb4a73f-1001-4fdb-898b-e22b5d3f1459+5:2409:x1874622863770496:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1787780176.806126:0:19055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04618eb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eeb4a73f-1001-4fdb-898b-e22b5d3f1459+5:2409:x1874622863770496:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 28us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780176.806132:0:19055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 21 00000100:00080000:0.0:1787780176.806157:0:17238:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787780176.806199:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787780176.806301:0:17242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863769728 00000100:00100000:2.0:1787780176.806307:0:17242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863769728 00000100:00100000:2.0:1787780176.806351:0:17242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863770240 00000100:00100000:2.0:1787780176.806354:0:17242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863770240 00000100:00100000:2.0:1787780176.806377:0:17242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 54 00000100:00100000:2.0:1787780176.806384:0:17242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04618ead00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e302a01-7f05-4001-b9ff-8e623671b6e0+5:2409:x1874622863769728:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1787780176.806416:0:17242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04618ead00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e302a01-7f05-4001-b9ff-8e623671b6e0+5:2409:x1874622863769728:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 34us (9187us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780176.806423:0:17242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 54 00000100:00100000:2.0:1787780176.806438:0:17242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 55 00000100:00100000:2.0:1787780176.806456:0:17242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04618ebc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eeb4a73f-1001-4fdb-898b-e22b5d3f1459+5:2409:x1874622863770240:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1787780176.806482:0:17242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04618ebc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eeb4a73f-1001-4fdb-898b-e22b5d3f1459+5:2409:x1874622863770240:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 38us (9144us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780176.806488:0:17242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 55 00000100:00080000:2.0:1787780176.806503:0:17238:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787780176.813326:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787780176.813370:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787780176.813413:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787780176.814907:0:20085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863769600 00000100:00100000:1.0:1787780176.814926:0:20085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863769600 00000100:00100000:1.0:1787780176.815012:0:20085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863770112 00000100:00100000:1.0:1787780176.815015:0:20085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863770112 00000100:00100000:1.0:1787780176.815049:0:20085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 56 00000100:00100000:1.0:1787780176.815062:0:20085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04618ea580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e302a01-7f05-4001-b9ff-8e623671b6e0+6:2409:x1874622863769600:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1787780176.815163:0:20085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04618ea580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e302a01-7f05-4001-b9ff-8e623671b6e0+6:2409:x1874622863769600:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 104us (8963us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780176.815172:0:20085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 56 00000100:00100000:1.0:1787780176.815195:0:20085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 57 00000100:00100000:1.0:1787780176.815202:0:20085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346cfcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eeb4a73f-1001-4fdb-898b-e22b5d3f1459+6:2409:x1874622863770112:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1787780176.815228:0:20085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346cfcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eeb4a73f-1001-4fdb-898b-e22b5d3f1459+6:2409:x1874622863770112:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 27us (1858us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780176.815235:0:20085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 57 00000100:00080000:1.0:1787780176.815255:0:17238:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787780176.815660:0:19055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863769856 00000100:00100000:0.0:1787780176.815667:0:19055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863769856 00000100:00100000:0.0:1787780176.815728:0:19055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863770368 00000100:00100000:0.0:1787780176.815752:0:19055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863770368 00000100:00100000:0.0:1787780176.815782:0:19055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 22 00000100:00100000:0.0:1787780176.815791:0:19055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346cff840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e302a01-7f05-4001-b9ff-8e623671b6e0+5:2409:x1874622863769856:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1787780176.816001:0:19055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346cff840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e302a01-7f05-4001-b9ff-8e623671b6e0+5:2409:x1874622863769856:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 211us (2690us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780176.816010:0:19055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 22 00000100:00100000:0.0:1787780176.816029:0:19055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 23 00000100:00100000:0.0:1787780176.816036:0:19055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03489f5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eeb4a73f-1001-4fdb-898b-e22b5d3f1459+5:2409:x1874622863770368:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1787780176.816062:0:19055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03489f5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eeb4a73f-1001-4fdb-898b-e22b5d3f1459+5:2409:x1874622863770368:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 27us (2649us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780176.816069:0:19055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 23 00000100:00080000:1.0:1787780176.821056:0:17238:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787780177.248040:0:18397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787780177.628603:0:17994:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787780178.273343:0:17231:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787780178.569232:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787780178.569643:0:20085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863770624 00000100:00100000:1.0:1787780178.569657:0:20085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863770624 00000100:00100000:1.0:1787780178.569768:0:20085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 23 00000100:00100000:1.0:1787780178.569782:0:20085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03489f70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e302a01-7f05-4001-b9ff-8e623671b6e0+6:15639:x1874622863770624:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787780178.569809:0:20085:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787780178.569895:0:20085:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a200/0xc8fc0a5179961d4c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea2284 expref: -99 pid: 20085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780178.570009:0:20085:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868e00/0xc8fc0a5179961d53 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780178.570028:0:20085:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868e00/0xc8fc0a5179961d53 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780178.570044:0:20085:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868e00/0xc8fc0a5179961d53 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780178.570062:0:20085:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869c00/0xc8fc0a5179961d5a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780178.570070:0:20085:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869c00/0xc8fc0a5179961d5a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780178.570077:0:20085:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869c00/0xc8fc0a5179961d5a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780178.570183:0:20085:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868400/0xc8fc0a5179961d61 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780178.570191:0:20085:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868400/0xc8fc0a5179961d61 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780178.570198:0:20085:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868400/0xc8fc0a5179961d61 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20085 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787780178.570232:0:20085:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787780178.570236:0:20085:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787780178.570280:0:20085:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868400/0xc8fc0a5179961d61 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780178.570316:0:20085:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868e00/0xc8fc0a5179961d53 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780178.570324:0:20085:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868e00/0xc8fc0a5179961d53 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 20085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780178.570331:0:20085:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868e00/0xc8fc0a5179961d53 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780178.570337:0:20085:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0477868e00 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:1.0:1787780178.570341:0:20085:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868e00/0xc8fc0a5179961d53 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780178.570349:0:20085:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868e00/0xc8fc0a5179961d53 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 20085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780178.570363:0:20085:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c0347a4e300) 00010000:00010000:1.0:1787780178.570367:0:20085:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787780178.570372:0:20085:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868e00/0xc8fc0a5179961d53 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780178.570379:0:20085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868e00/0xc8fc0a5179961d53 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780178.570395:0:20085:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869c00/0xc8fc0a5179961d5a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780178.570402:0:20085:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869c00/0xc8fc0a5179961d5a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780178.570408:0:20085:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869c00/0xc8fc0a5179961d5a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780178.570420:0:20085:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0477869c00 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:1.0:1787780178.570424:0:20085:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869c00/0xc8fc0a5179961d5a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780178.570430:0:20085:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869c00/0xc8fc0a5179961d5a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780178.570448:0:20085:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9c0341cd4500) 00010000:00010000:1.0:1787780178.570451:0:20085:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787780178.570453:0:20085:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869c00/0xc8fc0a5179961d5a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780178.570460:0:20085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869c00/0xc8fc0a5179961d5a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780178.570497:0:20085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0347e4a200/0xc8fc0a5179961d4c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea2284 expref: 8 pid: 20085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780178.570514:0:20085:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868400/0xc8fc0a5179961d61 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea2284 expref: 7 pid: 20085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780178.570522:0:20085:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9c0341cd4700) 00010000:00010000:1.0:1787780178.570524:0:20085:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787780178.570527:0:20085:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0477868400, rc 0) 00000100:00100000:1.0:1787780178.570603:0:20085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03489f70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e302a01-7f05-4001-b9ff-8e623671b6e0+7:15639:x1874622863770624:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 826us (1387us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780178.570612:0:20085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 23 00000100:00080000:2.0:1787780178.573353:0:17238:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787780178.580634:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787780178.580769:0:17254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863770752 00000100:00100000:3.0:1787780178.580783:0:17254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863770752 00000100:00100000:3.0:1787780178.580915:0:17254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 5 00000100:00100000:3.0:1787780178.580928:0:17254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03489f5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:6e302a01-7f05-4001-b9ff-8e623671b6e0+7:15639:x1874622863770752:12345-192.168.203.31@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1787780178.581051:0:17254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03489f5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:6e302a01-7f05-4001-b9ff-8e623671b6e0+7:15639:x1874622863770752:12345-192.168.203.31@tcp:900:lhsmtool_posix.0 Request processed in 125us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780178.581060:0:17254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 5 00000100:00100000:0.0:1787780178.584122:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787780178.586335:0:17243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863771008 00000100:00100000:1.0:1787780178.586462:0:17243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863771008 00000100:00100000:1.0:1787780178.586564:0:17243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 24 00000100:00100000:1.0:1787780178.586577:0:17243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03489f4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e302a01-7f05-4001-b9ff-8e623671b6e0+7:15639:x1874622863771008:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787780178.586674:0:17243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787780178.586707:0:17243:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869c00/0xc8fc0a5179961d68 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea228b expref: -99 pid: 17243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780178.586936:0:17243:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868e00/0xc8fc0a5179961d6f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780178.587024:0:17243:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868e00/0xc8fc0a5179961d6f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780178.587040:0:17243:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868e00/0xc8fc0a5179961d6f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780178.587061:0:17243:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869000/0xc8fc0a5179961d76 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780178.587068:0:17243:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869000/0xc8fc0a5179961d76 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780178.587075:0:17243:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869000/0xc8fc0a5179961d76 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780178.587305:0:17243:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869600/0xc8fc0a5179961d7d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780178.587315:0:17243:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869600/0xc8fc0a5179961d7d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780178.587322:0:17243:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869600/0xc8fc0a5179961d7d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17243 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787780178.587342:0:17243:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:1.0:1787780178.587628:0:17243:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868e00/0xc8fc0a5179961d6f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780178.587637:0:17243:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868e00/0xc8fc0a5179961d6f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780178.587645:0:17243:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868e00/0xc8fc0a5179961d6f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780178.587652:0:17243:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0477868e00 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:1.0:1787780178.587658:0:17243:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868e00/0xc8fc0a5179961d6f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780178.587666:0:17243:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868e00/0xc8fc0a5179961d6f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780178.587682:0:17243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9c0341cd4700) 00010000:00010000:1.0:1787780178.587686:0:17243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787780178.587692:0:17243:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868e00/0xc8fc0a5179961d6f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780178.587699:0:17243:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868e00/0xc8fc0a5179961d6f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780178.587716:0:17243:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869000/0xc8fc0a5179961d76 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780178.587723:0:17243:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869000/0xc8fc0a5179961d76 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780178.587898:0:17243:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869000/0xc8fc0a5179961d76 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780178.587905:0:17243:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0477869000 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:1.0:1787780178.587908:0:17243:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869000/0xc8fc0a5179961d76 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780178.587915:0:17243:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869000/0xc8fc0a5179961d76 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780178.587924:0:17243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9c0341cd4500) 00010000:00010000:1.0:1787780178.587927:0:17243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787780178.587930:0:17243:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869000/0xc8fc0a5179961d76 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780178.587936:0:17243:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869000/0xc8fc0a5179961d76 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780178.591694:0:17243:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869c00/0xc8fc0a5179961d68 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea228b expref: 10 pid: 17243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780178.591732:0:17243:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869600/0xc8fc0a5179961d7d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea228b expref: 9 pid: 17243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780178.591744:0:17243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c0341cd4e00) 00010000:00010000:1.0:1787780178.591747:0:17243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787780178.591752:0:17243:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0477869600, rc 0) 00000100:00100000:1.0:1787780178.591881:0:17243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03489f4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e302a01-7f05-4001-b9ff-8e623671b6e0+9:15639:x1874622863771008:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 5305us (7772us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1787780178.591914:0:17243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 24 00000100:00100000:0.0:1787780178.598922:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787780178.599393:0:19793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863771136 00000100:00100000:3.0:1787780178.599407:0:19793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863771136 00000100:00100000:3.0:1787780178.599496:0:19793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 25 00000100:00100000:3.0:1787780178.599508:0:19793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03489f7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e302a01-7f05-4001-b9ff-8e623671b6e0+9:15639:x1874622863771136:12345-192.168.203.31@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1787780178.599658:0:19793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03489f7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e302a01-7f05-4001-b9ff-8e623671b6e0+9:15639:x1874622863771136:12345-192.168.203.31@tcp:59:lhsmtool_posix.0 Request processed in 152us (753us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780178.599667:0:19793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 25 00000100:00100000:0.0:1787780178.617654:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787780178.617772:0:20085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863771264 00000100:00100000:1.0:1787780178.617794:0:20085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863771264 00000100:00100000:1.0:1787780178.617976:0:20085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 26 00000100:00100000:1.0:1787780178.617988:0:20085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03489f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e302a01-7f05-4001-b9ff-8e623671b6e0+5:15639:x1874622863771264:12345-192.168.203.31@tcp:59:lhsmtool_posix.0 00000100:00080000:2.0:1787780178.623602:0:17238:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:3.0:1787780178.624247:0:20085:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 6198us 00000100:00100000:0.0:1787780178.635529:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787780178.637380:0:17243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863771392 00000100:00100000:1.0:1787780178.637400:0:17243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863771392 00000100:00100000:1.0:1787780178.637486:0:17243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 27 00000100:00100000:1.0:1787780178.637497:0:17243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03489f6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e302a01-7f05-4001-b9ff-8e623671b6e0+9:15645:x1874622863771392:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:1.0:1787780178.637524:0:17243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787780178.637550:0:17243:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869c00/0xc8fc0a5179961d8b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea2292 expref: -99 pid: 17243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780178.637635:0:17243:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869000/0xc8fc0a5179961d92 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780178.637654:0:17243:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869000/0xc8fc0a5179961d92 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780178.637668:0:17243:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869000/0xc8fc0a5179961d92 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780178.639892:0:17243:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868e00/0xc8fc0a5179961d99 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780178.639917:0:17243:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868e00/0xc8fc0a5179961d99 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780178.639930:0:17243:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868e00/0xc8fc0a5179961d99 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780178.640003:0:17243:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869000/0xc8fc0a5179961d92 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780178.640011:0:17243:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869000/0xc8fc0a5179961d92 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780178.640018:0:17243:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869000/0xc8fc0a5179961d92 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780178.640025:0:17243:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0477869000 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:1.0:1787780178.640029:0:17243:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869000/0xc8fc0a5179961d92 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780178.640036:0:17243:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869000/0xc8fc0a5179961d92 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780178.640050:0:17243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c0347a4e300) 00010000:00010000:1.0:1787780178.640053:0:17243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787780178.640057:0:17243:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869000/0xc8fc0a5179961d92 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780178.640064:0:17243:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869000/0xc8fc0a5179961d92 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780178.640079:0:17243:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868e00/0xc8fc0a5179961d99 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780178.640085:0:17243:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868e00/0xc8fc0a5179961d99 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780178.640091:0:17243:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868e00/0xc8fc0a5179961d99 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780178.640104:0:17243:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0477868e00 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:1.0:1787780178.640109:0:17243:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868e00/0xc8fc0a5179961d99 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780178.640116:0:17243:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868e00/0xc8fc0a5179961d99 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780178.640127:0:17243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9c0341cd4500) 00010000:00010000:1.0:1787780178.640130:0:17243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787780178.640133:0:17243:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868e00/0xc8fc0a5179961d99 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780178.640140:0:17243:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868e00/0xc8fc0a5179961d99 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780178.640212:0:17243:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869c00/0xc8fc0a5179961d8b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea2292 expref: 10 pid: 17243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780178.640223:0:17243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c0347a4e300) 00010000:00010000:1.0:1787780178.640225:0:17243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787780178.640230:0:17243:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869c00/0xc8fc0a5179961d8b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea2292 expref: 10 pid: 17243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780178.640243:0:17243:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0477869c00, rc 0) 00000100:00100000:1.0:1787780178.640329:0:17243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03489f6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e302a01-7f05-4001-b9ff-8e623671b6e0+9:15645:x1874622863771392:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 2832us (4978us total) trans 0 rc 301/301 00000100:00100000:1.0:1787780178.640341:0:17243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 27 00000100:00100000:2.0:1787780178.644729:0:20085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03489f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e302a01-7f05-4001-b9ff-8e623671b6e0+5:15639:x1874622863771264:12345-192.168.203.31@tcp:59:lhsmtool_posix.0 Request processed in 26730us (27078us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780178.644749:0:20085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 26 00000100:00100000:0.0:1787780178.647316:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787780178.647497:0:17251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863771520 00000100:00100000:3.0:1787780178.647511:0:17251:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863771520 00000100:00100000:3.0:1787780178.647578:0:17251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 0 00000100:00100000:3.0:1787780178.647590:0:17251:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0461beed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:6e302a01-7f05-4001-b9ff-8e623671b6e0+9:15645:x1874622863771520:12345-192.168.203.31@tcp:700:lfs.0 00000100:00100000:3.0:1787780178.647713:0:17251:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0461beed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:6e302a01-7f05-4001-b9ff-8e623671b6e0+9:15645:x1874622863771520:12345-192.168.203.31@tcp:700:lfs.0 Request processed in 124us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780178.647722:0:17251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 0 00000040:00080000:0.0:1787780178.653600:0:17994:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787780178.657776:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787780178.657902:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863771776 00000100:00100000:1.0:1787780178.657937:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863771776 00000100:00100000:0.0:1787780178.658218:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 28 00000100:00100000:0.0:1787780178.658232:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0461bec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e302a01-7f05-4001-b9ff-8e623671b6e0+9:15645:x1874622863771776:12345-192.168.203.31@tcp:36:lfs.0 00010000:00010000:0.0:1787780178.658293:0:17244:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787780178.658322:0:17244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70800/0xc8fc0a5179961cb9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea21ff expref: 9 pid: 19793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780178.658358:0:17244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c0347a4e300) 00010000:00010000:0.0:1787780178.658365:0:17244:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787780178.658424:0:17244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0348c7bc00/0xc8fc0a5179961da0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780178.658450:0:17244:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0440030400/0xc8fc0a5179961cf8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea226f expref: 5 pid: 17242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780178.658459:0:17244:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0348c7bc00/0xc8fc0a5179961da0 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780178.658493:0:17244:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c0440030400/0xc8fc0a5179961cf8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea226f expref: 5 pid: 17242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780178.658521:0:17244:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0440030400/0xc8fc0a5179961cf8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea226f expref: 5 pid: 17242 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787780178.658533:0:17244:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0461bed2c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17244:1874622881693952:192.168.203.31@tcp:104: 00000100:00100000:0.0:1787780178.658625:0:17244:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c034798c6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787780178.662630:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787780178.662672:0:17244:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0461bed2c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17244:1874622881693952:192.168.203.31@tcp:104: 00010000:00010000:0.0:1787780178.662705:0:17244:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c0348c7bc00/0xc8fc0a5179961da0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17244 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787780178.663156:0:17228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863771904 00000100:00100000:3.0:1787780178.663169:0:17228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863771904 00010000:00010000:3.0:1787780178.663243:0:17228:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0440030400/0xc8fc0a5179961cf8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea226f expref: 6 pid: 17242 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787780178.663297:0:17228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 15 00000100:00100000:3.0:1787780178.663308:0:17228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c047785e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eeb4a73f-1001-4fdb-898b-e22b5d3f1459+6:2410:x1874622863771904:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787780178.663327:0:17228:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787780178.663334:0:17228:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c0440030400/0xc8fc0a5179961cf8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea226f expref: 6 pid: 17242 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780178.663349:0:17228:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c0440030400/0xc8fc0a5179961cf8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea226f expref: 6 pid: 17242 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780178.663389:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0440030400/0xc8fc0a5179961cf8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea226f expref: 6 pid: 17242 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780178.663409:0:17228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c0347a4e300) 00010000:00010000:3.0:1787780178.663416:0:17228:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0348c7bc00/0xc8fc0a5179961da0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780178.663427:0:17228:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0348c7bc00/0xc8fc0a5179961da0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780178.663445:0:17228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0348c7bc00/0xc8fc0a5179961da0 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780178.663482:0:17228:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787780178.663556:0:17228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c047785e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eeb4a73f-1001-4fdb-898b-e22b5d3f1459+5:2410:x1874622863771904:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 248us (943us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780178.663584:0:17228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 15 00010000:00010000:1.0:1787780178.664216:0:17244:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c0348c7bc00/0xc8fc0a5179961da0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780178.664232:0:17244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0348c7bc00/0xc8fc0a5179961da0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780178.664265:0:17244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869c00/0xc8fc0a5179961da7 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780178.664278:0:17244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869c00/0xc8fc0a5179961da7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780178.664288:0:17244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869c00/0xc8fc0a5179961da7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17244 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787780178.664502:0:17238:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787780178.666415:0:17244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71200/0xc8fc0a5179961dae lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780178.666448:0:17244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71200/0xc8fc0a5179961dae lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780178.666461:0:17244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71200/0xc8fc0a5179961dae lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17244 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787780178.666497:0:17244:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d7a1e075 reply state 00000000cf07fed3 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71200/0xc8fc0a5179961dae lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780178.666509:0:17244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71200/0xc8fc0a5179961dae lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780178.666516:0:17244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c0347a4ef00) 00010000:00010000:2.0:1787780178.666519:0:17244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787780178.666523:0:17244:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1787780178.666529:0:17244:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1787780178.666538:0:17244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0348c7bc00/0xc8fc0a5179961da0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780178.666545:0:17244:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0348c7bc00/0xc8fc0a5179961da0 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780178.666552:0:17244:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0348c7bc00/0xc8fc0a5179961da0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780178.666753:0:17244:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0348c7bc00 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:2.0:1787780178.666758:0:17244:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0348c7bc00/0xc8fc0a5179961da0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780178.666766:0:17244:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0348c7bc00/0xc8fc0a5179961da0 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780178.666910:0:17244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c0347a4e300) 00010000:00010000:2.0:1787780178.666913:0:17244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787780178.666918:0:17244:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0348c7bc00/0xc8fc0a5179961da0 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780178.666924:0:17244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0348c7bc00/0xc8fc0a5179961da0 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17244 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787780178.666948:0:17244:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d7a1e075 reply state 00000000cf07fed3 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869c00/0xc8fc0a5179961da7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780178.666957:0:17244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869c00/0xc8fc0a5179961da7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780178.666964:0:17244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9c0341cd4500) 00010000:00010000:2.0:1787780178.666966:0:17244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787780178.666969:0:17244:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1787780178.667069:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0461bec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e302a01-7f05-4001-b9ff-8e623671b6e0+10:15645:x1874622863771776:12345-192.168.203.31@tcp:36:lfs.0 Request processed in 8838us (9304us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1787780178.667078:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 28 00000100:00100000:2.0:1787780178.759917:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787780178.760088:0:19793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863772032 00000100:00100000:3.0:1787780178.760109:0:19793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863772032 00000100:00100000:3.0:1787780178.760170:0:19793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 29 00000100:00100000:3.0:1787780178.760180:0:19793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c047785f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e302a01-7f05-4001-b9ff-8e623671b6e0+10:15653:x1874622863772032:12345-192.168.203.31@tcp:101:lctl.0 00010000:00010000:3.0:1787780178.760205:0:19793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787780178.760228:0:19793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0440030000/0xc8fc0a5179961db5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea2299 expref: -99 pid: 19793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780178.760293:0:19793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0440030200/0xc8fc0a5179961dbc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780178.760308:0:19793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0440030200/0xc8fc0a5179961dbc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780178.760320:0:19793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0440030200/0xc8fc0a5179961dbc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787780178.760366:0:19793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787780178.760371:0:19793:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787780178.760410:0:19793:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c0440030200/0xc8fc0a5179961dbc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780178.760446:0:19793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0440030000/0xc8fc0a5179961db5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea2299 expref: 12 pid: 19793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780178.760468:0:19793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0440030200/0xc8fc0a5179961dbc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea2299 expref: 11 pid: 19793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780178.760491:0:19793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c0443d81100) 00010000:00010000:3.0:1787780178.760494:0:19793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787780178.760498:0:19793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0440030200, rc 0) 00000100:00100000:3.0:1787780178.760567:0:19793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c047785f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e302a01-7f05-4001-b9ff-8e623671b6e0+11:15653:x1874622863772032:12345-192.168.203.31@tcp:101:lctl.0 Request processed in 378us (651us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780178.760575:0:19793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 29 00000100:00100000:3.0:1787780178.787141:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787780178.787281:0:20085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863772160 00000100:00100000:2.0:1787780178.787294:0:20085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863772160 00000100:00100000:2.0:1787780178.787384:0:20085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 30 00000100:00100000:2.0:1787780178.787396:0:20085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347ee3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eeb4a73f-1001-4fdb-898b-e22b5d3f1459+5:15654:x1874622863772160:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:2.0:1787780178.787422:0:20085:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787780178.787458:0:20085:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71800/0xc8fc0a5179961dc3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea22a0 expref: -99 pid: 20085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780178.787566:0:20085:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71a00/0xc8fc0a5179961dca lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780178.787583:0:20085:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71a00/0xc8fc0a5179961dca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780178.787598:0:20085:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71a00/0xc8fc0a5179961dca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20085 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787780178.787654:0:20085:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787780178.787658:0:20085:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787780178.787693:0:20085:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71a00/0xc8fc0a5179961dca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780178.787722:0:20085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71800/0xc8fc0a5179961dc3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea22a0 expref: 7 pid: 20085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780178.787745:0:20085:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71a00/0xc8fc0a5179961dca lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea22a0 expref: 6 pid: 20085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780178.787755:0:20085:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c0443d81100) 00010000:00010000:2.0:1787780178.787758:0:20085:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787780178.787763:0:20085:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0477a71a00, rc 0) 00000100:00100000:2.0:1787780178.788160:0:20085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347ee3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eeb4a73f-1001-4fdb-898b-e22b5d3f1459+6:15654:x1874622863772160:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 765us (1032us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780178.788169:0:20085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 30 00000100:00100000:0.0:1787780178.794651:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787780178.794788:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863772288 00000100:00100000:2.0:1787780178.794801:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863772288 00000100:00100000:2.0:1787780178.794938:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 31 00000100:00100000:2.0:1787780178.794952:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0461bed2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eeb4a73f-1001-4fdb-898b-e22b5d3f1459+6:15654:x1874622863772288:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:2.0:1787780178.794980:0:17244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787780178.795006:0:17244:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70a00/0xc8fc0a5179961dd1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea22a7 expref: -99 pid: 17244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780178.795088:0:17244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71400/0xc8fc0a5179961dd8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780178.795106:0:17244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71400/0xc8fc0a5179961dd8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780178.795120:0:17244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71400/0xc8fc0a5179961dd8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780178.795133:0:17244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71600/0xc8fc0a5179961ddf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780178.795140:0:17244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71600/0xc8fc0a5179961ddf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780178.795147:0:17244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71600/0xc8fc0a5179961ddf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780178.795250:0:17244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70800/0xc8fc0a5179961de6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780178.795259:0:17244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70800/0xc8fc0a5179961de6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780178.795267:0:17244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70800/0xc8fc0a5179961de6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17244 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787780178.795326:0:17244:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787780178.795330:0:17244:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787780178.795353:0:17244:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70800/0xc8fc0a5179961de6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780178.795368:0:17244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71400/0xc8fc0a5179961dd8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780178.795375:0:17244:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71400/0xc8fc0a5179961dd8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780178.795383:0:17244:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71400/0xc8fc0a5179961dd8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780178.795389:0:17244:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0477a71400 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:2.0:1787780178.795394:0:17244:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71400/0xc8fc0a5179961dd8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780178.795402:0:17244:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71400/0xc8fc0a5179961dd8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780178.795416:0:17244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c0443d81100) 00010000:00010000:2.0:1787780178.795419:0:17244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787780178.795424:0:17244:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71400/0xc8fc0a5179961dd8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780178.795441:0:17244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71400/0xc8fc0a5179961dd8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780178.795458:0:17244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71600/0xc8fc0a5179961ddf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780178.795474:0:17244:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71600/0xc8fc0a5179961ddf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780178.795480:0:17244:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71600/0xc8fc0a5179961ddf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780178.795485:0:17244:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0477a71600 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:2.0:1787780178.795489:0:17244:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71600/0xc8fc0a5179961ddf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780178.795496:0:17244:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71600/0xc8fc0a5179961ddf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780178.795505:0:17244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9c0341cd4500) 00010000:00010000:2.0:1787780178.795507:0:17244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787780178.795510:0:17244:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71600/0xc8fc0a5179961ddf lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780178.795515:0:17244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71600/0xc8fc0a5179961ddf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780178.795545:0:17244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70a00/0xc8fc0a5179961dd1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea22a7 expref: 8 pid: 17244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780178.795560:0:17244:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70800/0xc8fc0a5179961de6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea22a7 expref: 7 pid: 17244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780178.795567:0:17244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c0347a4ef00) 00010000:00010000:2.0:1787780178.795569:0:17244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787780178.795578:0:17244:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0477a70800, rc 0) 00000100:00100000:2.0:1787780178.795661:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0461bed2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eeb4a73f-1001-4fdb-898b-e22b5d3f1459+7:15654:x1874622863772288:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 712us (1024us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780178.795669:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 31 00000100:00100000:1.0:1787780178.802616:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787780178.803873:0:17254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863772416 00000100:00100000:3.0:1787780178.803890:0:17254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863772416 00000100:00100000:3.0:1787780178.804040:0:17254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 6 00000100:00100000:3.0:1787780178.804052:0:17254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0481623480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:eeb4a73f-1001-4fdb-898b-e22b5d3f1459+5:15654:x1874622863772416:12345-192.168.203.31@tcp:900:lfs.0 00000100:00100000:3.0:1787780178.807647:0:17254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0481623480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:eeb4a73f-1001-4fdb-898b-e22b5d3f1459+5:15654:x1874622863772416:12345-192.168.203.31@tcp:900:lfs.0 Request processed in 3578us (5027us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780178.807666:0:17254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 6 00000100:00080000:2.0:1787780178.808442:0:17238:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787780178.816053:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787780178.816658:0:19793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863772672 00000100:00100000:2.0:1787780178.816722:0:19793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863772672 00000100:00100000:2.0:1787780178.817004:0:19793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 32 00000100:00100000:2.0:1787780178.817016:0:19793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347ee30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eeb4a73f-1001-4fdb-898b-e22b5d3f1459+7:15654:x1874622863772672:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:2.0:1787780178.817043:0:19793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787780178.817069:0:19793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70a00/0xc8fc0a5179961ded lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea22ae expref: -99 pid: 19793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787780178.817196:0:19793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1787780178.817340:0:19793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70a00/0xc8fc0a5179961ded lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea22ae expref: 9 pid: 19793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780178.817357:0:19793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c0443d81100) 00010000:00010000:2.0:1787780178.817360:0:19793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787780178.817366:0:19793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70a00/0xc8fc0a5179961ded lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea22ae expref: 9 pid: 19793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780178.817382:0:19793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0477a70a00, rc 0) 00000100:00100000:2.0:1787780178.817473:0:19793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347ee30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eeb4a73f-1001-4fdb-898b-e22b5d3f1459+8:15654:x1874622863772672:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 459us (1435us total) trans 8589934595 rc 301/301 00000100:00100000:2.0:1787780178.817481:0:19793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 32 00000100:00100000:1.0:1787780178.820482:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787780178.820574:0:20085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863772928 00000100:00100000:3.0:1787780178.820586:0:20085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863772928 00000100:00100000:3.0:1787780178.820655:0:20085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 33 00000100:00100000:3.0:1787780178.820666:0:20085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0481623c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eeb4a73f-1001-4fdb-898b-e22b5d3f1459+8:15654:x1874622863772928:12345-192.168.203.31@tcp:36:lfs.0 00010000:00010000:3.0:1787780178.820743:0:20085:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787780178.820792:0:20085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70800/0xc8fc0a5179961de6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea22a7 expref: 8 pid: 17244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780178.820818:0:20085:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c0347a4ef00) 00010000:00010000:3.0:1787780178.820823:0:20085:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787780178.820917:0:20085:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0440030000/0xc8fc0a5179961dfb lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780178.820934:0:20085:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0440030000/0xc8fc0a5179961dfb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780178.820945:0:20085:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0440030000/0xc8fc0a5179961dfb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20085 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787780178.821245:0:20085:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000880c435c reply state 000000003fd22e4c transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0440030000/0xc8fc0a5179961dfb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780178.821529:0:20085:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0440030000/0xc8fc0a5179961dfb lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780178.821538:0:20085:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c0347a4ef00) 00010000:00010000:3.0:1787780178.821541:0:20085:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:3.0:1787780178.821544:0:20085:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1787780178.821555:0:20085:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1787780178.821664:0:20085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0481623c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eeb4a73f-1001-4fdb-898b-e22b5d3f1459+9:15654:x1874622863772928:12345-192.168.203.31@tcp:36:lfs.0 Request processed in 998us (1195us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1787780178.821672:0:20085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 33 00000100:00100000:1.0:1787780178.825036:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787780178.825179:0:17245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863773184 00000100:00100000:0.0:1787780178.825191:0:17245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863773184 00000100:00100000:0.0:1787780178.825266:0:17245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 2 00000100:00100000:0.0:1787780178.825293:0:17245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0481621e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:eeb4a73f-1001-4fdb-898b-e22b5d3f1459+9:15654:x1874622863773184:12345-192.168.203.31@tcp:35:lfs.0 00000100:00100000:0.0:1787780178.825597:0:17245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0481621e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:eeb4a73f-1001-4fdb-898b-e22b5d3f1459+10:15654:x1874622863773184:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 304us (573us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1787780178.825606:0:17245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 2 00000100:00100000:0.0:1787780178.830185:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787780178.832155:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863773440 00000100:00100000:2.0:1787780178.832173:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863773440 00000100:00100000:2.0:1787780178.832290:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 34 00000100:00100000:2.0:1787780178.832303:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0461bee940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eeb4a73f-1001-4fdb-898b-e22b5d3f1459+10:15654:x1874622863773440:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:2.0:1787780178.832339:0:17244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787780178.832366:0:17244:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71600/0xc8fc0a5179961e02 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea22b5 expref: -99 pid: 17244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780178.832468:0:17244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71400/0xc8fc0a5179961e09 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780178.832486:0:17244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71400/0xc8fc0a5179961e09 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780178.832500:0:17244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71400/0xc8fc0a5179961e09 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780178.832512:0:17244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71800/0xc8fc0a5179961e10 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780178.832519:0:17244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71800/0xc8fc0a5179961e10 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780178.832526:0:17244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71800/0xc8fc0a5179961e10 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17244 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787780178.832661:0:17244:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1787780178.832755:0:17244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71400/0xc8fc0a5179961e09 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780178.832764:0:17244:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71400/0xc8fc0a5179961e09 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780178.832771:0:17244:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71400/0xc8fc0a5179961e09 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780178.832786:0:17244:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0477a71400 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:2.0:1787780178.832791:0:17244:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71400/0xc8fc0a5179961e09 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780178.832799:0:17244:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71400/0xc8fc0a5179961e09 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780178.832814:0:17244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c0443d81100) 00010000:00010000:2.0:1787780178.832817:0:17244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787780178.832823:0:17244:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71400/0xc8fc0a5179961e09 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780178.832830:0:17244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71400/0xc8fc0a5179961e09 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780178.833121:0:17244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71800/0xc8fc0a5179961e10 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780178.833130:0:17244:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71800/0xc8fc0a5179961e10 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780178.833137:0:17244:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71800/0xc8fc0a5179961e10 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780178.833143:0:17244:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0477a71800 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:2.0:1787780178.833147:0:17244:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71800/0xc8fc0a5179961e10 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780178.833154:0:17244:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71800/0xc8fc0a5179961e10 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780178.833175:0:17244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9c0341cd4500) 00010000:00010000:2.0:1787780178.833178:0:17244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787780178.833182:0:17244:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71800/0xc8fc0a5179961e10 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780178.833189:0:17244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71800/0xc8fc0a5179961e10 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780178.833229:0:17244:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71600/0xc8fc0a5179961e02 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea22b5 expref: 12 pid: 17244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780178.833242:0:17244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c0443d81100) 00010000:00010000:2.0:1787780178.833244:0:17244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787780178.833248:0:17244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71600/0xc8fc0a5179961e02 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea22b5 expref: 12 pid: 17244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780178.833258:0:17244:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0477a71600, rc 0) 00000100:00100000:2.0:1787780178.833416:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0461bee940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eeb4a73f-1001-4fdb-898b-e22b5d3f1459+11:15654:x1874622863773440:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 1114us (3248us total) trans 8589934598 rc 301/301 00000100:00100000:2.0:1787780178.833426:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 34 00000100:00100000:1.0:1787780178.840282:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787780178.840361:0:20085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863773568 00000100:00100000:3.0:1787780178.840374:0:20085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863773568 00000100:00100000:3.0:1787780178.840454:0:20085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 35 00000100:00100000:3.0:1787780178.840465:0:20085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0481620000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eeb4a73f-1001-4fdb-898b-e22b5d3f1459+11:15654:x1874622863773568:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:3.0:1787780178.840496:0:20085:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787780178.840522:0:20085:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0440030400/0xc8fc0a5179961e1e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea22bc expref: -99 pid: 20085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780178.840647:0:20085:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0440031600/0xc8fc0a5179961e25 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780178.840681:0:20085:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0440031600/0xc8fc0a5179961e25 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780178.840695:0:20085:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0440031600/0xc8fc0a5179961e25 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20085 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787780178.840730:0:20085:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787780178.840734:0:20085:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787780178.841048:0:20085:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c0440031600/0xc8fc0a5179961e25 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780178.841083:0:20085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0440030400/0xc8fc0a5179961e1e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea22bc expref: 13 pid: 20085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780178.841106:0:20085:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0440031600/0xc8fc0a5179961e25 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea22bc expref: 12 pid: 20085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780178.841117:0:20085:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c0347a4ef00) 00010000:00010000:3.0:1787780178.841121:0:20085:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787780178.841124:0:20085:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0440031600, rc 0) 00000100:00100000:3.0:1787780178.841242:0:20085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0481620000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eeb4a73f-1001-4fdb-898b-e22b5d3f1459+12:15654:x1874622863773568:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 778us (975us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780178.841251:0:20085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 35 00000100:00100000:1.0:1787780178.852478:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787780178.856341:0:17245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863773696 00000100:00100000:0.0:1787780178.856364:0:17245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863773696 00000100:00100000:0.0:1787780178.856463:0:17245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 3 00000100:00100000:0.0:1787780178.856476:0:17245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0481622d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:eeb4a73f-1001-4fdb-898b-e22b5d3f1459+12:15654:x1874622863773696:12345-192.168.203.31@tcp:37:lfs.0 00000100:00100000:2.0:1787780178.865138:0:17245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0481622d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:eeb4a73f-1001-4fdb-898b-e22b5d3f1459+12:15654:x1874622863773696:12345-192.168.203.31@tcp:37:lfs.0 Request processed in 8645us (12656us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780178.865158:0:17245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 3 00000100:00100000:2.0:1787780178.878970:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787780178.879386:0:17246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863773952 00000100:00100000:1.0:1787780178.879398:0:17246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863773952 00000100:00100000:1.0:1787780178.879490:0:17246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 4 00000100:00100000:1.0:1787780178.879503:0:17246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c044778b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:eeb4a73f-1001-4fdb-898b-e22b5d3f1459+12:15654:x1874622863773952:12345-192.168.203.31@tcp:35:lfs.0 00000100:00100000:1.0:1787780178.880500:0:17246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c044778b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:eeb4a73f-1001-4fdb-898b-e22b5d3f1459+13:15654:x1874622863773952:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 992us (1539us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1787780178.880511:0:17246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 4 00000100:00100000:1.0:1787780178.933164:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787780178.933299:0:19793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863774080 00000100:00100000:2.0:1787780178.933312:0:19793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863774080 00000100:00100000:2.0:1787780178.933392:0:19793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 36 00000100:00100000:2.0:1787780178.933422:0:19793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0481621e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e302a01-7f05-4001-b9ff-8e623671b6e0+11:15660:x1874622863774080:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:2.0:1787780178.933460:0:19793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787780178.933492:0:19793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71800/0xc8fc0a5179961e2c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea22c3 expref: -99 pid: 19793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780178.933575:0:19793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71400/0xc8fc0a5179961e33 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780178.933592:0:19793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71400/0xc8fc0a5179961e33 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780178.933605:0:19793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71400/0xc8fc0a5179961e33 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780178.933616:0:19793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70a00/0xc8fc0a5179961e3a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780178.933624:0:19793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70a00/0xc8fc0a5179961e3a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780178.933630:0:19793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70a00/0xc8fc0a5179961e3a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780178.933745:0:19793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70600/0xc8fc0a5179961e41 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780178.933754:0:19793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70600/0xc8fc0a5179961e41 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780178.933761:0:19793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70600/0xc8fc0a5179961e41 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787780178.933814:0:19793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787780178.933817:0:19793:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787780178.933916:0:19793:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70600/0xc8fc0a5179961e41 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780178.933932:0:19793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71400/0xc8fc0a5179961e33 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780178.933938:0:19793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71400/0xc8fc0a5179961e33 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780178.933946:0:19793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71400/0xc8fc0a5179961e33 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780178.933953:0:19793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0477a71400 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:2.0:1787780178.933957:0:19793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71400/0xc8fc0a5179961e33 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780178.933966:0:19793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71400/0xc8fc0a5179961e33 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780178.933981:0:19793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c0443d81100) 00010000:00010000:2.0:1787780178.933983:0:19793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787780178.933990:0:19793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71400/0xc8fc0a5179961e33 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780178.933996:0:19793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71400/0xc8fc0a5179961e33 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780178.934012:0:19793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70a00/0xc8fc0a5179961e3a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780178.934029:0:19793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70a00/0xc8fc0a5179961e3a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780178.934035:0:19793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70a00/0xc8fc0a5179961e3a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780178.934040:0:19793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0477a70a00 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:2.0:1787780178.934043:0:19793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70a00/0xc8fc0a5179961e3a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780178.934050:0:19793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70a00/0xc8fc0a5179961e3a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780178.934058:0:19793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9c0341cd4500) 00010000:00010000:2.0:1787780178.934060:0:19793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787780178.934063:0:19793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70a00/0xc8fc0a5179961e3a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780178.934069:0:19793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70a00/0xc8fc0a5179961e3a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780178.934097:0:19793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71800/0xc8fc0a5179961e2c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea22c3 expref: 13 pid: 19793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780178.934112:0:19793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70600/0xc8fc0a5179961e41 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea22c3 expref: 12 pid: 19793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780178.934120:0:19793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c0347a4ef00) 00010000:00010000:2.0:1787780178.934122:0:19793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787780178.934130:0:19793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0477a70600, rc 0) 00000100:00100000:2.0:1787780178.934201:0:19793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0481621e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e302a01-7f05-4001-b9ff-8e623671b6e0+12:15660:x1874622863774080:12345-192.168.203.31@tcp:101:bash.0 Request processed in 781us (1051us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780178.934209:0:19793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 36 00000100:00100000:0.0:1787780178.941134:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787780178.941234:0:17254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863774208 00000100:00100000:3.0:1787780178.941247:0:17254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863774208 00000100:00100000:3.0:1787780178.941332:0:17254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 7 00000100:00100000:3.0:1787780178.941344:0:17254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0461becb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:6e302a01-7f05-4001-b9ff-8e623671b6e0+5:15660:x1874622863774208:12345-192.168.203.31@tcp:900:bash.0 00000100:00100000:3.0:1787780178.941466:0:17254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0461becb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:6e302a01-7f05-4001-b9ff-8e623671b6e0+5:15660:x1874622863774208:12345-192.168.203.31@tcp:900:bash.0 Request processed in 124us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780178.941493:0:17254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 7 00000100:00100000:1.0:1787780178.945152:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787780178.945391:0:17242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863774464 00000100:00100000:0.0:1787780178.945403:0:17242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863774464 00000100:00100000:0.0:1787780178.945486:0:17242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 37 00000100:00100000:0.0:1787780178.945497:0:17242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0481622d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e302a01-7f05-4001-b9ff-8e623671b6e0+12:15660:x1874622863774464:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:0.0:1787780178.945525:0:17242:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787780178.945553:0:17242:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0348c7b600/0xc8fc0a5179961e48 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea22ca expref: -99 pid: 17242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780178.945700:0:17242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0348c7be00/0xc8fc0a5179961e4f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780178.945718:0:17242:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0440031600/0xc8fc0a5179961e25 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea22bc expref: 12 pid: 20085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780178.945728:0:17242:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0348c7be00/0xc8fc0a5179961e4f lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780178.945802:0:17242:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c0440031600/0xc8fc0a5179961e25 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea22bc expref: 12 pid: 20085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780178.945817:0:17242:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0440031600/0xc8fc0a5179961e25 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea22bc expref: 12 pid: 20085 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787780178.945834:0:17242:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0461bec780 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17242:1874622881694080:192.168.203.31@tcp:104: 00000100:00100000:0.0:1787780178.946007:0:17242:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c034798ce40 going to sleep for 11 seconds 00000100:00100000:0.0:1787780178.951412:0:17242:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0461bec780 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17242:1874622881694080:192.168.203.31@tcp:104: 00010000:00010000:0.0:1787780178.951464:0:17242:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c0348c7be00/0xc8fc0a5179961e4f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787780178.953122:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787780178.953517:0:17229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863774592 00000100:00100000:0.0:1787780178.953529:0:17229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863774592 00010000:00010000:0.0:1787780178.953587:0:17229:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0440031600/0xc8fc0a5179961e25 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea22bc expref: 13 pid: 20085 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787780178.953636:0:17229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 16 00000100:00100000:0.0:1787780178.953648:0:17229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04816221c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb4a73f-1001-4fdb-898b-e22b5d3f1459+13:2410:x1874622863774592:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787780178.953666:0:17229:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787780178.953685:0:17229:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c0440031600/0xc8fc0a5179961e25 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea22bc expref: 13 pid: 20085 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780178.953701:0:17229:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c0440031600/0xc8fc0a5179961e25 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea22bc expref: 13 pid: 20085 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780178.953756:0:17229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0440031600/0xc8fc0a5179961e25 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea22bc expref: 13 pid: 20085 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780178.953777:0:17229:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c0347a4ef00) 00010000:00010000:0.0:1787780178.953940:0:17229:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0348c7be00/0xc8fc0a5179961e4f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780178.953954:0:17229:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0348c7be00/0xc8fc0a5179961e4f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780178.953964:0:17229:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0348c7be00/0xc8fc0a5179961e4f lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780178.954003:0:17229:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787780178.954071:0:17229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04816221c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb4a73f-1001-4fdb-898b-e22b5d3f1459+12:2410:x1874622863774592:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 425us (959us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780178.954079:0:17229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 16 00010000:00010000:2.0:1787780178.954401:0:17242:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c0348c7be00/0xc8fc0a5179961e4f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780178.954410:0:17242:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0348c7be00/0xc8fc0a5179961e4f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780178.954450:0:17242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71800/0xc8fc0a5179961e56 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780178.954462:0:17242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71800/0xc8fc0a5179961e56 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780178.954471:0:17242:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71800/0xc8fc0a5179961e56 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780178.956643:0:17242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70a00/0xc8fc0a5179961e5d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780178.956727:0:17242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70a00/0xc8fc0a5179961e5d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780178.956959:0:17242:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70a00/0xc8fc0a5179961e5d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787780178.956978:0:17242:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787780178.957021:0:17242:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0348c7be00/0xc8fc0a5179961e4f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780178.957028:0:17242:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0348c7be00/0xc8fc0a5179961e4f lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780178.957052:0:17242:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0348c7be00/0xc8fc0a5179961e4f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780178.957059:0:17242:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0348c7be00 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:2.0:1787780178.957064:0:17242:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0348c7be00/0xc8fc0a5179961e4f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780178.957073:0:17242:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0348c7be00/0xc8fc0a5179961e4f lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780178.957089:0:17242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c0347a4ef00) 00010000:00010000:2.0:1787780178.957093:0:17242:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787780178.957098:0:17242:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0348c7be00/0xc8fc0a5179961e4f lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780178.957105:0:17242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0348c7be00/0xc8fc0a5179961e4f lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787780178.957121:0:17242:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d6793466 reply state 000000000c813b50 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71800/0xc8fc0a5179961e56 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780178.957135:0:17242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71800/0xc8fc0a5179961e56 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780178.957141:0:17242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9c0347a4e300) 00010000:00010000:2.0:1787780178.957144:0:17242:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787780178.957147:0:17242:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787780178.957194:0:17242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0348c7b600/0xc8fc0a5179961e48 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea22ca expref: 15 pid: 17242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780178.957208:0:17242:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70a00/0xc8fc0a5179961e5d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea22ca expref: 14 pid: 17242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780178.957222:0:17242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c0347a4e600) 00010000:00010000:2.0:1787780178.957224:0:17242:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1787780178.957227:0:17242:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0477a70a00, rc 0) 00000100:00100000:2.0:1787780178.957425:0:17242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0481622d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e302a01-7f05-4001-b9ff-8e623671b6e0+15:15660:x1874622863774464:12345-192.168.203.31@tcp:101:bash.0 Request processed in 11929us (12286us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1787780178.957442:0:17242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 37 00000100:00100000:1.0:1787780178.971387:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787780178.971560:0:20085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863774720 00000100:00100000:3.0:1787780178.971573:0:20085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863774720 00000100:00100000:3.0:1787780178.971655:0:20085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 38 00000100:00100000:3.0:1787780178.971668:0:20085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04816230c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e302a01-7f05-4001-b9ff-8e623671b6e0+15:15660:x1874622863774720:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:3.0:1787780178.971712:0:20085:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787780178.971749:0:20085:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0440030400/0xc8fc0a5179961e6b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea22d1 expref: -99 pid: 20085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780178.971907:0:20085:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0440031600/0xc8fc0a5179961e72 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780178.971923:0:20085:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0440031600/0xc8fc0a5179961e72 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780178.971937:0:20085:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0440031600/0xc8fc0a5179961e72 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20085 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787780178.972007:0:20085:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1787780178.972012:0:20085:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787780178.972040:0:20085:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c0440031600/0xc8fc0a5179961e72 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780178.972052:0:20085:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0440031600/0xc8fc0a5179961e72 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780178.972081:0:20085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0440030400/0xc8fc0a5179961e6b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea22d1 expref: 17 pid: 20085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780178.972103:0:20085:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0440031600/0xc8fc0a5179961e72 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea22d1 expref: 16 pid: 20085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780178.972131:0:20085:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c0347a4e600) 00010000:00010000:3.0:1787780178.972134:0:20085:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787780178.972139:0:20085:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0440031600, rc 0) 00000100:00100000:3.0:1787780178.972212:0:20085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04816230c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e302a01-7f05-4001-b9ff-8e623671b6e0+16:15660:x1874622863774720:12345-192.168.203.31@tcp:101:bash.0 Request processed in 546us (839us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780178.972219:0:20085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 38 00000100:00100000:1.0:1787780178.976317:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787780178.976494:0:17245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863774976 00000100:00100000:2.0:1787780178.976507:0:17245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863774976 00000100:00100000:2.0:1787780178.976580:0:17245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 5 00000100:00100000:2.0:1787780178.976592:0:17245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04816212c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e302a01-7f05-4001-b9ff-8e623671b6e0+16:15660:x1874622863774976:12345-192.168.203.31@tcp:35:bash.0 00000100:00100000:2.0:1787780178.977025:0:17245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04816212c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e302a01-7f05-4001-b9ff-8e623671b6e0+17:15660:x1874622863774976:12345-192.168.203.31@tcp:35:bash.0 Request processed in 432us (720us total) trans 8589934601 rc 0/0 00000100:00100000:2.0:1787780178.977035:0:17245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 5 00000100:00100000:0.0:1787780179.081931:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787780179.082050:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863775232 00000100:00100000:2.0:1787780179.082063:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863775232 00000100:00100000:2.0:1787780179.082142:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 39 00000100:00100000:2.0:1787780179.082153:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0461bec780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e302a01-7f05-4001-b9ff-8e623671b6e0+17:15670:x1874622863775232:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:2.0:1787780179.082188:0:17244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787780179.082214:0:17244:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71400/0xc8fc0a5179961e79 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea22d8 expref: -99 pid: 17244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787780179.082355:0:17244:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1787780179.082503:0:17244:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71400/0xc8fc0a5179961e79 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea22d8 expref: 19 pid: 17244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780179.082545:0:17244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c0443d81100) 00010000:00010000:2.0:1787780179.082548:0:17244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787780179.082554:0:17244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71400/0xc8fc0a5179961e79 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea22d8 expref: 19 pid: 17244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780179.082572:0:17244:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0477a71400, rc 0) 00000100:00100000:2.0:1787780179.082660:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0461bec780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e302a01-7f05-4001-b9ff-8e623671b6e0+18:15670:x1874622863775232:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 508us (747us total) trans 8589934602 rc 301/301 00000100:00100000:2.0:1787780179.082668:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 39 00000100:00100000:3.0:1787780179.088323:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787780179.088525:0:17245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863775488 00000100:00100000:2.0:1787780179.088540:0:17245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863775488 00000100:00100000:2.0:1787780179.088615:0:17245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 6 00000100:00100000:2.0:1787780179.088626:0:17245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347ee1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e302a01-7f05-4001-b9ff-8e623671b6e0+18:15670:x1874622863775488:12345-192.168.203.31@tcp:35:lfs.0 00000100:00100000:2.0:1787780179.089215:0:17245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347ee1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e302a01-7f05-4001-b9ff-8e623671b6e0+19:15670:x1874622863775488:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 587us (905us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1787780179.089226:0:17245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 6 00000100:00100000:3.0:1787780179.161989:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787780179.162387:0:17242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863775744 00000100:00100000:2.0:1787780179.162401:0:17242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863775744 00000100:00100000:2.0:1787780179.162493:0:17242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 40 00000100:00100000:2.0:1787780179.162505:0:17242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347ee3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e302a01-7f05-4001-b9ff-8e623671b6e0+19:15673:x1874622863775744:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:2.0:1787780179.162541:0:17242:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787780179.162570:0:17242:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71400/0xc8fc0a5179961e87 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea22df expref: -99 pid: 17242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780179.162724:0:17242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70200/0xc8fc0a5179961e8e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780179.162759:0:17242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70200/0xc8fc0a5179961e8e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780179.162776:0:17242:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70200/0xc8fc0a5179961e8e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787780179.162792:0:17242:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1787780179.163023:0:17242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71400/0xc8fc0a5179961e87 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea22df expref: 22 pid: 17242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780179.163045:0:17242:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70200/0xc8fc0a5179961e8e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea22df expref: 21 pid: 17242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780179.163053:0:17242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c0347a4e600) 00010000:00010000:0.0:1787780179.163056:0:17242:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787780179.163060:0:17242:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0477a70200, rc 0) 00000100:00100000:0.0:1787780179.163203:0:17242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347ee3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e302a01-7f05-4001-b9ff-8e623671b6e0+21:15673:x1874622863775744:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 699us (1230us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1787780179.163218:0:17242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 40 00000100:00100000:0.0:1787780179.171170:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787780179.171334:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787780179.171619:0:17228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863776000 00000100:00100000:3.0:1787780179.171634:0:17228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863776000 00000100:00100000:3.0:1787780179.171718:0:17228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 0 00000100:00100000:3.0:1787780179.171730:0:17228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347dade00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e302a01-7f05-4001-b9ff-8e623671b6e0+21:2408:x1874622863776000:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787780179.171751:0:17228:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787780179.171785:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70200/0xc8fc0a5179961e8e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea22df expref: 21 pid: 17242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780179.171809:0:17228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c0347a4e600) 00010000:00010000:3.0:1787780179.171815:0:17228:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787780179.171947:0:17228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347dade00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e302a01-7f05-4001-b9ff-8e623671b6e0+20:2408:x1874622863776000:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 218us (611us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780179.171956:0:17228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 0 00000100:00100000:2.0:1787780179.173132:0:19793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863775872 00000100:00100000:2.0:1787780179.173146:0:19793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863775872 00000100:00100000:2.0:1787780179.173248:0:19793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 41 00000100:00100000:2.0:1787780179.173259:0:19793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0461bef0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e302a01-7f05-4001-b9ff-8e623671b6e0+20:15673:x1874622863775872:12345-192.168.203.31@tcp:54:lfs.0 00010000:00010000:2.0:1787780179.173357:0:19793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70e00/0xc8fc0a5179961e9c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780179.173378:0:19793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70e00/0xc8fc0a5179961e9c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780179.173392:0:19793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70e00/0xc8fc0a5179961e9c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780179.173447:0:19793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70e00/0xc8fc0a5179961e9c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780179.173455:0:19793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70e00/0xc8fc0a5179961e9c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780179.173462:0:19793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70e00/0xc8fc0a5179961e9c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780179.173469:0:19793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0477a70e00 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:2.0:1787780179.173491:0:19793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70e00/0xc8fc0a5179961e9c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780179.173499:0:19793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70e00/0xc8fc0a5179961e9c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780179.173511:0:19793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c0347a4e600) 00010000:00010000:2.0:1787780179.173514:0:19793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787780179.173519:0:19793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70e00/0xc8fc0a5179961e9c lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780179.173526:0:19793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70e00/0xc8fc0a5179961e9c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787780179.173608:0:19793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0461bef0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e302a01-7f05-4001-b9ff-8e623671b6e0+20:15673:x1874622863775872:12345-192.168.203.31@tcp:54:lfs.0 Request processed in 350us (2453us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780179.173617:0:19793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 41 00000100:00100000:0.0:1787780179.176120:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787780179.176353:0:17246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863776256 00000100:00100000:1.0:1787780179.176367:0:17246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863776256 00000100:00100000:1.0:1787780179.176454:0:17246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 7 00000100:00100000:1.0:1787780179.176468:0:17246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347dacf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e302a01-7f05-4001-b9ff-8e623671b6e0+20:15673:x1874622863776256:12345-192.168.203.31@tcp:35:lfs.0 00000100:00100000:1.0:1787780179.176802:0:17246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347dacf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e302a01-7f05-4001-b9ff-8e623671b6e0+21:15673:x1874622863776256:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 337us (695us total) trans 8589934605 rc 0/0 00000100:00100000:1.0:1787780179.176813:0:17246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 7 00000100:00100000:3.0:1787780179.228466:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787780179.228497:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0481620b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881694208:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787780179.228591:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780179.228658:0:18752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881694208 00000100:00100000:3.0:1787780179.228685:0:18752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881694208 00000100:00100000:3.0:1787780179.228763:0:18752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787780179.228774:0:18752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347ee2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1874622881694208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787780179.228813:0:18752:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1787780179.228896:0:18752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347ee2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1874622881694208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 124us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780179.228905:0:18752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787780179.228962:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0481620b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881694208:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1787780179.228991:0:17238:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787780179.230524:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0481622580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881694592:0@lo:400:kworker.0 00000100:00100000:1.0:1787780179.230607:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780179.230649:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477843480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881695104:0@lo:400:kworker.0 00000100:00100000:1.0:1787780179.230675:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780179.230691:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477af3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1874622881695616:0@lo:400:kworker.0 00000100:00100000:1.0:1787780179.230743:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780179.230777:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1787780179.230785:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0481620f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881694464:0@lo:400:kworker.0 00000100:00100000:1.0:1787780179.230810:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780179.230828:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0481623840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881694976:0@lo:400:kworker.0 00000100:00100000:1.0:1787780179.230868:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780179.230884:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477af1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1874622881695488:0@lo:400:kworker.0 00000100:00100000:1.0:1787780179.230904:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780179.230940:0:17243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881695616 00000100:00100000:1.0:1787780179.230948:0:17243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881695616 00000100:00100000:1.0:1787780179.231028:0:17243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881695488 00000100:00100000:1.0:1787780179.231032:0:17243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881695488 00000100:00100000:1.0:1787780179.231057:0:17243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787780179.231069:0:17243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c048163f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1874622881695616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787780179.231124:0:17243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c048163f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1874622881695616:12345-0@lo:400:kworker.0 Request processed in 58us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780179.231131:0:17243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787780179.231156:0:17243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787780179.231163:0:17243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c048163e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874622881695488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787780179.231190:0:17243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c048163e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874622881695488:12345-0@lo:400:kworker.0 Request processed in 28us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780179.231196:0:17243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:1.0:1787780179.231232:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0477af1680 x1874622881695488/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787780195 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787780179.231247:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477af1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1874622881695488:0@lo:400:kworker.0 00000100:00100000:3.0:1787780179.231608:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0481620b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:3642:1874622881694336:0@lo:400:kworker.0 00000100:00100000:3.0:1787780179.231651:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780179.231686:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04816203c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874622881694848:0@lo:400:kworker.0 00000100:00100000:3.0:1787780179.231713:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780179.231733:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477af0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1874622881695360:0@lo:400:kworker.0 00000100:00100000:3.0:1787780179.231754:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780179.231774:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1787780179.231780:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0481621680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1874622881694720:0@lo:400:kworker.0 00000100:00100000:3.0:1787780179.231802:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780179.231822:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477af0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1874622881695232:0@lo:400:kworker.0 00000100:00100000:3.0:1787780179.231872:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780179.231897:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477af03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1874622881695744:0@lo:400:kworker.0 00000100:00100000:3.0:1787780179.231926:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780179.231951:0:17237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881694336 00000100:00100000:3.0:1787780179.231956:0:17237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881694336 00000100:00100000:3.0:1787780179.231996:0:17237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1787780179.232004:0:17237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0478637850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+24:3642:x1874622881694336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787780179.232059:0:17237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0478637850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+24:3642:x1874622881694336:12345-0@lo:400:kworker.0 Request processed in 56us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780179.232066:0:17237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1787780179.232105:0:17247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881694464 00000100:00100000:3.0:1787780179.232109:0:17247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881694464 00000100:00100000:3.0:1787780179.232136:0:17247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881694848 00000100:00100000:3.0:1787780179.232139:0:17247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881694848 00000100:00100000:3.0:1787780179.232171:0:17247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787780179.232178:0:17247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c048163d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881694464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787780179.232216:0:17247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c048163d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881694464:12345-0@lo:400:kworker.0 Request processed in 39us (1405us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780179.232223:0:17247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787780179.232236:0:17247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787780179.232241:0:17247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347ee0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1874622881694848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787780179.232543:0:19793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881695360 00000100:00100000:2.0:1787780179.232549:0:19793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881695360 00000100:00100000:2.0:1787780179.232578:0:19793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881694720 00000100:00100000:2.0:1787780179.232580:0:19793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881694720 00000100:00100000:2.0:1787780179.232590:0:19793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881695232 00000100:00100000:2.0:1787780179.232592:0:19793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881695232 00000100:00100000:2.0:1787780179.232601:0:19793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881695744 00000100:00100000:2.0:1787780179.232603:0:19793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881695744 00000100:00100000:2.0:1787780179.232617:0:19793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787780179.232623:0:19793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347ee1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1874622881695360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787780179.233045:0:19055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881694592 00000100:00100000:0.0:1787780179.233051:0:19055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881694592 00000100:00100000:0.0:1787780179.233084:0:19055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881695104 00000100:00100000:0.0:1787780179.233087:0:19055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881695104 00000100:00100000:0.0:1787780179.233103:0:19055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881694976 00000100:00100000:0.0:1787780179.233106:0:19055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881694976 00000100:00100000:0.0:1787780179.233123:0:19055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787780179.233131:0:19055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477af1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881694592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787780179.233204:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477af3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1874622881695616:0@lo:400:kworker.0 00000100:00100000:1.0:1787780179.233245:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0481620f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881694464:0@lo:400:kworker.0 00000100:00100000:1.0:1787780179.233312:0:18748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787780179.233321:0:18748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477af30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881695104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787780179.238719:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787780179.238766:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346da5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881695872:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787780179.238873:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787780179.238960:0:18752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881695872 00000100:00100000:2.0:1787780179.238989:0:18752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881695872 00000100:00100000:2.0:1787780179.239050:0:18752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787780179.239059:0:18752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c047785ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3641:x1874622881695872:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787780179.239107:0:18752:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1787780179.239946:0:19055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477af1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881694592:12345-0@lo:400:kworker.0 Request processed in 6809us (9332us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780179.239962:0:19055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787780179.240000:0:19055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787780179.240013:0:19055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c048163cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881694976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787780179.240077:0:19055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c048163cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881694976:12345-0@lo:400:kworker.0 Request processed in 69us (9208us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780179.240084:0:19055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787780179.240123:0:17242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787780179.240132:0:17242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347ee21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1874622881694720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787780179.240172:0:17242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347ee21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1874622881694720:12345-0@lo:400:kworker.0 Request processed in 42us (8369us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780179.240178:0:17242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787780179.240199:0:17242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787780179.240224:0:17242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347ee2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1874622881695232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787780179.240450:0:17242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347ee2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1874622881695232:12345-0@lo:400:kworker.0 Request processed in 226us (8576us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780179.240457:0:17242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787780179.240472:0:17242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787780179.240481:0:17242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347ee12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1874622881695744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787780179.240550:0:17242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347ee12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1874622881695744:12345-0@lo:400:kworker.0 Request processed in 71us (8622us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780179.240557:0:17242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787780179.240667:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0481623840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881694976:0@lo:400:kworker.0 00000100:00100000:0.0:1787780179.240683:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0481622580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881694592:0@lo:400:kworker.0 00000100:00080000:0.0:1787780179.240751:0:17238:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787780179.240758:0:17238:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787780179.240762:0:17238:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787780179.240765:0:17238:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787780179.240786:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0481621680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1874622881694720:0@lo:400:kworker.0 00000100:00100000:0.0:1787780179.240800:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477af0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1874622881695232:0@lo:400:kworker.0 00010000:00080000:0.0:1787780179.240816:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0477af03c0 x1874622881695744/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787780195 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787780179.240828:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477af03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1874622881695744:0@lo:400:kworker.0 00000100:00100000:0.0:1787780179.241017:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0481620b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:3642:1874622881694336:0@lo:400:kworker.0 00000100:00100000:0.0:1787780179.241232:0:19793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347ee1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1874622881695360:12345-0@lo:400:kworker.0 Request processed in 8606us (9474us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780179.241241:0:19793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787780179.241437:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477af0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1874622881695360:0@lo:400:kworker.0 00000100:00100000:2.0:1787780179.243356:0:18752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c047785ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3641:x1874622881695872:12345-0@lo:13:osp-pre-1-1.0 Request processed in 4274us (4460us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780179.243883:0:18752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787780179.245418:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346da5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881695872:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787780179.247130:0:18748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477af30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881695104:12345-0@lo:400:kworker.0 Request processed in 13800us (16444us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780179.247147:0:18748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787780179.247313:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477843480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881695104:0@lo:400:kworker.0 00000100:00100000:3.0:1787780179.249051:0:17247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347ee0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1874622881694848:12345-0@lo:400:kworker.0 Request processed in 16797us (17325us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780179.249069:0:17247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787780179.249231:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04816203c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874622881694848:0@lo:400:kworker.0 00010000:00010000:3.0:1787780179.293157:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787780179.554238:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787780179.554403:0:17242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863776512 00000100:00100000:0.0:1787780179.554414:0:17242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863776512 00000100:00100000:0.0:1787780179.554512:0:17242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 42 00000100:00100000:0.0:1787780179.554522:0:17242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c048163f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e302a01-7f05-4001-b9ff-8e623671b6e0+21:15704:x1874622863776512:12345-192.168.203.31@tcp:101:cat.0 00010000:00010000:0.0:1787780179.554558:0:17242:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787780179.554585:0:17242:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0348c7bc00/0xc8fc0a5179961ea3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea22e6 expref: -99 pid: 17242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780179.554741:0:17242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0348c7a600/0xc8fc0a5179961eaa lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780179.554761:0:17242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0348c7a600/0xc8fc0a5179961eaa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780179.554775:0:17242:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0348c7a600/0xc8fc0a5179961eaa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787780179.554789:0:17242:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1787780179.554988:0:17242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0348c7bc00/0xc8fc0a5179961ea3 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea22e6 expref: 24 pid: 17242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780179.555010:0:17242:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0348c7a600/0xc8fc0a5179961eaa lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea22e6 expref: 23 pid: 17242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780179.555044:0:17242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c0347a4e600) 00010000:00010000:0.0:1787780179.555047:0:17242:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787780179.555051:0:17242:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0348c7a600, rc 0) 00000100:00100000:0.0:1787780179.555126:0:17242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c048163f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e302a01-7f05-4001-b9ff-8e623671b6e0+23:15704:x1874622863776512:12345-192.168.203.31@tcp:101:cat.0 Request processed in 605us (903us total) trans 8589934606 rc 0/0 00000100:00100000:0.0:1787780179.555134:0:17242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 42 00000100:00100000:3.0:1787780179.564929:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787780179.565045:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787780179.565504:0:17246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863776896 00000100:00100000:1.0:1787780179.565517:0:17246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863776896 00000100:00100000:1.0:1787780179.565604:0:17246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 8 00000100:00100000:1.0:1787780179.565615:0:17246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347ee3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e302a01-7f05-4001-b9ff-8e623671b6e0+23:15704:x1874622863776896:12345-192.168.203.31@tcp:35:cat.0 00000100:00100000:1.0:1787780179.566114:0:17246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347ee3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e302a01-7f05-4001-b9ff-8e623671b6e0+24:15704:x1874622863776896:12345-192.168.203.31@tcp:35:cat.0 Request processed in 497us (1066us total) trans 8589934607 rc 0/0 00000100:00100000:1.0:1787780179.566123:0:17246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 8 00000100:00100000:0.0:1787780179.566251:0:17229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863776640 00000100:00100000:0.0:1787780179.566274:0:17229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863776640 00000100:00100000:0.0:1787780179.566325:0:17229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 1 00000100:00100000:0.0:1787780179.566333:0:17229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347ee2940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e302a01-7f05-4001-b9ff-8e623671b6e0+24:2409:x1874622863776640:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787780179.566346:0:17229:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787780179.566378:0:17229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0348c7a600/0xc8fc0a5179961eaa lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea22e6 expref: 24 pid: 17242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780179.566397:0:17229:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c0347a4e600) 00010000:00010000:0.0:1787780179.566402:0:17229:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787780179.566423:0:17229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347ee2940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e302a01-7f05-4001-b9ff-8e623671b6e0+23:2409:x1874622863776640:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 91us (1511us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780179.566439:0:17229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 1 00000040:00080000:3.0:1787780179.613044:0:17278:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787780179.651360:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787780179.651451:0:17243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863777152 00000100:00100000:0.0:1787780179.651464:0:17243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863777152 00000100:00100000:0.0:1787780179.651540:0:17243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 43 00000100:00100000:0.0:1787780179.651553:0:17243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347ee1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e302a01-7f05-4001-b9ff-8e623671b6e0+23:15710:x1874622863777152:12345-192.168.203.31@tcp:101:dd.0 00010000:00010000:0.0:1787780179.651692:0:17243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787780179.651723:0:17243:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0348c7a600/0xc8fc0a5179961eb8 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea22ed expref: -99 pid: 17243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780179.652258:0:17243:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0348c7bc00/0xc8fc0a5179961ebf lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780179.652279:0:17243:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70a00/0xc8fc0a5179961e5d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea22ca expref: 24 pid: 17242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780179.652289:0:17243:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0440031600/0xc8fc0a5179961e72 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea22d1 expref: 24 pid: 20085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780179.652298:0:17243:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0348c7bc00/0xc8fc0a5179961ebf lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780179.652343:0:17243:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c0440031600/0xc8fc0a5179961e72 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea22d1 expref: 24 pid: 20085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780179.652361:0:17243:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0440031600/0xc8fc0a5179961e72 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea22d1 expref: 24 pid: 20085 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787780179.652384:0:17243:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346da5680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17243:1874622881696000:192.168.203.31@tcp:104: 00010000:00010000:0.0:1787780179.652518:0:17243:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70a00/0xc8fc0a5179961e5d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea22ca expref: 24 pid: 17242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780179.652529:0:17243:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70a00/0xc8fc0a5179961e5d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea22ca expref: 24 pid: 17242 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787780179.652538:0:17243:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346da7840 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17243:1874622881696128:192.168.203.31@tcp:104: 00000100:00100000:0.0:1787780179.652575:0:17243:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c034798ce40 going to sleep for 11 seconds 00000100:00100000:3.0:1787780179.659173:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787780179.659244:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787780179.659265:0:17243:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346da5680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17243:1874622881696000:192.168.203.31@tcp:104: 00000100:00100000:0.0:1787780179.659280:0:17243:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346da7840 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17243:1874622881696128:192.168.203.31@tcp:104: 00010000:00010000:0.0:1787780179.659314:0:17243:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c0348c7bc00/0xc8fc0a5179961ebf lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17243 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787780179.659441:0:17227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863777280 00000100:00100000:1.0:1787780179.659451:0:17227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863777280 00010000:00010000:1.0:1787780179.659504:0:17227:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0440031600/0xc8fc0a5179961e72 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea22d1 expref: 25 pid: 20085 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787780179.659544:0:17227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863777408 00000100:00100000:1.0:1787780179.659547:0:17227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863777408 00010000:00010000:1.0:1787780179.659560:0:17227:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70a00/0xc8fc0a5179961e5d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea22ca expref: 26 pid: 17242 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787780179.659588:0:17227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 17 00000100:00100000:1.0:1787780179.659599:0:17227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347ee03c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e302a01-7f05-4001-b9ff-8e623671b6e0+26:2411:x1874622863777280:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787780179.659619:0:17227:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787780179.659628:0:17227:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c0440031600/0xc8fc0a5179961e72 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea22d1 expref: 26 pid: 20085 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787780179.659628:0:17229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 18 00000100:00100000:0.0:1787780179.659636:0:17229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0341d48050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e302a01-7f05-4001-b9ff-8e623671b6e0+26:2411:x1874622863777408:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787780179.659641:0:17227:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c0440031600/0xc8fc0a5179961e72 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea22d1 expref: 26 pid: 20085 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780179.659643:0:17229:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787780179.659648:0:17229:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70a00/0xc8fc0a5179961e5d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea22ca expref: 26 pid: 17242 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780179.659680:0:17227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0440031600/0xc8fc0a5179961e72 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea22d1 expref: 26 pid: 20085 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780179.659726:0:17229:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70a00/0xc8fc0a5179961e5d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea22ca expref: 25 pid: 17242 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780179.660554:0:17227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c0347a4e600) 00010000:00010000:1.0:1787780179.660567:0:17227:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0348c7bc00/0xc8fc0a5179961ebf lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780179.660578:0:17227:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0348c7bc00/0xc8fc0a5179961ebf lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780179.660586:0:17227:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787780179.660691:0:17227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347ee03c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e302a01-7f05-4001-b9ff-8e623671b6e0+25:2411:x1874622863777280:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 1090us (1531us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780179.660700:0:17227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 17 00010000:00010000:0.0:1787780179.664182:0:17229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70a00/0xc8fc0a5179961e5d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea22ca expref: 24 pid: 17242 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780179.664219:0:17229:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c0347a4e600) 00010000:00010000:0.0:1787780179.664226:0:17229:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0348c7bc00/0xc8fc0a5179961ebf lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780179.664238:0:17229:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0348c7bc00/0xc8fc0a5179961ebf lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780179.664246:0:17229:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0348c7bc00/0xc8fc0a5179961ebf lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780179.664375:0:17229:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787780179.664481:0:17229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0341d48050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e302a01-7f05-4001-b9ff-8e623671b6e0+23:2411:x1874622863777408:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 4843us (5234us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780179.664494:0:17229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 18 00010000:00010000:1.0:1787780179.666238:0:17243:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c0348c7bc00/0xc8fc0a5179961ebf lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780179.666259:0:17243:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0348c7bc00/0xc8fc0a5179961ebf lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17243 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787780179.666289:0:17243:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1787780179.666524:0:17243:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0348c7a600/0xc8fc0a5179961eb8 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea22ed expref: 24 pid: 17243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780179.666552:0:17243:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0348c7bc00/0xc8fc0a5179961ebf lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea22ed expref: 23 pid: 17243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780179.666563:0:17243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c0347a4e600) 00010000:00010000:1.0:1787780179.666566:0:17243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787780179.666569:0:17243:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0348c7bc00, rc 0) 00000100:00100000:1.0:1787780179.666700:0:17243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347ee1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e302a01-7f05-4001-b9ff-8e623671b6e0+23:15710:x1874622863777152:12345-192.168.203.31@tcp:101:dd.0 Request processed in 15150us (15356us total) trans 8589934608 rc 0/0 00000100:00100000:1.0:1787780179.666728:0:17243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 43 00000100:00100000:2.0:1787780179.672599:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787780179.672752:0:19793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863777536 00000100:00100000:0.0:1787780179.672765:0:19793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863777536 00000100:00100000:0.0:1787780179.673076:0:19793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 44 00000100:00100000:0.0:1787780179.673088:0:19793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c047785c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e302a01-7f05-4001-b9ff-8e623671b6e0+23:15710:x1874622863777536:12345-192.168.203.31@tcp:101:dd.0 00010000:00010000:0.0:1787780179.673125:0:19793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787780179.673154:0:19793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0348c7b400/0xc8fc0a5179961ecd lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea22f4 expref: -99 pid: 19793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780179.673202:0:19793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0348c7aa00/0xc8fc0a5179961ed4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780179.673220:0:19793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0348c7aa00/0xc8fc0a5179961ed4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780179.673235:0:19793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0348c7aa00/0xc8fc0a5179961ed4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780179.673404:0:19793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0348c7b400/0xc8fc0a5179961ecd lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea22f4 expref: 25 pid: 19793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780179.673436:0:19793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0348c7aa00/0xc8fc0a5179961ed4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea22f4 expref: 24 pid: 19793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780179.673447:0:19793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c0347a4e600) 00010000:00010000:0.0:1787780179.673458:0:19793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787780179.673462:0:19793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0348c7aa00, rc 0) 00000100:00100000:0.0:1787780179.673549:0:19793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c047785c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e302a01-7f05-4001-b9ff-8e623671b6e0+24:15710:x1874622863777536:12345-192.168.203.31@tcp:101:dd.0 Request processed in 462us (962us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780179.673557:0:19793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 44 00000100:00100000:2.0:1787780179.682423:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787780179.682591:0:17242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863777792 00000100:00100000:1.0:1787780179.682604:0:17242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863777792 00000100:00100000:1.0:1787780179.682684:0:17242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 45 00000100:00100000:1.0:1787780179.682696:0:17242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c047785cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e302a01-7f05-4001-b9ff-8e623671b6e0+24:15710:x1874622863777792:12345-192.168.203.31@tcp:36:dd.0 00010000:00010000:1.0:1787780179.683047:0:17242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868600/0xc8fc0a5179961edb lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780179.683069:0:17242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868600/0xc8fc0a5179961edb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780179.683082:0:17242:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868600/0xc8fc0a5179961edb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787780179.683134:0:17242:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:1.0:1787780179.683161:0:17242:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d41259cb reply state 0000000094cf3a53 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868600/0xc8fc0a5179961edb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780179.683174:0:17242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868600/0xc8fc0a5179961edb lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780179.683182:0:17242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c0347a4e600) 00010000:00010000:1.0:1787780179.683185:0:17242:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787780179.683190:0:17242:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787780179.683296:0:17242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c047785cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e302a01-7f05-4001-b9ff-8e623671b6e0+27:15710:x1874622863777792:12345-192.168.203.31@tcp:36:dd.0 Request processed in 601us (886us total) trans 8589934610 rc 0/0 00000100:00100000:1.0:1787780179.683305:0:17242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 45 00000020:00080000:1.0:1787780179.683311:0:17242:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787780179.686609:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787780179.686771:0:17243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863777920 00000100:00100000:1.0:1787780179.686813:0:17243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863777920 00000100:00100000:1.0:1787780179.686935:0:17243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 46 00000100:00100000:1.0:1787780179.686948:0:17243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347ee2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e302a01-7f05-4001-b9ff-8e623671b6e0+27:15710:x1874622863777920:12345-192.168.203.31@tcp:101:dd.0 00010000:00010000:1.0:1787780179.686980:0:17243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787780179.687006:0:17243:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869e00/0xc8fc0a5179961ee2 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea22fb expref: -99 pid: 17243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780179.687081:0:17243:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869e00/0xc8fc0a5179961ee2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea22fb expref: 28 pid: 17243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780179.687097:0:17243:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869e00/0xc8fc0a5179961ee2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea22fb expref: 28 pid: 17243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780179.687120:0:17243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c0347a4e600) 00010000:00010000:1.0:1787780179.687124:0:17243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787780179.687128:0:17243:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0477869e00, rc 0) 00000100:00100000:1.0:1787780179.687205:0:17243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347ee2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e302a01-7f05-4001-b9ff-8e623671b6e0+28:15710:x1874622863777920:12345-192.168.203.31@tcp:101:dd.0 Request processed in 260us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780179.687213:0:17243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 46 00000100:00100000:2.0:1787780179.705535:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787780179.705637:0:17228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863778176 00000100:00100000:3.0:1787780179.705649:0:17228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863778176 00000100:00100000:2.0:1787780179.706696:0:17228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 2 00000100:00100000:2.0:1787780179.706710:0:17228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c047785e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e302a01-7f05-4001-b9ff-8e623671b6e0+28:15710:x1874622863778176:12345-192.168.203.31@tcp:103:dd.0 00010000:00010000:2.0:1787780179.706733:0:17228:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787780179.706769:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869e00/0xc8fc0a5179961ee2 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea22fb expref: 28 pid: 17243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780179.706806:0:17228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c0347a4e600) 00010000:00010000:2.0:1787780179.706812:0:17228:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787780179.706968:0:17228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c047785e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e302a01-7f05-4001-b9ff-8e623671b6e0+27:15710:x1874622863778176:12345-192.168.203.31@tcp:103:dd.0 Request processed in 261us (1445us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780179.706976:0:17228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 2 00000100:00100000:3.0:1787780179.712054:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787780179.712233:0:19793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863778304 00000100:00100000:0.0:1787780179.712247:0:19793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863778304 00000100:00100000:0.0:1787780179.712324:0:19793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 47 00000100:00100000:0.0:1787780179.712336:0:19793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347ee03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e302a01-7f05-4001-b9ff-8e623671b6e0+27:15710:x1874622863778304:12345-192.168.203.31@tcp:58:dd.0 00010000:00010000:0.0:1787780179.712489:0:19793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0348c7b400/0xc8fc0a5179961ee9 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780179.712513:0:19793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0348c7b400/0xc8fc0a5179961ee9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780179.712526:0:19793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0348c7b400/0xc8fc0a5179961ee9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19793 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787780179.714612:0:19793:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787780179.715175:0:19793:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:0.0:1787780179.717183:0:19793:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:0.0:1787780179.717498:0:19793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347ee03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e302a01-7f05-4001-b9ff-8e623671b6e0+27:15710:x1874622863778304:12345-192.168.203.31@tcp:58:dd.0 Request processed in 5155us (5451us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780179.717515:0:19793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 47 00000100:00100000:1.0:1787780179.720328:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787780179.720450:0:20085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863778432 00000100:00100000:3.0:1787780179.720464:0:20085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863778432 00000100:00100000:3.0:1787780179.720536:0:20085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 48 00000100:00100000:3.0:1787780179.720548:0:20085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c048163d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e302a01-7f05-4001-b9ff-8e623671b6e0+27:15710:x1874622863778432:12345-192.168.203.31@tcp:101:dd.0 00010000:00010000:3.0:1787780179.720577:0:20085:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787780179.720605:0:20085:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0481373e00/0xc8fc0a5179961ef0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea2302 expref: -99 pid: 20085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780179.720679:0:20085:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0348c7b400/0xc8fc0a5179961ee9 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780179.720693:0:20085:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0481373e00/0xc8fc0a5179961ef0 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea2302 expref: 28 pid: 20085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780179.720716:0:20085:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9c0348c7b400/0xc8fc0a5179961ee9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 19793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780179.720734:0:20085:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0481373e00/0xc8fc0a5179961ef0 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea2302 expref: 28 pid: 20085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780179.720751:0:20085:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c0347a4e600) 00010000:00010000:3.0:1787780179.720754:0:20085:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787780179.720757:0:20085:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0481373e00/0xc8fc0a5179961ef0 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea2302 expref: 28 pid: 20085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780179.720765:0:20085:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0481373e00, rc 0) 00000100:00100000:3.0:1787780179.720920:0:20085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c048163d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e302a01-7f05-4001-b9ff-8e623671b6e0+28:15710:x1874622863778432:12345-192.168.203.31@tcp:101:dd.0 Request processed in 373us (605us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780179.720950:0:20085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 48 00000100:00100000:2.0:1787780179.745019:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346da7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881696256:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787780179.745146:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787780179.745240:0:18753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881696256 00000100:00100000:0.0:1787780179.745250:0:18753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881696256 00000100:00100000:0.0:1787780179.745330:0:18753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787780179.745343:0:18753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0348a08b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881696256:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787780179.745385:0:18753:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1787780179.745490:0:18753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0348a08b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874622881696256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 148us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780179.745499:0:18753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787780179.745551:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346da7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874622881696256:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787780180.317007:0:18397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787780180.636207:0:17278:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787780180.636221:0:17278:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787780180.636281:0:17278:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1787780180.636298:0:17278:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1787780180.636499:0:17278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c046215de00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17278:1874622881696384:192.168.203.31@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787780180.636637:0:17278:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0341c61600 going to sleep for 11 seconds 00000100:00100000:3.0:1787780180.646180:0:17278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c046215de00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17278:1874622881696384:192.168.203.31@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787780180.647747:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787780180.647896:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863778560 00000100:00100000:0.0:1787780180.647906:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863778560 00000100:00100000:0.0:1787780180.648019:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 49 00000100:00100000:0.0:1787780180.648032:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0348a0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e302a01-7f05-4001-b9ff-8e623671b6e0+28:15711:x1874622863778560:12345-192.168.203.31@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787780180.648078:0:17244:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787780180.648236:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0348a0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e302a01-7f05-4001-b9ff-8e623671b6e0+28:15711:x1874622863778560:12345-192.168.203.31@tcp:53:lhsmtool_posix.0 Request processed in 206us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780180.648246:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 49 00000100:00080000:3.0:1787780180.648461:0:17238:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787780180.652253:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787780180.652388:0:19793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863778688 00000100:00100000:0.0:1787780180.652401:0:19793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863778688 00000100:00100000:0.0:1787780180.652670:0:19793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 50 00000100:00100000:0.0:1787780180.652684:0:19793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c048163c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e302a01-7f05-4001-b9ff-8e623671b6e0+28:15711:x1874622863778688:12345-192.168.203.31@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1787780180.652791:0:19793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0348c7b800/0xc8fc0a5179961ef7 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780180.652817:0:19793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0348c7b800/0xc8fc0a5179961ef7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780180.652832:0:19793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0348c7b800/0xc8fc0a5179961ef7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780180.653369:0:19793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0348c7b200/0xc8fc0a5179961efe lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780180.653393:0:19793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0348c7b200/0xc8fc0a5179961efe lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780180.653500:0:19793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0348c7b200/0xc8fc0a5179961efe lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780180.654017:0:19793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0348c7ae00/0xc8fc0a5179961f05 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 19793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780180.654029:0:19793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0348c7ae00/0xc8fc0a5179961f05 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 19793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780180.654037:0:19793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0348c7ae00/0xc8fc0a5179961f05 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 19793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787780180.654093:0:19793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1787780180.654098:0:19793:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787780180.654115:0:19793:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c0348c7ae00/0xc8fc0a5179961f05 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 19793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780180.654126:0:19793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0348c7b800/0xc8fc0a5179961ef7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780180.654132:0:19793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0348c7b800/0xc8fc0a5179961ef7 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780180.654139:0:19793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0348c7b800/0xc8fc0a5179961ef7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780180.654145:0:19793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0348c7b800 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:0.0:1787780180.654149:0:19793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0348c7b800/0xc8fc0a5179961ef7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780180.654766:0:19793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0348c7b800/0xc8fc0a5179961ef7 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780180.654794:0:19793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c0341cd4e00) 00010000:00010000:0.0:1787780180.654797:0:19793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787780180.654803:0:19793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0348c7b800/0xc8fc0a5179961ef7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780180.654809:0:19793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0348c7b800/0xc8fc0a5179961ef7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780180.655297:0:19793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0348c7b200/0xc8fc0a5179961efe lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780180.655307:0:19793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0348c7b200/0xc8fc0a5179961efe lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780180.655313:0:19793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0348c7b200/0xc8fc0a5179961efe lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780180.655319:0:19793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0348c7b200 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:0.0:1787780180.655323:0:19793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0348c7b200/0xc8fc0a5179961efe lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780180.655329:0:19793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0348c7b200/0xc8fc0a5179961efe lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780180.655339:0:19793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff9c0347bec000) 00010000:00010000:0.0:1787780180.655341:0:19793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787780180.655344:0:19793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0348c7b200/0xc8fc0a5179961efe lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780180.655350:0:19793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0348c7b200/0xc8fc0a5179961efe lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780180.655382:0:19793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0348c7ae00/0xc8fc0a5179961f05 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 19793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780180.655388:0:19793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0348c7ae00/0xc8fc0a5179961f05 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 19793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780180.655394:0:19793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0348c7ae00/0xc8fc0a5179961f05 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 19793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780180.655412:0:19793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0348c7ae00 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:0.0:1787780180.655415:0:19793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0348c7ae00/0xc8fc0a5179961f05 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 19793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780180.655430:0:19793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0348c7ae00/0xc8fc0a5179961f05 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 19793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780180.655437:0:19793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c0347a4e600) 00010000:00010000:0.0:1787780180.655440:0:19793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787780180.655443:0:19793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0348c7ae00/0xc8fc0a5179961f05 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 19793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780180.655448:0:19793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0348c7ae00/0xc8fc0a5179961f05 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 19793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787780180.655547:0:19793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c048163c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e302a01-7f05-4001-b9ff-8e623671b6e0+28:15711:x1874622863778688:12345-192.168.203.31@tcp:34:lhsmtool_posix.0 Request processed in 2861us (3544us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780180.655557:0:19793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 50 00000100:00100000:2.0:1787780180.665379:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787780180.665525:0:17243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863778944 00000100:00100000:1.0:1787780180.665535:0:17243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863778944 00000100:00100000:1.0:1787780180.665597:0:17243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 51 00000100:00100000:1.0:1787780180.665607:0:17243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0348a083c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e302a01-7f05-4001-b9ff-8e623671b6e0+28:15711:x1874622863778944:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787780180.665627:0:17243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787780180.665663:0:17243:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868200/0xc8fc0a5179961f0c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea2309 expref: -99 pid: 17243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780180.665932:0:17243:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869800/0xc8fc0a5179961f13 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780180.665948:0:17243:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869800/0xc8fc0a5179961f13 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780180.665961:0:17243:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869800/0xc8fc0a5179961f13 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17243 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787780180.665972:0:17243:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1787780180.666050:0:17243:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869800/0xc8fc0a5179961f13 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780180.666058:0:17243:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869800/0xc8fc0a5179961f13 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780180.666064:0:17243:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869800/0xc8fc0a5179961f13 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780180.666071:0:17243:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0477869800 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:1.0:1787780180.666075:0:17243:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869800/0xc8fc0a5179961f13 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780180.666083:0:17243:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869800/0xc8fc0a5179961f13 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780180.666096:0:17243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c0347a4e600) 00010000:00010000:1.0:1787780180.666099:0:17243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787780180.666103:0:17243:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869800/0xc8fc0a5179961f13 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780180.666120:0:17243:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869800/0xc8fc0a5179961f13 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780180.666170:0:17243:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868200/0xc8fc0a5179961f0c lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea2309 expref: 30 pid: 17243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780180.666181:0:17243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c0341cd4e00) 00010000:00010000:1.0:1787780180.666183:0:17243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787780180.666187:0:17243:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868200/0xc8fc0a5179961f0c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea2309 expref: 30 pid: 17243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780180.666196:0:17243:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0477868200, rc 0) 00000100:00100000:1.0:1787780180.666562:0:17243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0348a083c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e302a01-7f05-4001-b9ff-8e623671b6e0+29:15711:x1874622863778944:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 954us (1191us total) trans 8589934611 rc 301/301 00000100:00100000:1.0:1787780180.666570:0:17243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 51 00000100:00100000:2.0:1787780180.675213:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787780180.675322:0:17242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863779072 00000100:00100000:1.0:1787780180.675337:0:17242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863779072 00000100:00100000:1.0:1787780180.675425:0:17242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 52 00000100:00100000:1.0:1787780180.675436:0:17242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0348a08780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e302a01-7f05-4001-b9ff-8e623671b6e0+29:15711:x1874622863779072:12345-192.168.203.31@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787780180.675472:0:17242:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787780180.675615:0:17242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0348a08780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e302a01-7f05-4001-b9ff-8e623671b6e0+29:15711:x1874622863779072:12345-192.168.203.31@tcp:53:lhsmtool_posix.0 Request processed in 179us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780180.675622:0:17242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 52 00000100:00100000:1.0:1787780180.686819:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787780180.687281:0:19793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863779328 00000100:00100000:0.0:1787780180.687295:0:19793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863779328 00000100:00100000:0.0:1787780180.687386:0:19793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 53 00000100:00100000:0.0:1787780180.687426:0:19793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c048163cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e302a01-7f05-4001-b9ff-8e623671b6e0+29:15711:x1874622863779328:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787780180.687455:0:19793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787780180.687484:0:19793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0348c7ae00/0xc8fc0a5179961f21 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea2310 expref: -99 pid: 19793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787780180.688565:0:19793:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x6:0x0], count =28 00000004:00080000:0.0:1787780180.688577:0:19793:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x6:0x0]+28 in llog 00000004:00080000:0.0:1787780180.688603:0:19793:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x22:0x0], index 0: 0 00010000:00010000:0.0:1787780180.689156:0:19793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0348c7b200/0xc8fc0a5179961f28 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780180.689176:0:19793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0348c7b200/0xc8fc0a5179961f28 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780180.689190:0:19793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0348c7b200/0xc8fc0a5179961f28 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780180.689277:0:19793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0348c7ae00/0xc8fc0a5179961f21 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea2310 expref: 32 pid: 19793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780180.689301:0:19793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0348c7b200/0xc8fc0a5179961f28 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea2310 expref: 31 pid: 19793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780180.689312:0:19793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c0347bec000) 00010000:00010000:0.0:1787780180.689315:0:19793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787780180.689319:0:19793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0348c7b200, rc 0) 00000100:00100000:0.0:1787780180.689988:0:19793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c048163cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e302a01-7f05-4001-b9ff-8e623671b6e0+31:15711:x1874622863779328:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 2569us (3181us total) trans 8589934612 rc 0/0 00000100:00100000:0.0:1787780180.690000:0:19793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 53 00000100:00100000:2.0:1787780180.701000:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787780180.701525:0:17243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863779584 00000100:00100000:1.0:1787780180.701540:0:17243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863779584 00000100:00100000:1.0:1787780180.701639:0:17243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 54 00000100:00100000:1.0:1787780180.701659:0:17243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0348a09a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e302a01-7f05-4001-b9ff-8e623671b6e0+31:15711:x1874622863779584:12345-192.168.203.31@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787780180.701947:0:17243:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787780180.701986:0:17243:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0348c7b200/0xc8fc0a5179961f28 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea2310 expref: 31 pid: 19793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780180.702496:0:17243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c0347bec000) 00010000:00010000:1.0:1787780180.702514:0:17243:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787780180.702549:0:17243:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868200/0xc8fc0a5179961f36 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780180.702567:0:17243:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868200/0xc8fc0a5179961f36 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780180.702579:0:17243:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868200/0xc8fc0a5179961f36 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780180.702597:0:17243:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869800/0xc8fc0a5179961f3d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x56ee01b2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780180.702604:0:17243:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869800/0xc8fc0a5179961f3d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x56ee01b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780180.702610:0:17243:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869800/0xc8fc0a5179961f3d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x56ee01b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780180.703071:0:17243:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868200/0xc8fc0a5179961f36 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780180.703080:0:17243:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868200/0xc8fc0a5179961f36 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780180.703106:0:17243:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868200/0xc8fc0a5179961f36 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780180.703114:0:17243:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0477868200 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:1.0:1787780180.703119:0:17243:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868200/0xc8fc0a5179961f36 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780180.703129:0:17243:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868200/0xc8fc0a5179961f36 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780180.703139:0:17243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c0347a4ef00) 00010000:00010000:1.0:1787780180.703142:0:17243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787780180.703147:0:17243:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868200/0xc8fc0a5179961f36 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780180.703153:0:17243:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868200/0xc8fc0a5179961f36 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780180.703165:0:17243:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869800/0xc8fc0a5179961f3d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x56ee01b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780180.703171:0:17243:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869800/0xc8fc0a5179961f3d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x56ee01b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780180.703176:0:17243:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869800/0xc8fc0a5179961f3d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x56ee01b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780180.703181:0:17243:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0477869800 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:1.0:1787780180.703184:0:17243:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869800/0xc8fc0a5179961f3d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x56ee01b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780180.703200:0:17243:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869800/0xc8fc0a5179961f3d lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x56ee01b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780180.703208:0:17243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x56ee01b2 (ffff9c0341cd4f00) 00010000:00010000:1.0:1787780180.703211:0:17243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787780180.703214:0:17243:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869800/0xc8fc0a5179961f3d lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x56ee01b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780180.703219:0:17243:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869800/0xc8fc0a5179961f3d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x56ee01b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17243 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787780180.703348:0:17243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0348a09a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e302a01-7f05-4001-b9ff-8e623671b6e0+30:15711:x1874622863779584:12345-192.168.203.31@tcp:36:lhsmtool_posix.0 Request processed in 1688us (2360us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787780180.703358:0:17243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 54 00000100:00100000:2.0:1787780180.711132:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787780180.711253:0:20085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863779712 00000100:00100000:3.0:1787780180.711267:0:20085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863779712 00000100:00100000:3.0:1787780180.711346:0:20085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 55 00000100:00100000:3.0:1787780180.711359:0:20085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0348a0a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e302a01-7f05-4001-b9ff-8e623671b6e0+30:15711:x1874622863779712:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787780180.711891:0:20085:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787780180.711925:0:20085:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0481373a00/0xc8fc0a5179961f44 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea2317 expref: -99 pid: 20085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780180.711975:0:20085:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0481373400/0xc8fc0a5179961f4b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780180.711993:0:20085:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0481373400/0xc8fc0a5179961f4b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780180.712010:0:20085:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0481373400/0xc8fc0a5179961f4b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780180.717088:0:20085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0481373a00/0xc8fc0a5179961f44 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea2317 expref: 32 pid: 20085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780180.717130:0:20085:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0481373400/0xc8fc0a5179961f4b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea2317 expref: 31 pid: 20085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780180.717142:0:20085:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c0443d81200) 00010000:00010000:2.0:1787780180.717146:0:20085:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787780180.717150:0:20085:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0481373400, rc 0) 00000100:00100000:2.0:1787780180.717251:0:20085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0348a0a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e302a01-7f05-4001-b9ff-8e623671b6e0+31:15711:x1874622863779712:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 5893us (6131us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780180.717263:0:20085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 55 00000100:00100000:3.0:1787780180.721350:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787780180.721595:0:19793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863779968 00000100:00100000:0.0:1787780180.721607:0:19793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863779968 00000100:00100000:0.0:1787780180.721813:0:19793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 56 00000100:00100000:0.0:1787780180.721826:0:19793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046215de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e302a01-7f05-4001-b9ff-8e623671b6e0+31:15711:x1874622863779968:12345-192.168.203.31@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787780180.721961:0:19793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0348c7b800/0xc8fc0a5179961f52 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780180.721984:0:19793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0348c7b800/0xc8fc0a5179961f52 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780180.721998:0:19793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0348c7b800/0xc8fc0a5179961f52 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19793 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787780180.722243:0:19793:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:0.0:1787780180.722255:0:19793:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 588726415335ns, next at 589726412244ns, rc = 0 00000004:00010000:0.0:1787780180.722320:0:19793:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004f4216b6 reply state 0000000079fc9b75 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0348c7b800/0xc8fc0a5179961f52 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780180.722335:0:19793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0348c7b800/0xc8fc0a5179961f52 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780180.722342:0:19793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c0443d81200) 00010000:00010000:0.0:1787780180.722345:0:19793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1787780180.722349:0:19793:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787780180.722498:0:19793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046215de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e302a01-7f05-4001-b9ff-8e623671b6e0+33:15711:x1874622863779968:12345-192.168.203.31@tcp:36:lhsmtool_posix.0 Request processed in 674us (1161us total) trans 8589934613 rc 0/0 00000100:00100000:0.0:1787780180.722507:0:19793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 56 00000100:00100000:0.0:1787780180.726202:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787780180.726402:0:17243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863780096 00000100:00100000:2.0:1787780180.726414:0:17243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863780096 00000100:00100000:2.0:1787780180.726536:0:17243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 57 00000100:00100000:2.0:1787780180.726549:0:17243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346da5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e302a01-7f05-4001-b9ff-8e623671b6e0+33:15711:x1874622863780096:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787780180.726585:0:17243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787780180.726613:0:17243:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71400/0xc8fc0a5179961f59 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea231e expref: -99 pid: 17243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780180.726704:0:17243:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71400/0xc8fc0a5179961f59 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea231e expref: 34 pid: 17243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780180.726726:0:17243:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71400/0xc8fc0a5179961f59 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea231e expref: 34 pid: 17243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780180.726774:0:17243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c0443d81200) 00010000:00010000:2.0:1787780180.726778:0:17243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787780180.726783:0:17243:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0477a71400, rc 0) 00000100:00100000:2.0:1787780180.726923:0:17243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346da5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e302a01-7f05-4001-b9ff-8e623671b6e0+34:15711:x1874622863780096:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 376us (736us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780180.726931:0:17243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 57 00000100:00100000:2.0:1787780180.730347:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787780180.730462:0:19055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863780224 00000100:00100000:0.0:1787780180.730474:0:19055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863780224 00000100:00080000:3.0:1787780180.730637:0:17238:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787780180.730684:0:19055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 26 00000100:00100000:0.0:1787780180.730696:0:19055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0348a092c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e302a01-7f05-4001-b9ff-8e623671b6e0+5:2411:x1874622863780224:12345-192.168.203.31@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1787780180.731075:0:19055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0348a092c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e302a01-7f05-4001-b9ff-8e623671b6e0+6:2411:x1874622863780224:12345-192.168.203.31@tcp:2:lhsmtool_posix.0 Request processed in 381us (742us total) trans 8589934595 rc 0/0 00000100:00100000:0.0:1787780180.731084:0:19055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 26 00000100:00100000:3.0:1787780180.735058:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787780180.735203:0:17245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863780480 00000100:00100000:2.0:1787780180.735216:0:17245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863780480 00000100:00100000:2.0:1787780180.735291:0:17245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 9 00000100:00100000:2.0:1787780180.735303:0:17245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046215e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e302a01-7f05-4001-b9ff-8e623671b6e0+34:15711:x1874622863780480:12345-192.168.203.31@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787780180.735604:0:17245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046215e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e302a01-7f05-4001-b9ff-8e623671b6e0+35:15711:x1874622863780480:12345-192.168.203.31@tcp:35:lhsmtool_posix.0 Request processed in 303us (559us total) trans 8589934614 rc 0/0 00000100:00100000:2.0:1787780180.735613:0:17245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 9 00000100:00100000:2.0:1787780180.738764:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787780180.738877:0:20085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863780736 00000100:00100000:3.0:1787780180.738889:0:20085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863780736 00000100:00100000:3.0:1787780180.738948:0:20085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 58 00000100:00100000:3.0:1787780180.738958:0:20085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346eff0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e302a01-7f05-4001-b9ff-8e623671b6e0+35:15711:x1874622863780736:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787780180.739580:0:20085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346eff0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e302a01-7f05-4001-b9ff-8e623671b6e0+35:15711:x1874622863780736:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 Request processed in 617us (825us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780180.739589:0:20085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 58 00000100:00100000:2.0:1787780180.754590:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787780180.754742:0:19793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863780864 00000100:00100000:0.0:1787780180.754754:0:19793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863780864 00000100:00100000:0.0:1787780180.754869:0:19793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 59 00000100:00100000:0.0:1787780180.754882:0:19793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346efd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e302a01-7f05-4001-b9ff-8e623671b6e0+35:15711:x1874622863780864:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787780180.754910:0:19793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787780180.754937:0:19793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0348c7a200/0xc8fc0a5179961f60 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea2325 expref: -99 pid: 19793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780180.755033:0:19793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0348c7ba00/0xc8fc0a5179961f67 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 19793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780180.755051:0:19793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0348c7ba00/0xc8fc0a5179961f67 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780180.755065:0:19793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0348c7ba00/0xc8fc0a5179961f67 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787780180.755123:0:19793:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787780180.755148:0:19793:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c0348c7ba00/0xc8fc0a5179961f67 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780180.755179:0:19793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0348c7a200/0xc8fc0a5179961f60 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea2325 expref: 37 pid: 19793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780180.755237:0:19793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0348c7ba00/0xc8fc0a5179961f67 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea2325 expref: 36 pid: 19793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780180.755248:0:19793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c0443d81200) 00010000:00010000:0.0:1787780180.755251:0:19793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787780180.755255:0:19793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0348c7ba00, rc 0) 00000100:00100000:0.0:1787780180.755329:0:19793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346efd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e302a01-7f05-4001-b9ff-8e623671b6e0+36:15711:x1874622863780864:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 450us (753us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780180.755338:0:19793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 59 00000100:00100000:1.0:1787780180.765087:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346eff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881696512:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787780180.765193:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787780180.765288:0:18752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881696512 00000100:00100000:2.0:1787780180.765298:0:18752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881696512 00000100:00100000:2.0:1787780180.765371:0:18752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787780180.765383:0:18752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c048163c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881696512:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787780180.765413:0:18752:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1787780180.765504:0:18752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c048163c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881696512:12345-0@lo:13:osp-pre-0-1.0 Request processed in 124us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780180.765512:0:18752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787780180.765710:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346eff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881696512:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787780180.767062:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787780180.767206:0:18750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863780992 00000100:00100000:2.0:1787780180.767216:0:18750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863780992 00000100:00100000:2.0:1787780180.767290:0:18750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 27 00000100:00100000:2.0:1787780180.767303:0:18750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c048163e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e302a01-7f05-4001-b9ff-8e623671b6e0+6:2410:x1874622863780992:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787780180.767325:0:18750:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787780180.767352:0:18750:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007f62b933/0xc8fc0a5179961f6e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea232c expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787780180.767386:0:18750:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8f5c55, blocks: 0x0 00010000:00010000:2.0:1787780180.767409:0:18750:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=588s v=(0 0) 00010000:00010000:2.0:1787780180.767415:0:18750:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787780180.767437:0:18750:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007f62b933/0xc8fc0a5179961f6e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea232c expref: 7 pid: 18750 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780180.767460:0:18750:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007f62b933/0xc8fc0a5179961f6e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea232c expref: 7 pid: 18750 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780180.767476:0:18750:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0477a70800, rc 0) 00000100:00100000:2.0:1787780180.767546:0:18750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c048163e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e302a01-7f05-4001-b9ff-8e623671b6e0+7:2410:x1874622863780992:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 245us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780180.767554:0:18750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 27 00000100:00100000:1.0:1787780180.774095:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787780180.776971:0:17243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863781248 00000100:00100000:2.0:1787780180.776990:0:17243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863781248 00000100:00100000:3.0:1787780180.777902:0:17243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 60 00000100:00100000:3.0:1787780180.777919:0:17243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c048163da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e302a01-7f05-4001-b9ff-8e623671b6e0+36:15711:x1874622863781248:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787780180.778881:0:17243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c048163da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e302a01-7f05-4001-b9ff-8e623671b6e0+36:15711:x1874622863781248:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 Request processed in 960us (4792us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780180.778893:0:17243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 60 00000100:00100000:3.0:1787780180.791376:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787780180.791683:0:20085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863781376 00000100:00100000:2.0:1787780180.791697:0:20085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863781376 00000100:00100000:2.0:1787780180.791785:0:20085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 61 00000100:00100000:2.0:1787780180.791799:0:20085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c03488e12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e302a01-7f05-4001-b9ff-8e623671b6e0+36:15711:x1874622863781376:12345-192.168.203.31@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1787780180.795648:0:17222:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:2.0:1787780180.795680:0:17222:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:2.0:1787780180.795739:0:17222:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:2.0:1787780180.795982:0:20085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c03488e12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e302a01-7f05-4001-b9ff-8e623671b6e0+19:15711:x1874622863781376:12345-192.168.203.31@tcp:44:lhsmtool_posix.0 Request processed in 4177us (4611us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780180.795996:0:20085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 61 00000100:00100000:3.0:1787780180.796217:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787780180.796239:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c03488e30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881696640:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1787780180.796334:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787780180.796403:0:18751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881696640 00000100:00100000:3.0:1787780180.796413:0:18751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881696640 00000100:00100000:3.0:1787780180.796479:0:18751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787780180.796490:0:18751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477989e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1874622881696640:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1787780180.796677:0:18751:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1787780180.796698:0:18751:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1787780180.796700:0:18751:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1787780180.796703:0:18751:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1787780181 -> 1787780181 00002000:00010000:3.0:1787780180.796705:0:18751:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1787780180.796744:0:18751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477989e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3642:x1874622881696640:12345-0@lo:2:osp-syn-0-0.0 Request processed in 256us (411us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1787780180.796751:0:18751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000004:00080000:3.0:1787780180.796805:0:3642:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c03488e30c0/2, rc 0, transno 8589934596 00000100:00100000:3.0:1787780180.796812:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c03488e30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881696640:0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1787780180.797167:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0440030000/0xc8fc0a5179961dfb lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780180.797179:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0440030000/0xc8fc0a5179961dfb lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 20085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780180.797188:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0440030000/0xc8fc0a5179961dfb lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780180.797204:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0440030000 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:1.0:1787780180.797210:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0440030000/0xc8fc0a5179961dfb lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780180.797218:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0440030000/0xc8fc0a5179961dfb lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 20085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780180.797237:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c0347a4ef00) 00010000:00010000:1.0:1787780180.797241:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1787780180.797246:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0440030000/0xc8fc0a5179961dfb lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780180.797253:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0440030000/0xc8fc0a5179961dfb lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780180.800037:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869c00/0xc8fc0a5179961da7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780180.800058:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869c00/0xc8fc0a5179961da7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780180.800067:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869c00/0xc8fc0a5179961da7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780180.800074:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0477869c00 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:3.0:1787780180.800079:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869c00/0xc8fc0a5179961da7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780180.800087:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869c00/0xc8fc0a5179961da7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780180.800108:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9c0341cd4500) 00010000:00010000:3.0:1787780180.800112:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787780180.800117:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869c00/0xc8fc0a5179961da7 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780180.800144:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869c00/0xc8fc0a5179961da7 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780180.800171:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71200/0xc8fc0a5179961dae lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780180.800176:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71200/0xc8fc0a5179961dae lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780180.800182:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71200/0xc8fc0a5179961dae lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780180.800187:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0477a71200 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:3.0:1787780180.800190:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71200/0xc8fc0a5179961dae lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780180.800196:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71200/0xc8fc0a5179961dae lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780180.800204:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c0347a4ef00) 00010000:00010000:3.0:1787780180.800206:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787780180.800209:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71200/0xc8fc0a5179961dae lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780180.800214:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71200/0xc8fc0a5179961dae lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780180.800229:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71800/0xc8fc0a5179961e56 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780180.800235:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71800/0xc8fc0a5179961e56 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780180.800246:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71800/0xc8fc0a5179961e56 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780180.800252:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0477a71800 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:3.0:1787780180.800255:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71800/0xc8fc0a5179961e56 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780180.800261:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71800/0xc8fc0a5179961e56 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780180.800268:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9c0347a4e300) 00010000:00010000:3.0:1787780180.800270:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787780180.800272:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71800/0xc8fc0a5179961e56 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780180.800279:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71800/0xc8fc0a5179961e56 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780180.800295:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868600/0xc8fc0a5179961edb lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780180.800377:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868600/0xc8fc0a5179961edb lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780180.800383:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868600/0xc8fc0a5179961edb lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780180.800389:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0477868600 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:3.0:1787780180.800392:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868600/0xc8fc0a5179961edb lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780180.800407:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868600/0xc8fc0a5179961edb lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780180.800430:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c0347a4e600) 00010000:00010000:3.0:1787780180.800433:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787780180.800436:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868600/0xc8fc0a5179961edb lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780180.800442:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868600/0xc8fc0a5179961edb lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780180.800456:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0348c7b800/0xc8fc0a5179961f52 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780180.800462:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0348c7b800/0xc8fc0a5179961f52 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780180.800468:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0348c7b800/0xc8fc0a5179961f52 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780180.800473:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0348c7b800 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:3.0:1787780180.800475:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0348c7b800/0xc8fc0a5179961f52 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780180.800481:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0348c7b800/0xc8fc0a5179961f52 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780180.800488:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c0443d81200) 00010000:00010000:3.0:1787780180.800490:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787780180.800493:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0348c7b800/0xc8fc0a5179961f52 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780180.800508:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0348c7b800/0xc8fc0a5179961f52 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787780180.802264:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787780180.802532:0:18750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863781504 00000100:00100000:2.0:1787780180.802546:0:18750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863781504 00000100:00100000:2.0:1787780180.802620:0:18750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 29 00000100:00100000:2.0:1787780180.802632:0:18750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c048163f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e302a01-7f05-4001-b9ff-8e623671b6e0+7:2410:x1874622863781504:12345-192.168.203.31@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1787780180.802794:0:18750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c048163f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e302a01-7f05-4001-b9ff-8e623671b6e0+7:2410:x1874622863781504:12345-192.168.203.31@tcp:16:lhsmtool_posix.0 Request processed in 164us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780180.802803:0:18750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 29 00000100:00100000:1.0:1787780180.806106:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787780180.806211:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863781760 00000100:00100000:2.0:1787780180.806224:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863781760 00000100:00100000:2.0:1787780180.806307:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 62 00000100:00100000:2.0:1787780180.806320:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c048163fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e302a01-7f05-4001-b9ff-8e623671b6e0+15:15711:x1874622863781760:12345-192.168.203.31@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787780180.806397:0:17244:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787780180.806447:0:17244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0348c7ba00/0xc8fc0a5179961f67 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea2325 expref: 15 pid: 19793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780180.806471:0:17244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c0443d81200) 00010000:00010000:2.0:1787780180.806477:0:17244:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787780180.806517:0:17244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71600/0xc8fc0a5179961f75 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780180.806534:0:17244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71600/0xc8fc0a5179961f75 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780180.806566:0:17244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71600/0xc8fc0a5179961f75 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17244 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787780180.806739:0:17244:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c9242fc0 reply state 00000000b4d889d4 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71600/0xc8fc0a5179961f75 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780180.806754:0:17244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71600/0xc8fc0a5179961f75 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780180.806761:0:17244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c0443d81200) 00010000:00010000:2.0:1787780180.806764:0:17244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787780180.806767:0:17244:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787780180.806929:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c048163fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e302a01-7f05-4001-b9ff-8e623671b6e0+16:15711:x1874622863781760:12345-192.168.203.31@tcp:36:lhsmtool_posix.0 Request processed in 611us (837us total) trans 8589934615 rc 0/0 00000100:00100000:2.0:1787780180.806937:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 62 00000100:00100000:3.0:1787780180.809913:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787780180.810060:0:18751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863781888 00000100:00100000:1.0:1787780180.810073:0:18751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863781888 00000100:00100000:1.0:1787780180.810144:0:18751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 30 00000100:00100000:1.0:1787780180.810157:0:18751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477988b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e302a01-7f05-4001-b9ff-8e623671b6e0+7:15711:x1874622863781888:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787780180.810183:0:18751:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787780180.810208:0:18751:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003ebef227/0xc8fc0a5179961f7c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea2333 expref: -99 pid: 18751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780180.810250:0:18751:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007f62b933/0xc8fc0a5179961f6e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea232c expref: 8 pid: 18750 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780180.810284:0:18751:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787780180.810290:0:18751:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787780180.810296:0:18751:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003ebef227/0xc8fc0a5179961f7c lrc: 4/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea2333 expref: 8 pid: 18751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780180.810415:0:18751:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007f62b933/0xc8fc0a5179961f6e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea232c expref: 8 pid: 18750 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780180.810440:0:18751:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007f62b933/0xc8fc0a5179961f6e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea232c expref: 8 pid: 18750 timeout: 688 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787780180.810457:0:18751:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c048163de00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:18751:1874622881696768:192.168.203.31@tcp:104: 00000100:00100000:1.0:1787780180.810567:0:18751:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0444eb3c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787780180.815151:0:18751:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c048163de00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:18751:1874622881696768:192.168.203.31@tcp:104: 00010000:00010000:1.0:1787780180.815201:0:18751:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003ebef227/0xc8fc0a5179961f7c lrc: 3/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0xf757128131ea2333 expref: 8 pid: 18751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780180.815229:0:18751:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0477868800, rc 0) 00000100:00100000:1.0:1787780180.815322:0:18751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477988b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e302a01-7f05-4001-b9ff-8e623671b6e0+8:15711:x1874622863781888:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 5167us (5427us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780180.815333:0:18751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 30 00000100:00100000:2.0:1787780180.817946:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787780180.818223:0:17227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863782016 00000100:00100000:1.0:1787780180.818237:0:17227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863782016 00010000:00010000:1.0:1787780180.818324:0:17227:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007f62b933/0xc8fc0a5179961f6e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea232c expref: 8 pid: 18750 timeout: 688 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787780180.818377:0:17227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 19 00000100:00100000:1.0:1787780180.818388:0:17227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346efcf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e302a01-7f05-4001-b9ff-8e623671b6e0+8:2410:x1874622863782016:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787780180.818407:0:17227:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787780180.818448:0:17227:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007f62b933/0xc8fc0a5179961f6e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea232c expref: 8 pid: 18750 timeout: 688 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780180.818466:0:17227:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007f62b933/0xc8fc0a5179961f6e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea232c expref: 8 pid: 18750 timeout: 688 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780180.818496:0:17227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007f62b933/0xc8fc0a5179961f6e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea232c expref: 8 pid: 18750 timeout: 688 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780180.818517:0:17227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787780180.818522:0:17227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787780180.818531:0:17227:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003ebef227/0xc8fc0a5179961f7c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.31@tcp remote: 0xf757128131ea2333 expref: 7 pid: 18751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780180.818544:0:17227:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003ebef227/0xc8fc0a5179961f7c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.31@tcp remote: 0xf757128131ea2333 expref: 7 pid: 18751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780180.818592:0:17227:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000003ebef227/0xc8fc0a5179961f7c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0xf757128131ea2333 expref: 7 pid: 18751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787780180.818624:0:17227:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c048163de00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:17227:1874622881696896:192.168.203.31@tcp:105: 00000100:00100000:1.0:1787780180.819281:0:17227:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0444eb3c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787780180.826084:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787780180.826205:0:18750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863782144 00000100:00100000:0.0:1787780180.826218:0:18750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863782144 00000100:00100000:0.0:1787780180.826312:0:18750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 31 00000100:00100000:0.0:1787780180.826326:0:18750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346efe1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e302a01-7f05-4001-b9ff-8e623671b6e0+8:2411:x1874622863782144:12345-192.168.203.31@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1787780180.826541:0:18750:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1787780180.826546:0:18750:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 0 -> 1787780180 00002000:00010000:0.0:1787780180.826549:0:18750:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb atime from disk: 0 -> 1787780179 00002000:00010000:0.0:1787780180.826552:0:18750:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1787780181 -> 1787780180 00002000:00010000:0.0:1787780180.826554:0:18750:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1787780180.826635:0:18750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346efe1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e302a01-7f05-4001-b9ff-8e623671b6e0+9:2411:x1874622863782144:12345-192.168.203.31@tcp:2:lhsmtool_posix.0 Request processed in 312us (566us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1787780180.826644:0:18750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 31 00000100:00100000:1.0:1787780180.827740:0:17227:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c048163de00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:17227:1874622881696896:192.168.203.31@tcp:105: 00010000:00010000:1.0:1787780180.827932:0:17227:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787780180.827999:0:17227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346efcf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e302a01-7f05-4001-b9ff-8e623671b6e0+8:2410:x1874622863782016:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 9612us (10068us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780180.828011:0:17227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 19 00000100:00100000:2.0:1787780180.832036:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787780180.832147:0:19055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863782272 00000100:00100000:3.0:1787780180.832160:0:19055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863782272 00000100:00100000:3.0:1787780180.832239:0:19055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 32 00000100:00100000:3.0:1787780180.832252:0:19055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346efda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e302a01-7f05-4001-b9ff-8e623671b6e0+8:2408:x1874622863782272:12345-192.168.203.31@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787780180.832323:0:19055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f6f8db85/0xc8fc0a5179961f83 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780180.832349:0:19055:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003ebef227/0xc8fc0a5179961f7c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0xf757128131ea2333 expref: 8 pid: 18751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780180.832359:0:19055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787780180.832364:0:19055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787780180.832369:0:19055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6f8db85/0xc8fc0a5179961f83 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780180.832425:0:19055:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003ebef227/0xc8fc0a5179961f7c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.31@tcp remote: 0xf757128131ea2333 expref: 8 pid: 18751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787780180.832444:0:19055:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003ebef227/0xc8fc0a5179961f7c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.31@tcp remote: 0xf757128131ea2333 expref: 8 pid: 18751 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787780180.832462:0:19055:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047798b0c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:19055:1874622881697024:192.168.203.31@tcp:104: 00000100:00100000:3.0:1787780180.832595:0:19055:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0341c61600 going to sleep for 11 seconds 00000100:00100000:3.0:1787780180.836140:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787780180.836232:0:17228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863782400 00000100:00100000:2.0:1787780180.836243:0:17228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863782400 00010000:00010000:2.0:1787780180.836294:0:17228:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003ebef227/0xc8fc0a5179961f7c lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.31@tcp remote: 0xf757128131ea2333 expref: 9 pid: 18751 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787780180.836350:0:17228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 20 00000100:00100000:2.0:1787780180.836360:0:17228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477989a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e302a01-7f05-4001-b9ff-8e623671b6e0+9:2411:x1874622863782400:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787780180.836379:0:17228:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787780180.836409:0:17228:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003ebef227/0xc8fc0a5179961f7c lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.31@tcp remote: 0xf757128131ea2333 expref: 9 pid: 18751 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780180.836450:0:17228:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003ebef227/0xc8fc0a5179961f7c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.31@tcp remote: 0xf757128131ea2333 expref: 9 pid: 18751 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780180.836485:0:17228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787780180.836490:0:17228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787780180.836498:0:17228:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f6f8db85/0xc8fc0a5179961f83 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780180.836510:0:17228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6f8db85/0xc8fc0a5179961f83 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780180.836536:0:17228:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787780180.836613:0:17228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477989a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e302a01-7f05-4001-b9ff-8e623671b6e0+9:2411:x1874622863782400:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 254us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780180.836622:0:17228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 20 00010000:00010000:0.0:1787780180.837227:0:19055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003ebef227/0xc8fc0a5179961f7c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.31@tcp remote: 0xf757128131ea2333 expref: 8 pid: 18751 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787780180.837259:0:19055:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047798b0c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:19055:1874622881697024:192.168.203.31@tcp:104: 00010000:00010000:0.0:1787780180.837311:0:19055:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f6f8db85/0xc8fc0a5179961f83 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780180.837324:0:19055:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f6f8db85/0xc8fc0a5179961f83 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780180.837332:0:19055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f6f8db85/0xc8fc0a5179961f83 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780180.837361:0:19055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f6f8db85/0xc8fc0a5179961f83 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780180.837372:0:19055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f6f8db85/0xc8fc0a5179961f83 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780180.837381:0:19055:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f6f8db85/0xc8fc0a5179961f83 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780180.837388:0:19055:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0481373200 already unused, calling callback (ffffffffc0d97420) 00010000:00010000:0.0:1787780180.837393:0:19055:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6f8db85/0xc8fc0a5179961f83 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780180.837402:0:19055:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6f8db85/0xc8fc0a5179961f83 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780180.837429:0:19055:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f6f8db85/0xc8fc0a5179961f83 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780180.837447:0:19055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f6f8db85/0xc8fc0a5179961f83 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787780180.837526:0:19055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346efda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e302a01-7f05-4001-b9ff-8e623671b6e0+7:2408:x1874622863782272:12345-192.168.203.31@tcp:1:lhsmtool_posix.0 Request processed in 5276us (5506us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780180.837537:0:19055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 32 00000100:00100000:3.0:1787780180.842223:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787780180.842413:0:17243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863782656 00000100:00100000:1.0:1787780180.842438:0:17243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863782656 00000100:00100000:1.0:1787780180.842522:0:17243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 63 00000100:00100000:1.0:1787780180.842535:0:17243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c047798bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e302a01-7f05-4001-b9ff-8e623671b6e0+16:15711:x1874622863782656:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787780180.842657:0:17243:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869200/0xc8fc0a5179961f8a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780180.842902:0:17243:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0348c7aa00/0xc8fc0a5179961ed4 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea22f4 expref: 16 pid: 19793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780180.842916:0:17243:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869200/0xc8fc0a5179961f8a lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780180.842965:0:17243:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c0348c7aa00/0xc8fc0a5179961ed4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea22f4 expref: 16 pid: 19793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780180.842983:0:17243:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0348c7aa00/0xc8fc0a5179961ed4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea22f4 expref: 16 pid: 19793 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787780180.843027:0:17243:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c048163de00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17243:1874622881697152:192.168.203.31@tcp:104: 00000100:00100000:1.0:1787780180.843147:0:17243:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0444eb3c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787780180.851129:0:17243:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c048163de00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17243:1874622881697152:192.168.203.31@tcp:104: 00010000:00010000:1.0:1787780180.851169:0:17243:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869200/0xc8fc0a5179961f8a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17243 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787780180.851329:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787780180.851511:0:17229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863782784 00000100:00100000:0.0:1787780180.851520:0:17229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863782784 00010000:00010000:0.0:1787780180.851572:0:17229:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0348c7aa00/0xc8fc0a5179961ed4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea22f4 expref: 17 pid: 19793 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787780180.851617:0:17229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 21 00000100:00100000:0.0:1787780180.851627:0:17229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477988000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e302a01-7f05-4001-b9ff-8e623671b6e0+17:2410:x1874622863782784:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787780180.851647:0:17229:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787780180.851655:0:17229:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c0348c7aa00/0xc8fc0a5179961ed4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea22f4 expref: 17 pid: 19793 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780180.851978:0:17229:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c0348c7aa00/0xc8fc0a5179961ed4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea22f4 expref: 17 pid: 19793 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780180.852012:0:17229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0348c7aa00/0xc8fc0a5179961ed4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea22f4 expref: 17 pid: 19793 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780180.852034:0:17229:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c0347a4e600) 00010000:00010000:0.0:1787780180.852042:0:17229:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0481373e00/0xc8fc0a5179961ef0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea2302 expref: 16 pid: 20085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780180.852071:0:17229:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869200/0xc8fc0a5179961f8a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780180.852081:0:17229:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869200/0xc8fc0a5179961f8a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780180.852091:0:17229:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869200/0xc8fc0a5179961f8a lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787780180.852159:0:17229:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787780180.852233:0:17229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477988000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e302a01-7f05-4001-b9ff-8e623671b6e0+16:2410:x1874622863782784:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 606us (905us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780180.852243:0:17229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 21 00010000:00010000:1.0:1787780180.853410:0:17243:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869200/0xc8fc0a5179961f8a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780180.853540:0:17243:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869200/0xc8fc0a5179961f8a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780180.854597:0:17243:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868c00/0xc8fc0a5179961f91 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780180.854625:0:17243:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71400/0xc8fc0a5179961f59 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea231e expref: 16 pid: 17243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780180.854636:0:17243:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868c00/0xc8fc0a5179961f91 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780180.854763:0:17243:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71400/0xc8fc0a5179961f59 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea231e expref: 16 pid: 17243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780180.855031:0:17243:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71400/0xc8fc0a5179961f59 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea231e expref: 16 pid: 17243 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787780180.855053:0:17243:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c048163de00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17243:1874622881697280:192.168.203.31@tcp:104: 00000100:00100000:1.0:1787780180.855263:0:17243:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0444eb3900 going to sleep for 11 seconds 00000100:00100000:0.0:1787780180.859287:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787780180.859514:0:17228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863782912 00000100:00100000:2.0:1787780180.859528:0:17228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863782912 00010000:00010000:2.0:1787780180.859585:0:17228:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71400/0xc8fc0a5179961f59 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea231e expref: 17 pid: 17243 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787780180.859644:0:17228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 22 00000100:00100000:2.0:1787780180.859665:0:17228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346da61c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e302a01-7f05-4001-b9ff-8e623671b6e0+17:2411:x1874622863782912:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787780180.859687:0:17228:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787780180.859697:0:17228:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71400/0xc8fc0a5179961f59 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea231e expref: 17 pid: 17243 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780180.859737:0:17228:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71400/0xc8fc0a5179961f59 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea231e expref: 17 pid: 17243 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780180.859769:0:17228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c0443d81200) 00010000:00010000:2.0:1787780180.859885:0:17228:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868c00/0xc8fc0a5179961f91 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780180.859897:0:17228:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868c00/0xc8fc0a5179961f91 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 17243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780180.859906:0:17228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868c00/0xc8fc0a5179961f91 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 17243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780180.859935:0:17228:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787780180.860008:0:17228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346da61c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e302a01-7f05-4001-b9ff-8e623671b6e0+17:2411:x1874622863782912:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 354us (738us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780180.860017:0:17228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 22 00010000:00010000:1.0:1787780180.860195:0:17243:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71400/0xc8fc0a5179961f59 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.31@tcp remote: 0xf757128131ea231e expref: 16 pid: 17243 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787780180.860217:0:17243:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c048163de00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17243:1874622881697280:192.168.203.31@tcp:104: 00010000:00010000:1.0:1787780180.860247:0:17243:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868c00/0xc8fc0a5179961f91 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780180.860258:0:17243:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868c00/0xc8fc0a5179961f91 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780180.860265:0:17243:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868c00/0xc8fc0a5179961f91 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17243 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787780180.860425:0:17243:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:1.0:1787780180.860572:0:17243:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:1.0:1787780180.860618:0:17243:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:1.0:1787780180.860716:0:17243:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c048163de00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:17243:1874622881697408:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787780180.861082:0:17243:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780180.861150:0:17243:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0444eb3780 going to sleep for 11 seconds 00000100:00100000:0.0:1787780180.866295:0:17248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881697408 00000100:00100000:0.0:1787780180.866320:0:17248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881697408 00000100:00100000:0.0:1787780180.866432:0:17248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787780180.866446:0:17248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c048163c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17243:x1874622881697408:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787780180.867039:0:17248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c048163c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17243:x1874622881697408:12345-0@lo:1000:mdt00_001.0 Request processed in 595us (5955us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780180.867049:0:17248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787780180.867277:0:17243:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c048163de00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:17243:1874622881697408:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1787780180.867651:0:17243:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:2.0:1787780180.868064:0:17243:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0346eff480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:17243:1874622881697536:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1787780180.868166:0:17243:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787780180.868253:0:17243:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0445fbf540 going to sleep for 11 seconds 00000100:00100000:3.0:1787780180.868303:0:17247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881697536 00000100:00100000:3.0:1787780180.868311:0:17247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881697536 00000100:00100000:3.0:1787780180.868401:0:17247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787780180.868413:0:17247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046e9bda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17243:x1874622881697536:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787780180.868609:0:17247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046e9bda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:17243:x1874622881697536:12345-0@lo:1000:mdt00_001.0 Request processed in 199us (443us total) trans 8589934598 rc 0/0 00000100:00100000:3.0:1787780180.868618:0:17247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787780180.868700:0:17243:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0346eff480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:17243:1874622881697536:0@lo:1000:mdt00_001.0 00010000:00010000:1.0:1787780180.868756:0:17243:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868c00/0xc8fc0a5179961f91 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780180.868780:0:17243:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868c00/0xc8fc0a5179961f91 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780180.868788:0:17243:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868c00/0xc8fc0a5179961f91 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780180.868810:0:17243:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0477868c00 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:1.0:1787780180.868816:0:17243:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868c00/0xc8fc0a5179961f91 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780180.868825:0:17243:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868c00/0xc8fc0a5179961f91 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780180.868874:0:17243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c0443d81200) 00010000:00010000:1.0:1787780180.868878:0:17243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787780180.868884:0:17243:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868c00/0xc8fc0a5179961f91 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780180.868891:0:17243:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477868c00/0xc8fc0a5179961f91 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780180.868931:0:17243:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0348c7b400/0xc8fc0a5179961ee9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 19793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780180.868938:0:17243:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0348c7b400/0xc8fc0a5179961ee9 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 19793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780180.868945:0:17243:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0348c7b400/0xc8fc0a5179961ee9 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 19793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780180.868949:0:17243:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0348c7b400 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:1.0:1787780180.868952:0:17243:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0348c7b400/0xc8fc0a5179961ee9 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 19793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780180.868959:0:17243:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0348c7b400/0xc8fc0a5179961ee9 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 19793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780180.868980:0:17243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c0347a4e600) 00010000:00010000:1.0:1787780180.868982:0:17243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787780180.868991:0:17243:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0481373e00/0xc8fc0a5179961ef0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea2302 expref: 19 pid: 20085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780180.869004:0:17243:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0481373e00/0xc8fc0a5179961ef0 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea2302 expref: 19 pid: 20085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780180.869016:0:17243:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0481373e00/0xc8fc0a5179961ef0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea2302 expref: 19 pid: 20085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780180.869080:0:17243:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c0481373e00/0xc8fc0a5179961ef0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea2302 expref: 19 pid: 20085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787780180.869094:0:17243:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c048163ed00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17243:1874622881697664:192.168.203.31@tcp:105: 00000100:00100000:1.0:1787780180.869186:0:17243:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0444eb3000 going to sleep for 11 seconds 00000100:00100000:0.0:1787780180.872788:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787780180.872997:0:17245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863783040 00000100:00100000:3.0:1787780180.873009:0:17245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863783040 00000100:00100000:3.0:1787780180.873082:0:17245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 10 00000100:00100000:3.0:1787780180.873094:0:17245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c044778a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e302a01-7f05-4001-b9ff-8e623671b6e0+20:15710:x1874622863783040:12345-192.168.203.31@tcp:49:dd.0 00000100:00100000:3.0:1787780180.873280:0:17245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c044778a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e302a01-7f05-4001-b9ff-8e623671b6e0+20:15710:x1874622863783040:12345-192.168.203.31@tcp:49:dd.0 Request processed in 187us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780180.873290:0:17245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 10 00000100:00100000:3.0:1787780180.876525:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787780180.876669:0:20085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863783168 00000100:00100000:2.0:1787780180.876683:0:20085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863783168 00000100:00100000:2.0:1787780180.876763:0:20085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 64 00000100:00100000:2.0:1787780180.876782:0:20085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c047798a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e302a01-7f05-4001-b9ff-8e623671b6e0+20:15710:x1874622863783168:12345-192.168.203.31@tcp:101:dd.0 00010000:00010000:2.0:1787780180.876812:0:20085:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787780180.876873:0:20085:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71c00/0xc8fc0a5179961f98 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf757128131ea233a expref: -99 pid: 20085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780180.876945:0:20085:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71e00/0xc8fc0a5179961f9f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 20085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780180.876960:0:20085:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869200/0xc8fc0a5179961f8a lrc: 2/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780180.876971:0:20085:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71e00/0xc8fc0a5179961f9f lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 20085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780180.876996:0:20085:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869200/0xc8fc0a5179961f8a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 17243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780180.877010:0:20085:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71e00/0xc8fc0a5179961f9f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20085 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787780180.877072:0:17243:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c048163ed00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17243:1874622881697664:192.168.203.31@tcp:105: 00010000:00010000:2.0:1787780180.877098:0:17243:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0348c7b400/0xc8fc0a5179961ee9 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x44a19400000020 pid: 19793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780180.877107:0:17243:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0348c7b400/0xc8fc0a5179961ee9 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x44a19400000020 pid: 19793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780180.877133:0:17243:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70c00/0xc8fc0a5179961fa6 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780180.877144:0:17243:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70c00/0xc8fc0a5179961fa6 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780180.877158:0:17243:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70c00/0xc8fc0a5179961fa6 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780180.877180:0:17243:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70c00/0xc8fc0a5179961fa6 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780180.877187:0:17243:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70c00/0xc8fc0a5179961fa6 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780180.877195:0:17243:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70c00/0xc8fc0a5179961fa6 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780180.877201:0:17243:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0477a70c00 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:2.0:1787780180.877204:0:17243:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70c00/0xc8fc0a5179961fa6 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780180.877211:0:17243:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70c00/0xc8fc0a5179961fa6 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780180.877223:0:17243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c0347a4e600) 00010000:00010000:2.0:1787780180.877227:0:17243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787780180.877230:0:17243:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70c00/0xc8fc0a5179961fa6 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780180.877236:0:17243:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70c00/0xc8fc0a5179961fa6 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780180.877246:0:17243:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869200/0xc8fc0a5179961f8a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 17243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780180.877252:0:17243:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869200/0xc8fc0a5179961f8a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 17243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780180.877258:0:17243:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869200/0xc8fc0a5179961f8a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 17243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780180.877268:0:17243:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0477869200 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:2.0:1787780180.877272:0:17243:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869200/0xc8fc0a5179961f8a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 17243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780180.877277:0:17243:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869200/0xc8fc0a5179961f8a lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40218400000020 pid: 17243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780180.877285:0:17243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c0347a4e600) 00010000:00010000:2.0:1787780180.877287:0:17243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787780180.877290:0:17243:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71e00/0xc8fc0a5179961f9f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780180.877298:0:17243:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71e00/0xc8fc0a5179961f9f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 20085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780180.877305:0:17243:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71e00/0xc8fc0a5179961f9f lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 20085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780180.877325:0:17243:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869200/0xc8fc0a5179961f8a lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 17243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780180.877332:0:17243:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477869200/0xc8fc0a5179961f8a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 17243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780180.877353:0:20085:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71e00/0xc8fc0a5179961f9f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780180.877359:0:20085:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71e00/0xc8fc0a5179961f9f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780180.877509:0:20085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71c00/0xc8fc0a5179961f98 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea233a expref: 22 pid: 20085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780180.877530:0:20085:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a71e00/0xc8fc0a5179961f9f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0xf757128131ea233a expref: 21 pid: 20085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780180.877538:0:20085:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c0347a4e600) 00010000:00010000:2.0:1787780180.877540:0:20085:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787780180.877542:0:20085:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0477a71e00, rc 0) 00000100:00100000:2.0:1787780180.877610:0:20085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c047798a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e302a01-7f05-4001-b9ff-8e623671b6e0+21:15710:x1874622863783168:12345-192.168.203.31@tcp:101:dd.0 Request processed in 830us (1101us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780180.877617:0:20085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 64 00000040:00080000:2.0:1787780180.877900:0:17278:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1787780180.877905:0:17278:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787780180.877921:0:17278:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1787780180.877927:0:17278:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1787780180.878002:0:17243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c047798bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e302a01-7f05-4001-b9ff-8e623671b6e0+20:15711:x1874622863782656:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 Request processed in 35470us (35794us total) trans 8589934620 rc 0/0 00000100:00100000:2.0:1787780180.878011:0:17243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 63 00000020:00080000:2.0:1787780180.878015:0:17243:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1787780180.884635:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1787780180.885127:0:17245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863783424 00000100:00100000:2.0:1787780180.885141:0:17245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863783424 00000100:00100000:2.0:1787780180.885223:0:17245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 11 00000100:00100000:2.0:1787780180.885236:0:17245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477988f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e302a01-7f05-4001-b9ff-8e623671b6e0+20:15711:x1874622863783424:12345-192.168.203.31@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1787780180.885629:0:17245:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787780180.888111:0:17245:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:2.0:1787780180.888223:0:17245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70a00/0xc8fc0a5179961fad lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780180.888273:0:17245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70a00/0xc8fc0a5179961fad lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 17245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780180.888288:0:17245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70a00/0xc8fc0a5179961fad lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780180.888298:0:17245:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70a00/0xc8fc0a5179961fad lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780180.888305:0:17245:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70a00/0xc8fc0a5179961fad lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780180.888312:0:17245:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70a00/0xc8fc0a5179961fad lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787780180.888338:0:17245:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787780180.888505:0:17245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477988f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e302a01-7f05-4001-b9ff-8e623671b6e0+22:15711:x1874622863783424:12345-192.168.203.31@tcp:35:lhsmtool_posix.0 Request processed in 3266us (3880us total) trans 8589934622 rc 0/0 00000100:00100000:2.0:1787780180.888517:0:17245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 11 00000020:00080000:2.0:1787780180.888524:0:17245:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787780180.890532:0:17231:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787780180.890551:0:17231:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70a00/0xc8fc0a5179961fad lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780180.890566:0:17231:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0477a70a00 already unused, calling callback (ffffffffc0d97420) 00010000:00010000:1.0:1787780180.890572:0:17231:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70a00/0xc8fc0a5179961fad lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780180.890584:0:17231:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70a00/0xc8fc0a5179961fad lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 17245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780180.890611:0:17231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c0443d81200) 00010000:00010000:1.0:1787780180.890637:0:17231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787780180.890645:0:17231:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70a00/0xc8fc0a5179961fad lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780180.890651:0:17231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0477a70a00/0xc8fc0a5179961fad lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780180.890690:0:17231:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787780180.890692:0:17231:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787780180.890694:0:17231:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787780181.044971:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787780181.045019:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1787780181.045138:0:18755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863783552 00000100:00100000:1.0:1787780181.045152:0:18755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863783552 00000100:00100000:1.0:1787780181.045229:0:18755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863783680 00000100:00100000:1.0:1787780181.045232:0:18755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863783680 00000100:00100000:1.0:1787780181.045250:0:18755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 0 00000100:00100000:1.0:1787780181.045260:0:18755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0346da7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6e302a01-7f05-4001-b9ff-8e623671b6e0+8:2408:x1874622863783552:12345-192.168.203.31@tcp:4:dd.0 00002000:00010000:1.0:1787780181.045322:0:18755:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x6a8f5c54, atime: 0x6a8f5c53, ctime: 0x6a8f5c54, blocks: 0x0 00010000:00010000:1.0:1787780181.045333:0:18755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd4d065d/0xc8fc0a5179961fb4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780181.045356:0:18755:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=589s v=(0 0) 00010000:00010000:1.0:1787780181.045362:0:18755:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787780181.045375:0:18755:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cd4d065d/0xc8fc0a5179961fb4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780181.045398:0:18755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cd4d065d/0xc8fc0a5179961fb4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787780181.162554:0:18745:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934599 is committed 00000001:00080000:0.0:1787780181.162572:0:18745:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00002000:00010000:1.0:1787780181.163023:0:18755:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 4194304 00002000:00010000:1.0:1787780181.163039:0:18755:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 1787780180 -> 1787780181 00002000:00010000:1.0:1787780181.163041:0:18755:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1787780180 -> 1787780181 00002000:00010000:1.0:1787780181.163044:0:18755:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 8192 00010000:00010000:1.0:1787780181.163063:0:18755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd4d065d/0xc8fc0a5179961fb4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780181.163076:0:18755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cd4d065d/0xc8fc0a5179961fb4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780181.163085:0:18755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cd4d065d/0xc8fc0a5179961fb4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780181.163093:0:18755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0477868c00 already unused, calling callback (ffffffffc0d97420) 00010000:00010000:1.0:1787780181.163098:0:18755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd4d065d/0xc8fc0a5179961fb4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780181.163106:0:18755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd4d065d/0xc8fc0a5179961fb4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780181.163125:0:18755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cd4d065d/0xc8fc0a5179961fb4 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780181.163134:0:18755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cd4d065d/0xc8fc0a5179961fb4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787780181.163242:0:18755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0346da7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6e302a01-7f05-4001-b9ff-8e623671b6e0+6:2408:x1874622863783552:12345-192.168.203.31@tcp:4:dd.0 Request processed in 117978us (118283us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1787780181.163254:0:18755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 0 00000100:00100000:1.0:1787780181.163294:0:18755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 1 00000100:00100000:1.0:1787780181.163307:0:18755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347dacf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6e302a01-7f05-4001-b9ff-8e623671b6e0+5:2408:x1874622863783680:12345-192.168.203.31@tcp:4:dd.0 00002000:00010000:1.0:1787780181.163346:0:18755:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 4194304, mtime: 0x6a8f5c55, atime: 0x6a8f5c53, ctime: 0x6a8f5c55, blocks: 0x2000 00010000:00010000:1.0:1787780181.163352:0:18755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8d3477e/0xc8fc0a5179961fbb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780181.163364:0:18755:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=589s v=(0 0) 00010000:00010000:1.0:1787780181.163369:0:18755:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787780181.163375:0:18755:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d8d3477e/0xc8fc0a5179961fbb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780181.163387:0:18755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d8d3477e/0xc8fc0a5179961fbb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787780181.218115:0:18745:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934600 is committed 00002000:00010000:1.0:1787780181.218666:0:18755:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 4194304 -> 7654321 00002000:00010000:1.0:1787780181.218673:0:18755:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 8192 -> 14952 00010000:00010000:1.0:1787780181.218691:0:18755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8d3477e/0xc8fc0a5179961fbb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780181.218705:0:18755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d8d3477e/0xc8fc0a5179961fbb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780181.218714:0:18755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d8d3477e/0xc8fc0a5179961fbb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780181.218722:0:18755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0477869000 already unused, calling callback (ffffffffc0d97420) 00010000:00010000:1.0:1787780181.218727:0:18755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8d3477e/0xc8fc0a5179961fbb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780181.218750:0:18755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8d3477e/0xc8fc0a5179961fbb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780181.218781:0:18755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d8d3477e/0xc8fc0a5179961fbb lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787780181.218789:0:18755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d8d3477e/0xc8fc0a5179961fbb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787780181.219065:0:18755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347dacf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6e302a01-7f05-4001-b9ff-8e623671b6e0+5:2408:x1874622863783680:12345-192.168.203.31@tcp:4:dd.0 Request processed in 55757us (174039us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1787780181.219076:0:18755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 1 00010000:00010000:3.0:1787780181.340817:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787780181.788271:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787780181.788296:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c048163e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881697792:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787780181.788364:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780181.788469:0:17248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881697792 00000100:00100000:1.0:1787780181.788477:0:17248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881697792 00000100:00100000:1.0:1787780181.788527:0:17248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787780181.788536:0:17248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046e9bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881697792:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787780181.788569:0:17248:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:1.0:1787780181.788620:0:17248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046e9bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881697792:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780181.788628:0:17248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787780181.788716:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c048163e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881697792:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787780181.789035:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787780181.789047:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347dade00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881697920:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787780181.789078:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787780181.789392:0:17247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881697920 00000100:00100000:0.0:1787780181.789408:0:17247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881697920 00000100:00100000:0.0:1787780181.789456:0:17247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787780181.789464:0:17247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c048163e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881697920:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787780181.789486:0:17247:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787780181.789537:0:17247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c048163e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881697920:12345-0@lo:41:osp-pre-1-0.0 Request processed in 73us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780181.789543:0:17247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787780181.789655:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347dade00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881697920:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787780181.917808:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787780181.917884:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787780181.917923:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787780181.917950:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1787780181.917975:0:19793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863784064 00000100:00100000:0.0:1787780181.917983:0:19793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863784064 00000100:00100000:0.0:1787780181.918037:0:19793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863784576 00000100:00100000:0.0:1787780181.918040:0:19793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863784576 00000100:00100000:0.0:1787780181.918062:0:19793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 64 00000100:00100000:0.0:1787780181.918071:0:19793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347dade00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e302a01-7f05-4001-b9ff-8e623671b6e0+5:2411:x1874622863784064:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1787780181.918139:0:19793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347dade00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e302a01-7f05-4001-b9ff-8e623671b6e0+5:2411:x1874622863784064:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 68us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780181.918146:0:19793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 64 00000100:00100000:2.0:1787780181.918260:0:17242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 65 00000100:00100000:2.0:1787780181.918271:0:17242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0347faa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eeb4a73f-1001-4fdb-898b-e22b5d3f1459+5:2411:x1874622863784576:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1787780181.918314:0:17242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0347faa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eeb4a73f-1001-4fdb-898b-e22b5d3f1459+5:2411:x1874622863784576:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 46us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780181.918320:0:17242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 65 00000100:00100000:3.0:1787780181.918803:0:18750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863784320 00000100:00100000:3.0:1787780181.918809:0:18750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863784320 00000100:00100000:3.0:1787780181.918878:0:18750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 27 00000100:00100000:3.0:1787780181.918887:0:18750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477843480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e302a01-7f05-4001-b9ff-8e623671b6e0+5:2411:x1874622863784320:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1787780181.918928:0:18750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477843480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e302a01-7f05-4001-b9ff-8e623671b6e0+5:2411:x1874622863784320:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 43us (1004us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780181.918935:0:18750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 27 00000100:00080000:3.0:1787780181.918954:0:17238:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787780181.918959:0:17238:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787780181.919006:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787780181.919057:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787780181.919085:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787780181.919181:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787780181.919198:0:17242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863783936 00000100:00100000:3.0:1787780181.919202:0:17242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863783936 00000100:00100000:3.0:1787780181.919222:0:17242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863784448 00000100:00100000:3.0:1787780181.919225:0:17242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863784448 00000100:00100000:3.0:1787780181.919248:0:17242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 66 00000100:00100000:3.0:1787780181.919255:0:17242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c047798b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e302a01-7f05-4001-b9ff-8e623671b6e0+22:2411:x1874622863783936:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1787780181.919289:0:17242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c047798b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e302a01-7f05-4001-b9ff-8e623671b6e0+22:2411:x1874622863783936:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 34us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780181.919296:0:17242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 66 00000100:00100000:3.0:1787780181.919309:0:17242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 67 00000100:00100000:3.0:1787780181.919316:0:17242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c04779883c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eeb4a73f-1001-4fdb-898b-e22b5d3f1459+6:2411:x1874622863784448:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1787780181.919342:0:17242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c04779883c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eeb4a73f-1001-4fdb-898b-e22b5d3f1459+6:2411:x1874622863784448:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 27us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780181.919348:0:17242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 67 00000100:00080000:3.0:1787780181.919363:0:17238:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787780181.919400:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1787780181.919428:0:18750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863784832 00000100:00100000:3.0:1787780181.919438:0:18750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863784832 00000100:00100000:3.0:1787780181.919460:0:18750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863784192 00000100:00100000:3.0:1787780181.919462:0:18750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863784192 00000100:00100000:3.0:1787780181.919473:0:18750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863784704 00000100:00100000:3.0:1787780181.919476:0:18750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863784704 00000100:00100000:3.0:1787780181.919489:0:18750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 28 00000100:00100000:3.0:1787780181.919494:0:18750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c047798ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eeb4a73f-1001-4fdb-898b-e22b5d3f1459+5:2411:x1874622863784832:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1787780181.919518:0:18750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c047798ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eeb4a73f-1001-4fdb-898b-e22b5d3f1459+5:2411:x1874622863784832:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 24us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780181.919523:0:18750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 28 00000100:00100000:3.0:1787780181.919532:0:18750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 29 00000100:00100000:3.0:1787780181.919538:0:18750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477989680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e302a01-7f05-4001-b9ff-8e623671b6e0+5:2411:x1874622863784192:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1787780181.919558:0:18750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477989680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e302a01-7f05-4001-b9ff-8e623671b6e0+5:2411:x1874622863784192:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 21us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780181.919563:0:18750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 29 00000100:00100000:3.0:1787780181.919641:0:18750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 30 00000100:00100000:3.0:1787780181.919649:0:18750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c047798a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eeb4a73f-1001-4fdb-898b-e22b5d3f1459+5:2411:x1874622863784704:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1787780181.919674:0:18750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c047798a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eeb4a73f-1001-4fdb-898b-e22b5d3f1459+5:2411:x1874622863784704:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 25us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1787780181.919679:0:18750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 30 00000100:00080000:3.0:1787780181.919693:0:17238:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787780181.919696:0:17238:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787780181.920034:0:17236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622863783808 00000100:00100000:1.0:1787780181.920039:0:17236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622863783808 00000100:00100000:1.0:1787780181.920084:0:17236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 167 00000100:00100000:1.0:1787780181.920091:0:17236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046f20f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6cfa51b-ab50-4fc0-ae19-b724d7d272e4+13:2411:x1874622863783808:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1787780181.920132:0:17236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046f20f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6cfa51b-ab50-4fc0-ae19-b724d7d272e4+13:2411:x1874622863783808:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 43us (2335us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780181.920138:0:17236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 167 00010000:00010000:2.0:1787780182.366135:0:18397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787780182.960815:0:20422:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:1.0:1787780183.388371:0:17231:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787780184.348303:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c048163ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881698048:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787780184.348373:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780184.348501:0:18752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881698048 00000100:00100000:1.0:1787780184.348510:0:18752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881698048 00000100:00100000:1.0:1787780184.348573:0:18752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787780184.348583:0:18752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046e9bde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881698048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787780184.348611:0:18752:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1787780184.348659:0:18752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046e9bde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881698048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780184.348666:0:18752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787780184.348710:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c048163ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881698048:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1787780184.348764:0:17238:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787780184.349049:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c048163de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881698304:0@lo:400:kworker.0 00000100:00100000:1.0:1787780184.349078:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780184.349102:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04816203c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874622881698816:0@lo:400:kworker.0 00000100:00100000:1.0:1787780184.349125:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780184.349142:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0481623840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1874622881699328:0@lo:400:kworker.0 00000100:00100000:1.0:1787780184.349164:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780184.349182:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1787780184.349188:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c048163ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:3642:1874622881698176:0@lo:400:kworker.0 00000100:00100000:1.0:1787780184.349211:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780184.349231:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04816221c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874622881698688:0@lo:400:kworker.0 00000100:00100000:1.0:1787780184.349271:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780184.349289:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0481622580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1874622881699200:0@lo:400:kworker.0 00000100:00100000:1.0:1787780184.349323:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780184.349354:0:18276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881698304 00000100:00100000:1.0:1787780184.349359:0:18276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881698304 00000100:00100000:1.0:1787780184.349384:0:18276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881698688 00000100:00100000:1.0:1787780184.349387:0:18276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881698688 00000100:00100000:1.0:1787780184.349413:0:18276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787780184.349420:0:18276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477af03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1874622881698304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787780184.349460:0:18276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477af03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1874622881698304:12345-0@lo:400:kworker.0 Request processed in 39us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780184.349467:0:18276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787780184.349481:0:18276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787780184.349486:0:18276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477af1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1874622881698688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787780184.349513:0:18276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477af1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1874622881698688:12345-0@lo:400:kworker.0 Request processed in 26us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780184.349518:0:18276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787780184.349536:0:18750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881698816 00000100:00100000:1.0:1787780184.349539:0:18750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881698816 00000100:00100000:1.0:1787780184.349571:0:18750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787780184.349578:0:18750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477af0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1874622881698816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787780184.349608:0:18750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477af0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1874622881698816:12345-0@lo:400:kworker.0 Request processed in 31us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780184.349614:0:18750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787780184.349632:0:17242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881699328 00000100:00100000:1.0:1787780184.349635:0:17242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881699328 00000100:00100000:1.0:1787780184.349657:0:17242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881699200 00000100:00100000:1.0:1787780184.349667:0:17242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881699200 00000100:00100000:1.0:1787780184.349693:0:17242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787780184.349699:0:17242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0477af3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1874622881699328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787780184.349728:0:17242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0477af3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1874622881699328:12345-0@lo:400:kworker.0 Request processed in 29us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780184.349734:0:17242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787780184.349746:0:17242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787780184.349751:0:17242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c034928da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1874622881699200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787780184.349774:0:17242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c034928da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1874622881699200:12345-0@lo:400:kworker.0 Request processed in 23us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780184.349780:0:17242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787780184.349796:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881698176 00000100:00100000:1.0:1787780184.349800:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881698176 00000100:00100000:1.0:1787780184.349823:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1787780184.349829:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046f20c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+24:3642:x1874622881698176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787780184.349888:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046f20c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a551391-c6f4-42cf-bfe4-f12cef7d26fb+24:3642:x1874622881698176:12345-0@lo:400:kworker.0 Request processed in 58us (676us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780184.349893:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1787780184.349938:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c048163ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8a551391-c6f4-42cf-bfe4-f12cef7d26fb:3642:1874622881698176:0@lo:400:kworker.0 00000100:00100000:1.0:1787780184.349949:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04816221c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874622881698688:0@lo:400:kworker.0 00000100:00100000:1.0:1787780184.349957:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0481622580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1874622881699200:0@lo:400:kworker.0 00000100:00100000:1.0:1787780184.349966:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c048163de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881698304:0@lo:400:kworker.0 00000100:00100000:1.0:1787780184.349975:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04816203c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874622881698816:0@lo:400:kworker.0 00010000:00080000:1.0:1787780184.349986:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0481623840 x1874622881699328/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787780200 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787780184.350003:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0481623840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1874622881699328:0@lo:400:kworker.0 00000100:00080000:1.0:1787780184.350041:0:17238:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787780184.350045:0:17238:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787780184.350047:0:17238:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787780184.350055:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0481622940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874622881698560:0@lo:400:kworker.0 00000100:00100000:1.0:1787780184.350079:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780184.350096:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0481621680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874622881699072:0@lo:400:kworker.0 00000100:00100000:1.0:1787780184.350114:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780184.350127:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0477af0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1874622881699584:0@lo:400:kworker.0 00000100:00100000:1.0:1787780184.350143:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780184.350157:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1787780184.350162:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c04816212c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881698432:0@lo:400:kworker.0 00000100:00100000:1.0:1787780184.350179:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780184.350194:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0481620b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881698944:0@lo:400:kworker.0 00000100:00100000:1.0:1787780184.350211:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780184.350225:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0481620f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1874622881699456:0@lo:400:kworker.0 00000100:00100000:1.0:1787780184.350240:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787780184.350261:0:19793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881698560 00000100:00100000:1.0:1787780184.350264:0:19793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881698560 00000100:00100000:1.0:1787780184.350279:0:19793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881699072 00000100:00100000:1.0:1787780184.350281:0:19793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881699072 00000100:00100000:1.0:1787780184.350289:0:19793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881699584 00000100:00100000:1.0:1787780184.350291:0:19793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881699584 00000100:00100000:1.0:1787780184.350305:0:19793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881699456 00000100:00100000:1.0:1787780184.350307:0:19793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881699456 00000100:00100000:1.0:1787780184.350320:0:19793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787780184.350332:0:19793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c034928f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874622881698560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787780184.350366:0:19793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c034928f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874622881698560:12345-0@lo:400:kworker.0 Request processed in 35us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780184.350371:0:19793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787780184.350383:0:19793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787780184.350389:0:19793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c034928fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1874622881699072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787780184.350427:0:19793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c034928fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1874622881699072:12345-0@lo:400:kworker.0 Request processed in 38us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780184.350433:0:19793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787780184.350444:0:19793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787780184.350449:0:19793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c034928de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1874622881699584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787780184.350474:0:19793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c034928de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1874622881699584:12345-0@lo:400:kworker.0 Request processed in 26us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780184.350480:0:19793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787780184.350491:0:19793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787780184.350496:0:19793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c034928e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1874622881699456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787780184.350520:0:19793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c034928e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1874622881699456:12345-0@lo:400:kworker.0 Request processed in 25us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780184.350525:0:19793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787780184.350541:0:18748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881698432 00000100:00100000:1.0:1787780184.350544:0:18748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881698432 00000100:00100000:1.0:1787780184.350565:0:18748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881698944 00000100:00100000:1.0:1787780184.350567:0:18748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881698944 00000100:00100000:1.0:1787780184.350584:0:18748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787780184.350589:0:18748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c034928c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881698432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787780184.350617:0:18748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c034928c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1874622881698432:12345-0@lo:400:kworker.0 Request processed in 27us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780184.350629:0:18748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787780184.350641:0:18748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787780184.350646:0:18748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c034928ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881698944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787780184.350673:0:18748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c034928ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874622881698944:12345-0@lo:400:kworker.0 Request processed in 28us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1787780184.350678:0:18748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:1.0:1787780184.350699:0:17238:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787780184.350715:0:17238:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787780184.350717:0:17238:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787780184.350718:0:17238:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787780184.350738:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 2 00000004:00080000:1.0:1787780184.350744:0:3644:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c03488e30c0, transno 8589934596 00000004:00080000:1.0:1787780184.350754:0:3644:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934598 committed transno 8589934598 00000100:00100000:1.0:1787780184.350771:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c04816212c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874622881698432:0@lo:400:kworker.0 00000100:00100000:1.0:1787780184.350783:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0481620b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874622881698944:0@lo:400:kworker.0 00000100:00100000:1.0:1787780184.350792:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0481620f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1874622881699456:0@lo:400:kworker.0 00000100:00100000:1.0:1787780184.350800:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0481622940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874622881698560:0@lo:400:kworker.0 00000100:00100000:1.0:1787780184.350808:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0481621680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874622881699072:0@lo:400:kworker.0 00010000:00080000:1.0:1787780184.350819:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c0477af0000 x1874622881699584/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787780200 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787780184.350829:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0477af0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1874622881699584:0@lo:400:kworker.0 00000100:00100000:2.0:1787780184.352885:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c047798b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881699712:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787780184.352949:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787780184.353000:0:18752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881699712 00000100:00100000:2.0:1787780184.353008:0:18752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881699712 00000100:00100000:2.0:1787780184.353050:0:18752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787780184.353057:0:18752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046e9bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881699712:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787780184.353077:0:18752:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1787780184.353115:0:18752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046e9bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874622881699712:12345-0@lo:13:osp-pre-1-1.0 Request processed in 58us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1787780184.353122:0:18752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787780184.353164:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c047798b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874622881699712:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1787780184.418308:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787780184.862166:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0347fa8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881699840:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787780184.862236:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787780184.862363:0:18752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874622881699840 00000100:00100000:0.0:1787780184.862371:0:18752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874622881699840 00000100:00100000:0.0:1787780184.862429:0:18752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787780184.862438:0:18752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c046e9bed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1874622881699840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787780184.862468:0:18752:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915857920 avail 3684335616 00000100:00100000:0.0:1787780184.862517:0:18752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c046e9bed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1874622881699840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1787780184.862539:0:18752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787780184.862585:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0347fa8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874622881699840:0@lo:13:osp-pre-0-0.0 Debug log: 44432 lines, 44432 kept, 0 dropped, 0 bad.